-- Logs begin at Thu 2022-05-26 11:44:20 UTC, end at Thu 2022-05-26 13:04:03 UTC. -- May 26 12:28:54.367119 dv-cinder-819667-4-iscsi systemd[1]: Starting Devstack devstack@n-api.service... May 26 12:28:54.374646 dv-cinder-819667-4-iscsi devstack@n-api.service[103295]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini May 26 12:28:54.377493 dv-cinder-819667-4-iscsi devstack@n-api.service[103295]: *** Starting uWSGI 2.0.18-debian (64bit) on [Thu May 26 12:28:54 2022] *** May 26 12:28:54.377493 dv-cinder-819667-4-iscsi devstack@n-api.service[103295]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 May 26 12:28:54.377493 dv-cinder-819667-4-iscsi devstack@n-api.service[103295]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 May 26 12:28:54.377493 dv-cinder-819667-4-iscsi devstack@n-api.service[103295]: nodename: dv-cinder-819667-4-iscsi May 26 12:28:54.377493 dv-cinder-819667-4-iscsi devstack@n-api.service[103295]: machine: x86_64 May 26 12:28:54.377493 dv-cinder-819667-4-iscsi devstack@n-api.service[103295]: clock source: unix May 26 12:28:54.377493 dv-cinder-819667-4-iscsi devstack@n-api.service[103295]: pcre jit disabled May 26 12:28:54.377493 dv-cinder-819667-4-iscsi devstack@n-api.service[103295]: detected number of CPU cores: 4 May 26 12:28:54.377493 dv-cinder-819667-4-iscsi devstack@n-api.service[103295]: current working directory: / May 26 12:28:54.377493 dv-cinder-819667-4-iscsi devstack@n-api.service[103295]: detected binary path: /usr/bin/uwsgi-core May 26 12:28:54.377493 dv-cinder-819667-4-iscsi devstack@n-api.service[103295]: your processes number limit is 47680 May 26 12:28:54.378172 dv-cinder-819667-4-iscsi devstack@n-api.service[103295]: your memory page size is 4096 bytes May 26 12:28:54.378172 dv-cinder-819667-4-iscsi devstack@n-api.service[103295]: detected max file descriptor number: 2048 May 26 12:28:54.378172 dv-cinder-819667-4-iscsi devstack@n-api.service[103295]: lock engine: pthread robust mutexes May 26 12:28:54.378172 dv-cinder-819667-4-iscsi devstack@n-api.service[103295]: thunder lock: enabled May 26 12:28:54.378172 dv-cinder-819667-4-iscsi devstack@n-api.service[103295]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 May 26 12:28:54.378172 dv-cinder-819667-4-iscsi devstack@n-api.service[103295]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] May 26 12:28:54.421535 dv-cinder-819667-4-iscsi devstack@n-api.service[103295]: Python main interpreter initialized at 0x55681a72f9c0 May 26 12:28:54.421535 dv-cinder-819667-4-iscsi devstack@n-api.service[103295]: python threads support enabled May 26 12:28:54.421535 dv-cinder-819667-4-iscsi devstack@n-api.service[103295]: your server socket listen backlog is limited to 100 connections May 26 12:28:54.421535 dv-cinder-819667-4-iscsi devstack@n-api.service[103295]: your mercy for graceful operations on workers is 90 seconds May 26 12:28:54.421893 dv-cinder-819667-4-iscsi devstack@n-api.service[103295]: mapped 403077 bytes (393 KB) for 2 cores May 26 12:28:54.421893 dv-cinder-819667-4-iscsi devstack@n-api.service[103295]: *** Operational MODE: preforking *** May 26 12:28:54.422232 dv-cinder-819667-4-iscsi devstack@n-api.service[103295]: *** uWSGI is running in multiple interpreter mode *** May 26 12:28:54.422232 dv-cinder-819667-4-iscsi devstack@n-api.service[103295]: spawned uWSGI master process (pid: 103295) May 26 12:28:54.422445 dv-cinder-819667-4-iscsi systemd[1]: Started Devstack devstack@n-api.service. May 26 12:28:54.423494 dv-cinder-819667-4-iscsi devstack@n-api.service[103295]: spawned uWSGI worker 1 (pid: 103296, cores: 1) May 26 12:28:54.423494 dv-cinder-819667-4-iscsi devstack@n-api.service[103295]: spawned uWSGI worker 2 (pid: 103297, cores: 1) May 26 12:28:54.423494 dv-cinder-819667-4-iscsi devstack@n-api.service[103295]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... May 26 12:28:55.568062 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. May 26 12:28:55.569475 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. May 26 12:28:56.288132 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 26 12:28:56.288132 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: from cryptography.utils import int_from_bytes May 26 12:28:56.288447 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 26 12:28:56.288447 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: from cryptography.utils import int_from_bytes May 26 12:28:56.288965 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 26 12:28:56.288965 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: from cryptography.utils import int_from_bytes May 26 12:28:56.289299 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 26 12:28:56.289299 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: from cryptography.utils import int_from_bytes May 26 12:28:58.853739 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 26 12:28:58.854435 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=103297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 26 12:28:58.854537 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=103297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 26 12:28:58.854877 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 26 12:28:58.855023 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 26 12:28:58.855403 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=103297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 26 12:28:58.855485 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=103296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 26 12:28:58.855607 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=103297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:28:58.855754 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=103296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 26 12:28:58.855856 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=103297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:28:58.856141 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 26 12:28:58.856274 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=103297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:28:58.856356 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=103296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 26 12:28:58.856434 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=103297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:28:58.856778 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=103296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:28:58.857020 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=103297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:28:58.857119 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=103297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:28:58.857197 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=103296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:28:58.857382 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=103297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:28:58.857482 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=103296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:28:58.857732 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=103296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:28:58.857862 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=103297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:28:58.858059 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=103297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:28:58.858190 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=103296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:28:58.858286 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:28:58.858379 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=103296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:28:58.858642 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=103297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:28:58.858756 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=103296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:28:58.859087 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-819667-4-iscsi {{(pid=103297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:28:58.859297 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=103296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:28:58.859668 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=103297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:28:58.859824 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=103296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:28:58.859939 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:28:58.860232 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=103297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:28:58.860374 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=103296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:28:58.860518 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=103297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:28:58.860615 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-819667-4-iscsi {{(pid=103296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:28:58.860868 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=103297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:28:58.861001 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=103296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:28:58.861168 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=103297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:28:58.861271 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=103296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:28:58.861497 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=103296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:28:58.861596 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=103297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:28:58.861808 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=103297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:28:58.861947 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=103296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:28:58.862102 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=103296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:28:58.862316 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=103297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:28:58.862473 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=103296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:28:58.863686 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=103296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:28:58.863902 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=103297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:28:58.863902 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=103297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:28:58.864223 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=103296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:28:58.864436 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=103297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:28:58.864637 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=103296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:28:58.864820 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=103297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:28:58.865018 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=103296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:28:58.865196 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=103297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:28:58.865382 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=103296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:28:58.865534 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=103297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:28:58.865745 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=103296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:28:58.865897 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=103297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:28:58.866108 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=103296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:28:58.866297 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=103297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:28:58.866487 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=103296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:28:58.866674 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=103297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:28:58.866861 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=103296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:28:58.867040 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=103297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:28:58.867194 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=103296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:28:58.867416 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-819667-4-iscsi {{(pid=103297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:28:58.867642 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=103296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:28:58.867789 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=103297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:28:58.867967 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=103296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:28:58.868202 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=103297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:28:58.868389 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-819667-4-iscsi {{(pid=103296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:28:58.868539 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=103297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:28:58.868699 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=103296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:28:58.868827 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=103297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:28:58.868985 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=103296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:28:58.869118 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=103297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:28:58.869290 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=103296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:28:58.869413 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=103297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:28:58.869532 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=103296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:28:58.869666 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=103297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:28:58.869788 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=103296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:28:58.869906 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=103297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:28:58.870052 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=103296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:28:58.870179 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=103297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:28:58.870307 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=103296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:28:58.870436 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=103297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:28:58.870563 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=103296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:28:58.870689 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=103297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:28:58.870809 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=103296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:28:58.870934 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=103297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:28:58.871079 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=103296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:28:58.871200 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=103297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:28:58.871346 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=103296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:28:58.871467 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=103297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:28:58.871605 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=103296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:28:58.871739 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=103297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:28:58.871882 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=103296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:28:58.872004 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=103297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:28:58.872123 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=103296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:28:58.872254 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=103297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:28:58.872374 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=103296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:28:58.872499 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=103297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:28:58.872631 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=103296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:28:58.872769 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=103297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:28:58.872769 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=103297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:28:58.873015 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=103296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:28:58.873137 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=103297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:28:58.873267 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=103296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:28:58.873267 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=103296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:28:58.873505 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=103297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:28:58.873624 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=103296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:28:58.873745 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=103297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:28:58.873865 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=103296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:28:58.874023 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=103297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:28:58.874184 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=103296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:28:58.874311 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=103297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:28:58.874311 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=103297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:28:58.874542 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=103296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:28:58.874666 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=103297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:28:58.874861 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=103296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:28:58.874861 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=103296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:28:58.875127 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=103297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:28:58.875335 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=103296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:28:58.875455 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=103297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:28:58.875693 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=103296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:28:58.875693 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=103296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:28:58.875926 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=103297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:28:58.876045 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=103296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:28:58.876162 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=103297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:28:58.876292 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=103296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:28:58.876415 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=103297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:28:58.876538 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=103296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:28:58.876668 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=103297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:28:58.876905 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=103296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:28:58.877030 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=103297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:28:58.877165 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=103296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:28:58.877286 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=103297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:28:58.877404 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=103296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:28:58.877522 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=103297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:28:58.877652 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=103296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:28:58.877772 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=103297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:28:58.877900 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=103296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:28:58.878021 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=103297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:28:58.878145 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=103296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:28:58.878265 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=103297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:28:58.878390 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=103296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:28:58.878515 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=103297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:28:58.878643 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=103296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:28:58.878763 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=103297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:28:58.878885 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=103296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:28:58.879039 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.75 {{(pid=103297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:28:58.879179 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=103296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:28:58.879300 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.75 {{(pid=103297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:28:58.879623 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.75 {{(pid=103296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:28:58.879820 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=103297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:28:58.879965 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.75 {{(pid=103296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:28:58.880098 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=103297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:28:58.880231 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=103296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:28:58.880374 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=103297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:28:58.880505 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=103296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:28:58.880633 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=103297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:28:58.880764 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=103296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:28:58.880891 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=103297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:28:58.881096 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=103296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:28:58.881298 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=103297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:28:58.881446 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=103296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:28:58.881584 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=103297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:28:58.881730 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=103296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:28:58.881851 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=103297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:28:58.881971 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=103296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:28:58.882100 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=103297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:28:58.882311 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=103296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:28:58.882491 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=103297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:28:58.882637 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=103296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:28:58.882762 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=103297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:28:58.882884 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=103296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:28:58.883092 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=103297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:28:58.883224 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=103296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:28:58.883346 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=103297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:28:58.883502 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=103296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:28:58.883672 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=103297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:28:58.883805 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=103296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:28:58.883927 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=103297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:28:58.884071 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=103296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:28:58.884197 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=103297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:28:58.884407 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=103296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:28:58.884599 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=103297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:28:58.884747 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=103296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:28:58.884874 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=103297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:28:58.884994 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=103296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:28:58.885114 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=103297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:28:58.885308 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=103296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:28:58.885501 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=103297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:28:58.885650 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=103296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:28:58.885783 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=103297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:28:58.885917 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=103296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:28:58.886039 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=103297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:28:58.886158 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=103296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:28:58.886278 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=103297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:28:58.886487 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=103296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:28:58.886666 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=103297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:28:58.886802 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=103296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:28:58.886942 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=103297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:28:58.887066 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=103296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:28:58.887186 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=103297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:28:58.887392 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=103296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:28:58.887645 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=103297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:28:58.887783 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=103296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:28:58.887914 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=103297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:28:58.888037 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=103296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:28:58.888247 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=103297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:28:58.888382 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=103296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:28:58.888504 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=103297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:28:58.888633 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=103296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:28:58.888760 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=103297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:28:58.888888 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=103296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:28:58.889022 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=103297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:28:58.889190 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=103296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:28:58.889328 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=103297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:28:58.889498 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=103296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:28:58.889630 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=103297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:28:58.889839 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=103296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:28:58.890030 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=103297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:28:58.890164 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=103296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:28:58.890288 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=103297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:28:58.890492 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=103296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:28:58.890686 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=103297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:28:58.890847 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=103296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:28:58.890973 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=103297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:28:58.891104 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=103296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:28:58.891209 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=103297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:28:58.891339 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=103296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:28:58.891468 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=103297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:28:58.891638 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=103296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:28:58.891782 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=103297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:28:58.891978 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=103296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:28:58.892158 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=103297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:28:58.892289 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=103296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:28:58.892413 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=103297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:28:58.892557 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=103296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:28:58.892706 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=103297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:28:58.892875 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=103296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:28:58.893005 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=103297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:28:58.893201 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=103296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:28:58.893380 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=103297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:28:58.893526 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=103296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:28:58.893668 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=103297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:28:58.893794 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=103296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:28:58.893914 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=103297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:28:58.894109 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=103296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:28:58.894289 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=103297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:28:58.894419 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=103296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:28:58.894562 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=103297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:28:58.894697 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=103296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:28:58.894820 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=103297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:28:58.894977 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=103296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:28:58.895117 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=103297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:28:58.895271 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=103296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:28:58.895416 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=103297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:28:58.895589 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=103296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:28:58.895712 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=103297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:28:58.895892 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=103296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:28:58.896023 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=103297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:28:58.896227 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=103296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:28:58.896408 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=103297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:28:58.896540 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=103296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:28:58.896665 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=103297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:28:58.896786 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=103296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:28:58.896919 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=103297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:28:58.897059 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=103296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:28:58.897185 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=103297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:28:58.897378 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=103296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:28:58.897502 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=103297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:28:58.897697 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=103296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:28:58.897815 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=103297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:28:58.898007 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=103296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:28:58.898139 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=103297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:28:58.898315 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=103296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:28:58.898438 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=103297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:28:58.898629 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=103296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:28:58.898762 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=103297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:58.898948 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=103296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:28:58.899085 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=103297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:58.899285 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=103296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:58.899409 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=103297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:58.899634 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=103297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:58.899781 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=103296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:58.899980 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=103296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:58.900105 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=103297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:58.900295 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=103296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:58.900428 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=103297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:58.900627 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=103297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:58.900759 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=103296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:58.900946 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=103297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:58.901083 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=103296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:58.901265 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=103297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:58.901390 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=103296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:58.901576 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=103296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:58.901699 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=103297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:58.901888 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=103296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:58.902011 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=103297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:58.902204 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=103297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:58.902326 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=103296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:58.902516 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=103296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:58.902651 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=103297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:58.902828 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=103296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:58.902969 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=103297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:58.903139 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=103296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:58.903263 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=103297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:58.903458 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=103296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:58.903656 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=103297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:58.903863 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=103296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:58.903994 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=103297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:58.904124 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=103297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:58.904245 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=103296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:58.904449 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=103297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:58.904585 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=103296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:58.904732 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=103296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:58.904855 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=103297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:58.905050 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=103296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:58.905189 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=103297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:58.905360 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=103296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:58.905486 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=103297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:58.905675 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=103296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:58.905811 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=103297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:58.906088 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=103296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:58.906256 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=103297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:58.906391 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=103296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:58.906514 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=103297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:58.906706 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=103296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:58.906831 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=103297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:58.907049 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=103296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:58.907174 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=103297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:58.907392 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=103297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:58.907524 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=103296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:58.907812 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=103296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:58.907933 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=103297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:58.908118 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=103297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:58.908256 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=103296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:58.908432 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=103297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:58.908559 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=103296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:58.908742 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=103296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:58.908869 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=103297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:58.909057 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=103296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:58.909192 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=103297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:58.909369 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=103296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:58.909496 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=103297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:58.909692 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=103297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:58.909815 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=103296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:58.910020 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=103297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:58.910158 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=103296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:58.910331 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=103296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:58.910454 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=103297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:58.910647 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=103297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:58.910772 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=103296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:58.910952 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=103297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:58.911078 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=103296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:58.911265 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=103296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:58.911387 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=103297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:58.911601 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=103296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:58.911743 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=103297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:58.911914 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=103296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:58.912039 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=103297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:58.912229 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=103296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:58.912353 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=103297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:58.912553 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=103297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:58.912676 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=103296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:58.912864 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=103296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:58.912995 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=103297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:58.913179 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=103296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:58.913302 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=103297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:58.913491 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=103297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:58.913614 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=103296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:58.913807 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=103296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:58.913937 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=103297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:58.914119 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=103297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:58.914241 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=103296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:58.914426 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=103296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:58.914548 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=103297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:58.914733 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=103297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:58.914857 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=103296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:58.915035 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=103296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:58.915164 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=103297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:58.915340 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=103296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:58.915510 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=103297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:58.915654 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=103297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:58.915774 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=103296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:58.915966 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=103296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:58.916089 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=103297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:58.916270 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=103296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:58.916415 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=103297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:58.916590 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=103297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:58.916729 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=103296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:58.916916 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=103296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:58.917041 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=103297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:58.917221 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=103297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:58.917353 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=103296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:58.917534 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=103297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:58.917664 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=103296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:58.917844 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=103296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:58.917968 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=103297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:58.918155 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=103296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:58.918292 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=103297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:58.918463 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=103297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:58.918585 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=103296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:58.918772 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=103296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:58.918903 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=103297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:58.919080 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=103296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:58.919212 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=103297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:58.919387 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=103297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:58.919509 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=103296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:58.919725 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=103296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:58.919849 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=103297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:58.920033 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=103296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:58.920158 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=103297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:58.920339 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=103297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:58.920465 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=103296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:58.920654 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=103296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:58.920810 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=103297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:58.920946 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=103297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:58.921074 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=103296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:58.921254 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=103297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:58.921380 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=103296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:58.921578 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=103296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:58.921700 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=103297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:58.921887 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=103296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:58.922012 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=103297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:58.922199 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=103297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:58.922336 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=103296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:58.922517 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=103297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:58.922652 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=103296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:58.922832 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=103297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:58.922963 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=103296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:58.923161 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=103297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:58.923286 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=103296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:58.923477 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=103297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:58.923642 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=103296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:58.923819 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=103297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:58.923944 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=103296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:58.924157 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=103297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:58.924290 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=103296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:58.924477 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=103296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:58.924608 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=103297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:58.924789 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=103297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:58.924913 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=103296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:58.925119 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=103297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:58.925244 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=103296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:58.925423 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=103296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:58.925559 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=103297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:58.925748 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=103296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:58.925873 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=103297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:58.926055 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=103297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:58.926179 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=103296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:58.926368 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=103297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:58.926493 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=103296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:58.926671 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=103296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:58.926794 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=103297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:58.926977 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=103297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:58.927100 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=103296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:58.927280 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=103296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:58.927413 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=103297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:58.927610 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=103296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:58.927737 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=103297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:58.927916 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=103297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:58.928039 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=103296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:58.928224 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=103297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:58.928351 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=103296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:58.928526 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=103296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:58.928648 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=103297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:58.928834 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=103297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:58.928956 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=103296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:58.929141 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=103296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:58.929264 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=103297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:58.929445 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=103296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:58.929577 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=103297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:58.929751 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=103296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:58.929884 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=103297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:58.930060 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=103297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:58.930192 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=103296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:58.930368 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=103297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:58.930493 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=103296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:58.930669 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=103296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:58.930806 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=103297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:58.930974 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=103296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:58.931098 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=103297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:58.931278 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=103296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:58.931402 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=103297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:58.931646 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=103296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:58.931786 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=103297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:58.931953 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=103296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:58.932077 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=103297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:58.932295 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=103296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:58.932428 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=103297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:58.932619 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=103297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:58.932820 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=103296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:58.932942 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=103297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:58.933063 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=103296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:58.933237 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=103297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:58.933361 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=103296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:58.933547 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=103296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:58.933671 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=103297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:58.933859 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=103297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:58.933981 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=103296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:58.934168 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=103296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:58.934303 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=103297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:58.934477 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=103296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:58.934611 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=103297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:58.934788 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=103296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:58.934911 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=103297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:58.935098 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=103297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:58.935220 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=103296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:58.935413 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=103296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:58.935577 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=103297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:58.935750 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=103296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:58.935874 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=103297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:58.936072 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=103296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:58.936197 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=103297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:58.936386 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=103297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:58.936508 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=103296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:58.936709 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=103296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:58.936846 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=103297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:58.937015 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=103297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:58.937144 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=103296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:58.937379 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=103297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:58.937537 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=103296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:58.937726 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=103297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:58.938022 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=103296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:58.938146 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=103297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:58.938348 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=103296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:58.938474 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=103297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:58.938682 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=103297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:58.938815 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=103296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:58.938997 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=103297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:58.939123 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=103296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:58.939315 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=103297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:58.939452 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=103296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:58.939656 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=103297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:58.939782 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=103296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:58.939970 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=103296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:58.940093 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=103297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:58.940282 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=103297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:58.940410 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=103296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:58.940592 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=103296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:58.940715 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=103297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:58.940905 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=103296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:58.941037 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=103297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:58.941228 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=103297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:58.941347 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=103296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:58.941523 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=103296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:58.941652 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=103297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:58.941833 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=103297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:58.941966 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=103296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:58.942142 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=103296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:58.942272 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=103297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:58.942458 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=103297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:58.942588 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=103296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:58.942766 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=103296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:58.942898 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=103297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:58.943075 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=103297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:58.943197 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=103296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:58.943388 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=103296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:58.943509 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=103297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:58.943731 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=103296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:58.943872 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=103297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:58.944038 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=103296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:58.944163 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=103297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:58.944355 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=103296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:58.944479 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=103297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:58.944682 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=103297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:58.944813 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=103296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:58.945008 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=103297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:58.945134 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=103296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:58.945316 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=103296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:58.945440 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=103297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:58.945628 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=103297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:58.945760 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=103296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:58.945945 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=103297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:58.946070 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=103296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:58.946255 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=103297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:58.946380 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=103296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:58.946561 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=103296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:58.946685 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=103297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:58.946871 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=103297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:58.946993 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=103296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:58.947179 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=103296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:58.947302 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=103297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:58.947488 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=103296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:58.947645 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=103297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:58.947823 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=103296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:58.947948 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=103297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:58.948129 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=103297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:58.948253 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=103296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:58.948444 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=103296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:58.948580 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=103297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:58.948754 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=103297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:58.948876 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=103296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:58.949057 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=103296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:58.949180 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=103297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:58.949362 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=103297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:58.949486 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=103296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:58.949666 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=103296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:58.949789 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=103297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:58.949971 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=103296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:58.950109 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=103297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:58.950275 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=103296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:58.950400 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=103297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:58.950587 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=103296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:58.950711 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=103297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:58.950909 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=103297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:58.951046 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=103296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:58.951218 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=103296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:58.951341 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=103297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:58.951522 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=103297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:58.951664 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=103296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:58.951869 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=103297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:58.952007 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=103296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:58.952175 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=103296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:58.952298 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=103297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:58.952476 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=103296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:58.952602 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=103297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:58.952800 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=103297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:58.952936 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=103296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:58.953112 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=103297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:58.953275 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=103296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:58.953585 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=103296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:58.953708 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=103297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:58.953895 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=103296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:58.954020 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=103297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:58.954199 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=103296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:58.954324 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=103297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:58.954534 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=103297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:58.954658 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=103296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:58.954842 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=103296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:58.954967 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=103297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:58.955147 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=103296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:58.955271 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=103297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:58.955463 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=103296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:58.955625 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=103297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:58.955802 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=103297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:58.955934 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=103296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:58.956111 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=103296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:58.956233 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=103297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:58.956423 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=103296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:58.956548 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=103297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:58.956734 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=103296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:58.956859 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=103297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:58.957046 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=103297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:58.957175 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=103296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:58.957360 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=103297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:58.957494 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=103296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:58.957671 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=103296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:58.957795 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=103297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:58.957979 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=103297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:58.958103 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=103296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:58.958292 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=103296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:58.958426 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=103297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:58.958601 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=103296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:58.958727 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=103297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:58.958910 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=103297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:58.959039 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=103296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:58.959219 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=103296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:58.959351 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=103297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:58.959528 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=103297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:58.959666 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=103296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:58.959861 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=103297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:58.959986 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=103296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:58.960168 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=103296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:58.960657 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=103297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:58.960841 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=103296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:58.960968 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=103297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:58.961146 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=103296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:58.961419 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=103297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:58.961553 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=103296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:58.961755 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=103297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:58.961881 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=103296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:58.962072 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=103297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:58.962326 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=103296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:58.962450 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=103297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:58.962649 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=103296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:58.962781 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=103297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:58.962960 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=103296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:58.963092 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=103297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:58.963280 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=103296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:58.963404 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=103297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:58.963713 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=103296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:58.963857 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=103297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:58.963982 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=103296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:58.964103 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=103297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:58.964233 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=103296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:58.964363 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=103297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:58.964559 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=103296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:58.964692 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=103297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:58.964883 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=103297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:58.965009 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=103296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:58.965192 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=103297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:58.965331 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=103296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:58.965499 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=103296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:58.965622 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=103297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:58.965802 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=103297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:58.965927 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=103296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:58.966103 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=103296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:58.966234 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=103297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:58.966408 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=103297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:58.966532 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=103296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:58.966710 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=103296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:58.966841 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=103297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:58.967013 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=103297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:58.967137 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=103296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:58.967313 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=103296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:58.967435 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=103297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:58.967638 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=103297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:58.967764 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=103296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:58.967942 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=103296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:58.968066 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=103297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:58.968251 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=103296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:58.968384 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=103297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:58.968676 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=103296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:58.968810 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=103297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:58.969003 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=103296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:58.969133 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=103297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:58.969288 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=103296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:58.969422 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=103297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:58.969593 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=103296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:58.969718 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=103297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:58.969904 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=103296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:58.970029 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=103297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:58.970208 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=103296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:58.970346 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=103297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:58.970531 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=103296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:58.970655 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=103297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:58.970843 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=103296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:58.970976 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=103297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:58.971146 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=103296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:58.971279 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=103297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:58.971449 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=103296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:58.971592 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=103297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:58.971833 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=103297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:58.971956 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=103296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:58.972165 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=103297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:58.972291 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=103296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:58.972510 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=103297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:58.972635 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=103296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:58.972819 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=103297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:58.972950 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=103296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:58.973127 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=103297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:58.973253 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=103296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:58.973456 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=103297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:58.973582 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=103296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:58.973764 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=103297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:58.973887 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=103296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:58.974071 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=103297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:58.974203 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=103296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:58.974378 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=103297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:58.974504 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=103296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:58.974690 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=103297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:58.974815 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=103296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:58.975002 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=103297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:58.975135 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=103296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:58.975304 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=103296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:58.975428 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=103297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:58.975640 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=103297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:58.975777 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=103296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:58.975948 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=103296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:58.976072 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=103297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:58.976252 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=103296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:58.976376 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=103297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:58.976561 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=103297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:58.976693 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=103296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:58.976941 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=103296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:58.977079 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=103297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:58.977202 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=103297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:58.977322 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=103296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:58.977470 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=103297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:58.977617 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=103296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:58.977771 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=103296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:58.977894 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=103297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:58.978085 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=103297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:58.978207 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=103296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:58.978385 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=103296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:58.978527 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=103297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:58.978687 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=103297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:58.978815 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=103296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:58.978999 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=103296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:58.979122 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=103297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:58.979303 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=103296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:58.979429 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=103297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:58.979627 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=103297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:58.979752 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=103296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:58.979939 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=103296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:58.980061 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=103297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:58.980242 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=103297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:58.980366 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=103296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:58.980542 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=103296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:58.980665 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=103297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:58.980850 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=103297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:58.980974 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=103296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:58.981151 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=103296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:58.981276 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=103297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:58.981454 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=103297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:58.981577 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=103296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:58.981758 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=103296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:58.981881 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=103297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:58.982063 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=103296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:58.982187 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=103297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:58.982366 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=103297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:58.982496 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=103296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:58.982672 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=103296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:58.982803 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=103297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:58.982980 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=103296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:58.983104 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=103297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:58.983282 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=103296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:58.983406 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=103297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:58.983607 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=103297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:58.983748 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=103296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:58.983923 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=103297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:58.984085 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=103296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:58.984290 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=103296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:58.984436 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=103297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:58.984709 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=103296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:58.984864 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=103297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:58.984990 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=103296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:58.985111 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=103297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:58.985239 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=103296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:58.985360 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=103297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:58.985482 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=103296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:58.985610 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=103297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:58.985732 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=103296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:58.985860 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=103297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:58.986015 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=103296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:58.986149 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=103297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:58.986349 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=103296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:58.986474 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=103297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:58.986617 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=103296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:58.986750 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=103297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:58.986925 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=103296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:58.987051 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=103297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:58.987227 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=103296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:58.987354 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=103297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:58.987529 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=103297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:58.987683 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=103296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:58.987859 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=103297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:58.987991 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=103296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:58.988165 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=103297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:58.988290 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=103296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:58.988463 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=103296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:58.988587 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=103297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:58.988766 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=103296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:58.988883 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=103297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:58.989066 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=103296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:58.989199 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=103297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:58.989367 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=103296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:58.989501 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=103297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:58.989669 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=103296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:58.989802 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=103297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:58.989974 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=103297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:58.990101 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=103296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:58.990281 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=103297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:58.990405 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=103296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:58.990580 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=103296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:58.990712 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=103297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:58.990888 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=103296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:58.991012 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=103297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:58.991189 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=103296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:58.991313 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=103297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:58.991529 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=103296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:58.991696 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=103297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:58.991856 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=103296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:58.991980 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=103297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:58.992196 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=103297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:58.992329 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=103296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:58.992507 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=103296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:58.992637 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=103297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:58.992816 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=103297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:58.992945 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=103296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:58.993131 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=103297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:58.993256 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=103296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:58.993438 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=103297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:58.993563 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=103296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:58.993746 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=103296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:58.993869 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=103297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:58.994053 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=103297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:58.994176 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=103296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:58.994355 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=103296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:58.994478 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=103297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:58.994658 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=103297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:58.994789 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=103296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:58.994963 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=103297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:58.995088 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=103296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:58.995270 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=103296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:58.995393 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=103297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:58.995595 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=103296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:58.995725 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=103297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:58.995899 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=103296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:58.996035 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=103297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:58.996222 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=103297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:58.996346 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=103296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:58.996530 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=103296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:58.996653 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=103297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:58.996840 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=103296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:58.996966 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=103297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:58.997151 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=103297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:58.997275 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=103296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:58.997462 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=103297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:58.997587 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=103296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:58.997776 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=103297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:58.997914 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=103296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:58.998078 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=103296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:58.998201 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=103297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:58.998386 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=103297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:58.998509 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=103296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:58.998694 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=103296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:58.998826 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=103297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:58.999002 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=103297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:58.999133 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=103296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:58.999309 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=103296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:58.999433 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=103297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:58.999642 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=103296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:58.999974 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=103297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:59.000107 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=103297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:59.000236 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=103296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:59.000364 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=103296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:59.000485 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=103297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:59.000605 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=103296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:59.000745 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=103297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:59.000919 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=103296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:59.001045 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=103297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:59.001229 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=103296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:59.001354 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=103297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:59.001537 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=103296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:59.001666 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=103297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:59.001848 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=103296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:59.001973 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=103297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:59.002156 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=103296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:59.002281 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=103297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:59.002461 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=103296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:59.002586 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=103297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:59.002786 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=103297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:59.002910 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=103296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:59.003094 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=103297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:59.003226 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=103296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:59.003395 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=103296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:59.003519 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=103297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:59.003727 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=103297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:59.003852 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=103296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:59.004031 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=103296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:59.004168 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:59.004342 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=103296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:59.004468 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=103297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:59.004647 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=103296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:59.004772 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=103297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:59.005060 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=103297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:59.005193 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:59.005374 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=103297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:59.005499 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=103296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:59.005684 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=103296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:59.005814 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=103297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:59.005990 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=103296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:59.006123 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=103297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:59.006302 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=103296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:59.006435 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=103297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:59.006606 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=103297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:59.006730 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=103296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:59.006920 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=103296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:59.007058 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:59.007236 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=103296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:59.007369 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=103297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:59.007558 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=103296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:59.007687 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=103297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:59.007951 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=103297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:59.008098 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:59.008260 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=103297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:59.008385 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=103296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:59.008565 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=103297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:59.008697 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=103296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:59.008879 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=103297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:59.009005 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=103296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:59.009186 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=103296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:59.009309 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=103297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:59.009489 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=103296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:59.009613 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=103297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:59.009799 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=103297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:59.009931 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=103296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:59.010113 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=103297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:59.010239 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=103296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:59.010414 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=103296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:59.010536 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=103297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:59.010717 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=103296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:59.010842 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=103297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:59.011020 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=103296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:59.011155 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=103297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:59.011345 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=103296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:59.011469 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:59.011677 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=103296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:59.011805 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=103297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:59.012004 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=103296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:59.012123 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=103297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:59.012420 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:59.012554 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=103297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:59.012736 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=103296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:59.012861 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=103297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:59.013040 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=103296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:59.013164 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=103297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:59.013372 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=103297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:59.013508 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=103296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:59.013701 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=103297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:59.013826 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=103296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:59.014029 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=103297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:59.014153 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=103296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:59.014338 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=103297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:59.014471 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=103296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:59.014653 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=103297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:59.014777 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=103296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:59.014966 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=103297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:59.015101 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=103296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:59.015268 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=103296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:59.015418 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=103297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:59.015641 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=103296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:59.015813 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=103297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:59.015940 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=103296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:59.016265 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=103296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:59.016397 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=103297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:59.016591 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=103297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:59.016714 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=103296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:59.016900 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=103296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:59.017031 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=103297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:59.017215 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=103296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:59.017339 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=103297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:59.017520 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=103296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:59.017653 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=103297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:59.017850 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=103296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:59.017975 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=103297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:59.018174 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=103296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:59.018307 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=103297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:59.018487 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=103296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:59.018622 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:59.018813 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=103296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:59.018938 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=103297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:59.019214 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=103297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:59.019339 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:59.019555 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=103296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:59.019694 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=103297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:59.019863 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=103296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:59.019997 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=103297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:59.020184 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=103297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:59.020308 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=103296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:59.020496 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=103297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:59.020629 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=103296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:59.020793 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=103296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:59.020915 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=103297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:59.021088 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=103296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:59.021220 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=103297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:59.021397 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=103296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:59.021532 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=103297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:59.021700 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=103296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:59.021832 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=103297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:59.022004 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=103296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:59.022136 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=103297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:59.022317 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=103297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:59.022441 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=103296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:59.022620 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=103296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:59.022738 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=103297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:59.022929 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=103297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:59.023052 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=103296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:59.023235 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=103297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:59.023370 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=103296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:59.023560 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=103296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:59.023686 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=103297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:59.023866 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=103296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:59.023992 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=103297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:59.024169 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=103296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:59.024302 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=103297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:59.024493 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=103297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:59.024624 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=103296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:59.024793 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=103296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:59.024926 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=103297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:59.025115 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=103296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:59.025242 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=103297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:59.025429 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=103296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:59.025553 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=103297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:59.025734 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=103297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:59.025906 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=103296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:59.026059 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=103296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:59.026183 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=103297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:59.026365 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=103296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:59.026489 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=103297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:59.026668 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=103297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:59.026804 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=103296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:59.026975 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=103297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:59.027100 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=103296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:59.027277 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=103296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:59.027399 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=103297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:59.027616 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=103296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:59.027763 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=103297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:59.027922 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=103296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:59.028047 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=103297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:59.028244 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=103297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:59.028367 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=103296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:59.028552 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=103296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:59.028676 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=103297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:59.028875 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=103296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:59.029000 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=103297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:59.029200 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=103297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:59.029324 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=103296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:59.029531 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=103296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:59.029656 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=103297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:59.029843 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=103296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:59.029968 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=103297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:59.030171 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=103297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:59.030295 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=103296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:59.030492 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=103297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:59.030617 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=103296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:59.030807 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=103296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:59.030971 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=103297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:59.031171 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=103297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:59.031311 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=103296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:59.031522 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=103296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:59.031678 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=103297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:59.031852 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=103296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:59.031978 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=103297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:59.032160 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=103296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:59.032295 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=103297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:59.032472 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=103296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:59.032605 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=103297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:59.032779 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=103296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:59.032904 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=103297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:59.033086 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=103296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:59.033292 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=103297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:59.033417 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=103296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:59.033545 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=103297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:59.033674 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=103296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:59.033796 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=103297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:59.033976 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=103296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:59.034110 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=103297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:59.034279 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=103296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:59.034404 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=103297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:59.034581 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=103296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:59.034706 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=103297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:59.034903 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=103296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:59.035029 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=103297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:59.035205 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=103296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:59.035331 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=103297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:59.035526 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=103296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:59.035672 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=103297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:59.035858 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=103296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:59.035984 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=103297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:59.036161 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=103296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:59.036286 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=103297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:59.036466 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=103296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:59.036591 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=103297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:59.036771 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=103296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:59.036898 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=103297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:59.037164 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=103296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:59.037308 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=103297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:59.037431 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=103296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:59.037551 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=103297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:59.037748 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=103297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:59.037873 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=103296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:59.038065 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=103296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:59.038188 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=103297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:59.038382 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=103297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:59.038554 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=103296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:59.038711 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=103297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:59.038890 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=103296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:59.039014 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=103297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:59.039204 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=103296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:59.039331 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=103297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:59.039529 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=103296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:59.039771 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=103297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:59.039893 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=103296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:59.040012 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=103297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:59.040172 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=103296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:59.040297 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=103297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:59.040505 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=103296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:59.040631 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=103297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:59.040790 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=103296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:59.040914 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=103297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:59.041104 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=103296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:59.041228 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=103297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:59.041418 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=103296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:59.041545 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=103297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:59.041731 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=103296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:59.041864 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=103297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:59.042040 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=103296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:59.042165 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=103297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:59.042356 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=103296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:59.042613 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=103297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:59.042749 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=103296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:59.042948 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=103297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:59.043073 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=103296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:59.043271 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=103297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:59.043487 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=103296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:59.043645 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=103297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:59.043841 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=103296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:59.043968 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=103297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:59.044159 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=103296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:59.044292 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=103297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:59.044471 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=103296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:59.044605 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=103297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:59.044783 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=103296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:59.044908 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=103297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:59.045096 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=103296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:59.045229 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=103297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:59.045407 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=103296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:59.045532 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=103297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:59.045720 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=103296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:59.045846 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=103297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:59.046030 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=103296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:59.046156 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=103297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:59.046341 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=103296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:59.046466 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=103297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:59.046716 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=103297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:59.046842 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=103296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:59.047121 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=103297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:59.047246 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=103296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:59.047445 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=103297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:59.047591 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=103296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:59.047790 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=103297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:59.047932 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=103296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:59.048108 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=103297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:59.048234 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=103296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:59.048426 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=103297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:59.048554 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=103296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:59.048787 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=103296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:59.048921 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=103297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:59.049106 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=103296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:59.049237 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=103297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:59.049414 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=103297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:59.049537 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=103296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:59.049739 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=103297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:59.049877 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=103296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:59.050060 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=103297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:59.050184 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=103296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:59.050362 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=103296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:59.050492 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=103297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:59.050677 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=103296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:59.050803 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=103297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:59.050992 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=103297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:59.051117 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=103296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:59.051306 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=103296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:59.051428 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=103297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:59.051630 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=103296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:59.051755 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=103297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:59.051941 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=103296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:59.052077 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=103297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:59.052256 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=103297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:59.052380 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=103296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:59.052568 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=103296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:59.052692 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=103297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:59.052881 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=103296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:59.052999 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=103297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:59.053191 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=103296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:59.053325 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=103297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:59.053509 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=103296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:59.053642 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=103297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:59.053822 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=103296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:59.053954 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=103297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:59.054145 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=103296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:59.054280 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=103297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:59.054461 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=103297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:59.054584 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=103296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:59.054781 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=103297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:59.054912 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=103296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:59.055094 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=103296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:59.055307 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=103297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:59.055442 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=103296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:59.055650 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=103297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:59.055777 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=103296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:59.055991 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=103297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:59.056245 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=103296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:59.056381 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=103297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:59.056562 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=103296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:59.056686 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=103297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:59.056894 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=103296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:59.057054 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=103297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:59.057222 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=103296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:59.057349 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=103297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:59.057555 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=103296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:59.057679 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=103297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:59.057864 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=103297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:59.057987 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=103296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:59.058172 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=103297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:59.058298 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=103296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:59.058486 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=103297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:59.058611 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=103296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:59.058791 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=103296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:59.058913 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=103297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:59.059094 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=103297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:59.059219 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=103296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:59.059405 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=103296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:59.059522 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=103297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:59.059740 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=103296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:59.059878 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=103297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:59.060046 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=103297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:59.060170 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=103296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:59.060366 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=103296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:59.060492 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=103297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:59.060677 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=103297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:59.060810 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=103296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:59.060977 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=103296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:59.061210 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=103297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:59.061335 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=103296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:59.061564 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=103297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:59.061689 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=103296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:59.061881 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=103297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:59.062108 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=103296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:59.062270 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=103297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:59.062540 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=103296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:59.062748 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=103297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:59.062883 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=103296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:59.063159 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=103297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:59.063284 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=103296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:59.063474 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=103297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:59.063619 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=103296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:59.063833 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=103297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:59.063979 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=103296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:59.064149 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=103297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:59.064281 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=103296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:59.064459 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=103297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:59.064583 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=103296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:59.064777 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=103297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:59.064910 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=103296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:59.065090 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=103297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:59.065225 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=103296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:59.065399 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=103297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:59.065523 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=103296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:59.065706 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=103297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:59.065841 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=103296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:59.066010 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=103296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:59.066126 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=103297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:59.066316 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=103296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:59.066451 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=103297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:59.066621 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=103297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:59.066747 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=103296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:59.066929 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=103296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:59.067060 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=103297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:59.067234 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=103297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:59.067358 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=103296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:59.067587 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=103296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:59.067741 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=103297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:59.067865 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=103296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:59.067997 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=103297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:59.068176 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=103297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:59.068299 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=103296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:59.068485 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=103297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:59.068619 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=103296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:59.068788 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=103296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:59.068912 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=103297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:59.069092 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=103296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:59.069217 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=103297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:59.069395 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=103297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:59.069519 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=103296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:59.069695 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=103296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:59.069818 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=103297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:59.069999 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=103297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:59.070198 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=103296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:59.070325 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=103296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:59.070443 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=103297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:59.070572 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=103296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:59.070700 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=103297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:59.070884 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=103296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:59.071023 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=103297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:59.071188 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=103296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:59.071319 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=103297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:59.071497 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=103296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:59.071644 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=103297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:59.071824 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=103296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:59.071962 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=103297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:59.072133 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=103297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:59.072259 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=103296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:59.072436 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=103296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:59.072558 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=103297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:59.072747 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=103296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:59.072881 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=103297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:59.073093 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=103297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:59.073220 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=103296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:59.073399 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=103297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:59.073523 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=103296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:59.073718 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=103297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:59.073843 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=103296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:59.074030 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=103297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:59.074155 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=103296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:59.074357 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=103297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:59.074482 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=103296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:59.074670 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=103297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:59.074795 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=103296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:59.074983 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=103297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:59.075108 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=103296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:59.075293 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=103296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:59.075423 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=103297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:59.075630 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=103296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:59.075757 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=103297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:59.075979 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=103296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:59.076193 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=103297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:59.076318 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=103296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:59.076532 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=103297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:59.076823 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=103296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:59.076949 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=103297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:59.077165 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=103296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:59.077295 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=103297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:59.077496 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=103296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:59.077629 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=103297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:59.077827 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=103297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:59.077954 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=103296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:59.078140 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=103297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:59.078266 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=103296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:59.078452 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=103297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:59.078590 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=103296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:59.078779 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=103297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:59.078904 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=103296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:59.079095 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=103297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:59.079219 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=103296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:59.079413 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=103297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:59.079573 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=103296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:59.079754 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=103296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:59.079890 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=103297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:59.080068 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=103297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:59.080191 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=103296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:59.080380 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=103296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:59.080512 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=103297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:59.080691 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=103297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:59.080822 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=103296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:59.081001 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=103296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:59.081124 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=103297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:59.081312 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=103296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:59.081439 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=103297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:59.081624 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=103297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:59.081746 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=103296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:59.081932 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=103296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:59.082062 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=103297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:59.082243 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=103296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:59.082368 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=103297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:59.082553 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=103296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:59.082678 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=103297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:59.082864 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=103296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:59.082996 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=103297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:59.083173 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=103296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:59.083291 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=103297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:59.083483 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=103296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:59.083637 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=103297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:59.083824 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=103296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:59.083962 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=103297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:59.084157 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=103297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:59.084281 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=103296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:59.084477 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=103297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:59.084602 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=103296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:59.084793 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=103296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:59.084929 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=103297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:59.085107 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=103297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:59.085588 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=103296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:59.085773 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=103297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:59.085906 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=103296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:59.086085 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=103296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:59.086226 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=103297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:59.086397 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=103297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:59.086533 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=103296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:59.086705 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=103296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:59.086828 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=103297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:59.087014 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=103296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:59.087148 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=103297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:59.087332 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=103296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:59.087457 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=103297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:59.087660 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=103297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:59.087785 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=103296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:59.087993 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=103296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:59.088118 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=103297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:59.088303 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=103296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:59.088434 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=103297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:59.088689 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=103297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:59.088813 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=103296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:59.089012 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=103297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:59.089150 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=103296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:59.089324 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=103297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:59.089443 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=103296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:59.089641 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=103296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:59.089773 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=103297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:59.089950 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=103296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:59.090075 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=103297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:59.090263 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=103297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:59.090386 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=103296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:59.090581 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=103296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:59.090719 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=103297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:59.090892 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=103297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:59.091022 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=103296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:59.091210 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=103296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:59.091333 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=103297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:59.091524 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=103296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:59.091677 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=103297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:59.091890 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=103296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:59.092024 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=103297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:59.092216 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=103297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:59.092339 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=103296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:59.092528 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=103297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:59.092654 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=103296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:59.092836 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=103297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:59.092962 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=103296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:59.093143 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=103297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:59.093268 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=103296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:59.093499 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=103296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:59.093637 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=103297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:59.093806 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=103296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:59.093932 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=103297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:59.094117 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=103296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:59.094239 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=103297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:59.094472 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=103296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:59.094561 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=103297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:59.094784 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=103296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:59.094878 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=103297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:59.095090 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=103296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:59.095177 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=103297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:59.095394 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=103297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:59.095481 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=103296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:59.095727 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=103297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:59.095816 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=103296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:59.096029 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=103296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:59.096128 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=103297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:59.096333 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=103296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:59.096466 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=103297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:59.096639 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=103296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:59.096764 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=103297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:59.096942 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=103297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:59.097075 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=103296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:59.097249 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=103296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:59.097379 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=103297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:59.097553 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=103297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:59.097684 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=103296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:59.097859 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=103296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:59.097992 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=103297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:59.098164 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=103297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:59.098288 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=103296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:59.098465 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=103296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:59.098590 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=103297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:59.098769 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=103296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:59.098904 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=103297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:59.099072 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=103297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:59.099197 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=103296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:59.099378 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=103296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:59.099502 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=103297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:59.099848 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=103296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:59.099974 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=103297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:59.100116 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=103296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:59.100299 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=103297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:59.100431 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=103296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:59.100562 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=103297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:59.100693 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=103296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:59.100815 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=103297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:59.100935 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=103296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:59.101055 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=103297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:59.101174 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=103296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:59.101295 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=103297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:59.101505 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=103296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:59.101640 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=103297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:59.101821 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=103296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:59.101945 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=103297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:59.102144 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=103296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:59.102277 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=103297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:59.102455 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=103296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:59.102580 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=103297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:59.102778 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=103297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:59.102901 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=103296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:59.103084 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=103296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:59.103217 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=103297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:59.103406 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=103297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:59.103523 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=103296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:59.103746 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=103297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:59.103871 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=103296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:59.104059 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=103296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:59.104195 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=103297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:59.104369 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=103296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:59.104495 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=103297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:59.104684 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=103297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:59.104808 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=103296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:59.104999 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=103296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:59.105130 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=103297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:59.105309 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=103297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:59.105432 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=103296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:59.105619 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=103296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:59.105755 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=103297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:59.105931 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=103296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:59.106064 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=103297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:59.106240 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=103296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:59.106365 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=103297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:59.106553 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=103296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:59.106678 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=103297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:59.106867 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=103297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:59.106999 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=103296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:59.107193 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=103296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:59.107317 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=103297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:59.107504 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=103296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:59.107679 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=103297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:59.107887 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=103297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:59.108012 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=103296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:59.108154 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=103297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:59.108280 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=103296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:59.108465 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=103297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:59.108589 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=103296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:59.108777 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=103296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:59.108908 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=103297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:59.109117 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=103296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:59.109296 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=103297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:59.109423 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=103297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:59.109555 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=103296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:59.109735 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=103297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:59.109869 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=103296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:59.110040 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=103296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:59.110164 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=103297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:59.110352 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=103297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:59.110509 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=103296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:59.110669 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=103297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:59.110829 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=103296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:59.110987 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=103297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:59.111141 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=103296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:59.111319 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=103297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:59.111457 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=103296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:59.111669 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=103297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:59.111795 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=103296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:59.111982 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=103297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:59.112107 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=103296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:59.112311 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=103297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:59.112438 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=103296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:59.112642 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=103297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:59.112766 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=103296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:59.112992 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=103297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:59.113117 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=103296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:59.113307 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=103297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:59.113441 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=103296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:59.113651 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=103297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:59.113777 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=103296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:59.113973 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=103296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:59.114096 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=103297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:59.114287 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=103297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:59.114411 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=103296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:59.114606 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=103297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:59.114740 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=103296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:59.114914 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=103297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:59.115054 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=103296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:59.115176 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 26 12:28:59.115297 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=103296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:59.115513 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=103296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:28:59.115778 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 26 12:28:59.173909 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: INFO dbcounter [None req-f1d9be34-795d-4410-b807-f9b6aa0419fb None None] Registered counter for database nova_api May 26 12:28:59.174121 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: INFO dbcounter [None req-544af60b-6823-48ae-b627-d2351861ea23 None None] Registered counter for database nova_api May 26 12:28:59.198162 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG oslo_db.sqlalchemy.engines [None req-544af60b-6823-48ae-b627-d2351861ea23 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103297) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 26 12:28:59.199883 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG oslo_db.sqlalchemy.engines [None req-f1d9be34-795d-4410-b807-f9b6aa0419fb None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103296) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 26 12:28:59.205315 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG dbcounter [-] [103297] Writer thread running {{(pid=103297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 26 12:28:59.206816 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG dbcounter [-] [103296] Writer thread running {{(pid=103296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 26 12:28:59.262642 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.context [None req-544af60b-6823-48ae-b627-d2351861ea23 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),20e2b1f2-33d6-4e23-a875-4a2cebf4cec0(cell1) {{(pid=103297) load_cells /opt/stack/nova/nova/context.py:464}} May 26 12:28:59.263953 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.context [None req-f1d9be34-795d-4410-b807-f9b6aa0419fb None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),20e2b1f2-33d6-4e23-a875-4a2cebf4cec0(cell1) {{(pid=103296) load_cells /opt/stack/nova/nova/context.py:464}} May 26 12:28:59.267133 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG oslo_concurrency.lockutils [None req-544af60b-6823-48ae-b627-d2351861ea23 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:28:59.268129 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG oslo_concurrency.lockutils [None req-f1d9be34-795d-4410-b807-f9b6aa0419fb None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:28:59.268784 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG oslo_concurrency.lockutils [None req-544af60b-6823-48ae-b627-d2351861ea23 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:28:59.269572 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG oslo_concurrency.lockutils [None req-544af60b-6823-48ae-b627-d2351861ea23 None None] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:28:59.269706 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG oslo_concurrency.lockutils [None req-f1d9be34-795d-4410-b807-f9b6aa0419fb None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:28:59.270498 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG oslo_concurrency.lockutils [None req-f1d9be34-795d-4410-b807-f9b6aa0419fb None None] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:28:59.271563 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG oslo_concurrency.lockutils [None req-544af60b-6823-48ae-b627-d2351861ea23 None None] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:28:59.272511 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG oslo_concurrency.lockutils [None req-f1d9be34-795d-4410-b807-f9b6aa0419fb None None] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:28:59.273576 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: INFO dbcounter [None req-544af60b-6823-48ae-b627-d2351861ea23 None None] Registered counter for database nova_cell0 May 26 12:28:59.274511 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: INFO dbcounter [None req-f1d9be34-795d-4410-b807-f9b6aa0419fb None None] Registered counter for database nova_cell0 May 26 12:28:59.277595 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: INFO dbcounter [None req-544af60b-6823-48ae-b627-d2351861ea23 None None] Registered counter for database nova_cell1 May 26 12:28:59.278796 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: INFO dbcounter [None req-f1d9be34-795d-4410-b807-f9b6aa0419fb None None] Registered counter for database nova_cell1 May 26 12:28:59.286083 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG oslo_db.sqlalchemy.engines [None req-544af60b-6823-48ae-b627-d2351861ea23 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103297) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 26 12:28:59.288504 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG oslo_db.sqlalchemy.engines [None req-544af60b-6823-48ae-b627-d2351861ea23 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103297) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 26 12:28:59.289548 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG oslo_db.sqlalchemy.engines [None req-f1d9be34-795d-4410-b807-f9b6aa0419fb None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103296) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 26 12:28:59.292777 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG oslo_db.sqlalchemy.engines [None req-f1d9be34-795d-4410-b807-f9b6aa0419fb None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103296) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 26 12:28:59.296674 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG dbcounter [-] [103297] Writer thread running {{(pid=103297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 26 12:28:59.297157 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG dbcounter [-] [103296] Writer thread running {{(pid=103296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 26 12:28:59.297943 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG dbcounter [-] [103297] Writer thread running {{(pid=103297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 26 12:28:59.302955 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG dbcounter [-] [103296] Writer thread running {{(pid=103296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 26 12:28:59.443843 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: INFO dbcounter [None req-544af60b-6823-48ae-b627-d2351861ea23 None None] Registered counter for database nova_cell0 May 26 12:28:59.445337 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: INFO dbcounter [None req-f1d9be34-795d-4410-b807-f9b6aa0419fb None None] Registered counter for database nova_cell0 May 26 12:28:59.454937 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG oslo_db.sqlalchemy.engines [None req-544af60b-6823-48ae-b627-d2351861ea23 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103297) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 26 12:28:59.458760 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG oslo_db.sqlalchemy.engines [None req-f1d9be34-795d-4410-b807-f9b6aa0419fb None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103296) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 26 12:28:59.459442 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG dbcounter [-] [103297] Writer thread running {{(pid=103297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 26 12:28:59.464116 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG dbcounter [-] [103296] Writer thread running {{(pid=103296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 26 12:28:59.793191 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: WARNING keystonemiddleware.auth_token [None req-f1d9be34-795d-4410-b807-f9b6aa0419fb None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 26 12:28:59.795186 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: WARNING keystonemiddleware.auth_token [None req-544af60b-6823-48ae-b627-d2351861ea23 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 26 12:28:59.800551 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: WARNING keystonemiddleware.auth_token [None req-f1d9be34-795d-4410-b807-f9b6aa0419fb None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 26 12:28:59.802461 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: WARNING keystonemiddleware.auth_token [None req-544af60b-6823-48ae-b627-d2351861ea23 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 26 12:29:00.146326 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: WARNING keystonemiddleware.auth_token [None req-544af60b-6823-48ae-b627-d2351861ea23 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 26 12:29:00.149195 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: WARNING keystonemiddleware.auth_token [None req-f1d9be34-795d-4410-b807-f9b6aa0419fb None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 26 12:29:00.152233 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: WARNING keystonemiddleware.auth_token [None req-544af60b-6823-48ae-b627-d2351861ea23 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 26 12:29:00.155142 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: WARNING keystonemiddleware.auth_token [None req-f1d9be34-795d-4410-b807-f9b6aa0419fb None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 26 12:29:00.157660 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55681a72f9c0 pid: 103297 (default app) May 26 12:29:00.159769 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi [None req-544af60b-6823-48ae-b627-d2351861ea23 None None] Calling method '>' {{(pid=103297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:29:00.160754 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55681a72f9c0 pid: 103296 (default app) May 26 12:29:00.160929 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: INFO nova.api.openstack.requestlog [None req-544af60b-6823-48ae-b627-d2351861ea23 None None] 10.222.0.75 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001779 May 26 12:29:00.161364 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: [pid: 103297|app: 0|req: 1/1] 10.222.0.75 () {50 vars in 788 bytes} [Thu May 26 12:29:00 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 12:30:18.752519 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi [None req-f1d9be34-795d-4410-b807-f9b6aa0419fb None None] Calling method '>' {{(pid=103296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:30:18.753765 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: INFO nova.api.openstack.requestlog [None req-f1d9be34-795d-4410-b807-f9b6aa0419fb None None] 10.222.0.75 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002058 May 26 12:30:18.754142 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: [pid: 103296|app: 0|req: 1/2] 10.222.0.75 () {54 vars in 930 bytes} [Thu May 26 12:30:18 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 12:30:18.766949 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG dbcounter [-] [103297] Writing DB stats nova_api:SELECT=3 {{(pid=103297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:30:18.767952 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG dbcounter [-] [103297] Writing DB stats nova_cell1:SELECT=3 {{(pid=103297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:30:18.769012 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG dbcounter [-] [103297] Writing DB stats nova_cell0:SELECT=3 {{(pid=103297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:30:18.770071 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG dbcounter [-] [103297] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=103297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:30:19.223716 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi [None req-da22f347-0d11-4c5e-af8f-b72516eaf2ea admin admin] Calling method '>' {{(pid=103297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:30:19.252926 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: INFO nova.api.openstack.requestlog [None req-da22f347-0d11-4c5e-af8f-b72516eaf2ea admin admin] 10.222.0.75 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.492442 May 26 12:30:19.253688 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: [pid: 103297|app: 0|req: 2/3] 10.222.0.75 () {60 vars in 1291 bytes} [Thu May 26 12:30:18 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:30:21.524241 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi [None req-f1d9be34-795d-4410-b807-f9b6aa0419fb None None] Calling method '>' {{(pid=103296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:30:21.525473 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: INFO nova.api.openstack.requestlog [None req-f1d9be34-795d-4410-b807-f9b6aa0419fb None None] 10.222.0.75 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001960 May 26 12:30:21.526140 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: [pid: 103296|app: 0|req: 2/4] 10.222.0.75 () {54 vars in 930 bytes} [Thu May 26 12:30:21 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 12:30:21.591214 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi [None req-ff1d737b-9cb7-4742-979c-069f26f0d59e admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "cirros256", "id": "c1", "swap": 0, "disk": 1, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "ram": 256, "vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=103297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 12:30:21.610167 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 26 12:30:21.610167 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: warnings.warn(msg) May 26 12:30:21.639681 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: INFO nova.api.openstack.requestlog [None req-ff1d737b-9cb7-4742-979c-069f26f0d59e admin admin] 10.222.0.75 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.107583 May 26 12:30:21.640260 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: [pid: 103297|app: 0|req: 3/5] 10.222.0.75 () {64 vars in 1282 bytes} [Thu May 26 12:30:21 2022] POST /compute/v2.1/flavors => generated 407 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 26 12:30:21.654285 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG dbcounter [-] [103296] Writing DB stats nova_api:SELECT=3 {{(pid=103296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:30:21.655214 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG dbcounter [-] [103296] Writing DB stats nova_cell0:SELECT=3 {{(pid=103296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:30:21.656866 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG dbcounter [-] [103296] Writing DB stats nova_cell1:SELECT=3 {{(pid=103296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:30:21.657994 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG dbcounter [-] [103296] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=103296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:30:21.862490 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi [None req-93962d07-f664-4693-b2bc-4bcc892240db admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 12:30:21.865040 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 26 12:30:21.865040 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: warnings.warn(msg) May 26 12:30:21.927632 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: INFO nova.api.openstack.requestlog [None req-93962d07-f664-4693-b2bc-4bcc892240db admin admin] 10.222.0.75 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.278863 May 26 12:30:21.928640 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: [pid: 103296|app: 0|req: 3/6] 10.222.0.75 () {64 vars in 1335 bytes} [Thu May 26 12:30:21 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:30:24.184084 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi [None req-ff1d737b-9cb7-4742-979c-069f26f0d59e admin admin] Calling method '>' {{(pid=103297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:30:24.185112 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: INFO nova.api.openstack.requestlog [None req-ff1d737b-9cb7-4742-979c-069f26f0d59e admin admin] 10.222.0.75 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001574 May 26 12:30:24.185510 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: [pid: 103297|app: 0|req: 4/7] 10.222.0.75 () {54 vars in 930 bytes} [Thu May 26 12:30:24 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 12:30:24.330400 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi [None req-9bef2e1d-1ba9-423f-abc3-fc4eae5cb388 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 1, "disk": 5, "rxtx_factor": 1.0, "ram": 512, "os-flavor-access:is_public": true, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "ds512M", "id": "d1"}} {{(pid=103296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 12:30:24.349409 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 26 12:30:24.349409 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: warnings.warn(msg) May 26 12:30:24.368490 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: INFO nova.api.openstack.requestlog [None req-9bef2e1d-1ba9-423f-abc3-fc4eae5cb388 admin admin] 10.222.0.75 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.176891 May 26 12:30:24.369047 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: [pid: 103296|app: 0|req: 4/8] 10.222.0.75 () {64 vars in 1282 bytes} [Thu May 26 12:30:24 2022] POST /compute/v2.1/flavors => generated 404 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 26 12:30:24.381345 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi [None req-518deec7-1738-4ebd-9da7-37195ddfd7db admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 12:30:24.382935 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 26 12:30:24.382935 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: warnings.warn(msg) May 26 12:30:24.415415 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: INFO nova.api.openstack.requestlog [None req-518deec7-1738-4ebd-9da7-37195ddfd7db admin admin] 10.222.0.75 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.037774 May 26 12:30:24.416100 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: [pid: 103297|app: 0|req: 5/9] 10.222.0.75 () {64 vars in 1335 bytes} [Thu May 26 12:30:24 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:30:26.676413 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi [None req-9bef2e1d-1ba9-423f-abc3-fc4eae5cb388 admin admin] Calling method '>' {{(pid=103296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:30:26.677421 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: INFO nova.api.openstack.requestlog [None req-9bef2e1d-1ba9-423f-abc3-fc4eae5cb388 admin admin] 10.222.0.75 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001541 May 26 12:30:26.677807 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: [pid: 103296|app: 0|req: 5/10] 10.222.0.75 () {54 vars in 930 bytes} [Thu May 26 12:30:26 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 12:30:26.742446 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi [None req-39c2b86f-540f-46bf-923a-56311cac72df admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "id": "d2", "disk": 10, "swap": 0, "os-flavor-access:is_public": true, "vcpus": 1, "name": "ds1G", "ram": 1024, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=103297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 12:30:26.762448 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: INFO nova.api.openstack.requestlog [None req-39c2b86f-540f-46bf-923a-56311cac72df admin admin] 10.222.0.75 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.078203 May 26 12:30:26.763354 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: [pid: 103297|app: 0|req: 6/11] 10.222.0.75 () {64 vars in 1282 bytes} [Thu May 26 12:30:26 2022] POST /compute/v2.1/flavors => generated 404 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 26 12:30:26.775594 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi [None req-42f33159-2a3c-4005-9b77-a77bc187db9a admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 12:30:26.800240 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: INFO nova.api.openstack.requestlog [None req-42f33159-2a3c-4005-9b77-a77bc187db9a admin admin] 10.222.0.75 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028346 May 26 12:30:26.802754 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: [pid: 103296|app: 0|req: 6/12] 10.222.0.75 () {64 vars in 1335 bytes} [Thu May 26 12:30:26 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:30:29.125988 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi [None req-39c2b86f-540f-46bf-923a-56311cac72df admin admin] Calling method '>' {{(pid=103297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:30:29.127666 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: INFO nova.api.openstack.requestlog [None req-39c2b86f-540f-46bf-923a-56311cac72df admin admin] 10.222.0.75 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002096 May 26 12:30:29.128066 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: [pid: 103297|app: 0|req: 7/13] 10.222.0.75 () {54 vars in 930 bytes} [Thu May 26 12:30:29 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 12:30:29.190039 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi [None req-78633ea8-a12f-4924-86ad-55a97b7a0fcc admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 10, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "name": "ds2G", "swap": 0, "os-flavor-access:is_public": true, "id": "d3", "ram": 2048, "vcpus": 2}} {{(pid=103296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 12:30:29.211443 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: INFO nova.api.openstack.requestlog [None req-78633ea8-a12f-4924-86ad-55a97b7a0fcc admin admin] 10.222.0.75 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.077272 May 26 12:30:29.212024 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: [pid: 103296|app: 0|req: 7/14] 10.222.0.75 () {64 vars in 1282 bytes} [Thu May 26 12:30:29 2022] POST /compute/v2.1/flavors => generated 404 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 26 12:30:29.224736 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi [None req-18372860-db8b-4263-acd3-f4d4dfd4a6ee admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 12:30:29.252673 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: INFO nova.api.openstack.requestlog [None req-18372860-db8b-4263-acd3-f4d4dfd4a6ee admin admin] 10.222.0.75 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.031962 May 26 12:30:29.253621 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: [pid: 103297|app: 0|req: 8/15] 10.222.0.75 () {64 vars in 1335 bytes} [Thu May 26 12:30:29 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:30:31.581233 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi [None req-78633ea8-a12f-4924-86ad-55a97b7a0fcc admin admin] Calling method '>' {{(pid=103296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:30:31.583493 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: INFO nova.api.openstack.requestlog [None req-78633ea8-a12f-4924-86ad-55a97b7a0fcc admin admin] 10.222.0.75 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001466 May 26 12:30:31.584792 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: [pid: 103296|app: 0|req: 8/16] 10.222.0.75 () {54 vars in 930 bytes} [Thu May 26 12:30:31 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 12:30:31.670819 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi [None req-529c7a24-3974-4a7b-8afe-86c873c85d44 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "id": "d4", "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 20, "rxtx_factor": 1.0, "name": "ds4G", "ram": 4096, "vcpus": 4, "swap": 0}} {{(pid=103297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 12:30:31.693416 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: INFO nova.api.openstack.requestlog [None req-529c7a24-3974-4a7b-8afe-86c873c85d44 admin admin] 10.222.0.75 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.098645 May 26 12:30:31.694318 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: [pid: 103297|app: 0|req: 9/17] 10.222.0.75 () {64 vars in 1282 bytes} [Thu May 26 12:30:31 2022] POST /compute/v2.1/flavors => generated 404 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 26 12:30:31.708257 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi [None req-07c9e79d-d8a2-4b4d-b487-b80efec921e8 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 12:30:31.738631 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: INFO nova.api.openstack.requestlog [None req-07c9e79d-d8a2-4b4d-b487-b80efec921e8 admin admin] 10.222.0.75 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.035304 May 26 12:30:31.739932 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: [pid: 103296|app: 0|req: 9/18] 10.222.0.75 () {64 vars in 1335 bytes} [Thu May 26 12:30:31 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 12:30:34.018918 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi [None req-529c7a24-3974-4a7b-8afe-86c873c85d44 admin admin] Calling method '>' {{(pid=103297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:30:34.020586 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: INFO nova.api.openstack.requestlog [None req-529c7a24-3974-4a7b-8afe-86c873c85d44 admin admin] 10.222.0.75 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002079 May 26 12:30:34.021156 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: [pid: 103297|app: 0|req: 10/19] 10.222.0.75 () {54 vars in 930 bytes} [Thu May 26 12:30:34 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 12:30:34.088643 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi [None req-3c28600b-a6f7-4542-b17a-8bb6d6298abb admin admin] Calling method '>' {{(pid=103296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:30:34.114461 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: INFO nova.api.openstack.requestlog [None req-3c28600b-a6f7-4542-b17a-8bb6d6298abb admin admin] 10.222.0.75 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.086540 May 26 12:30:34.127718 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: [pid: 103296|app: 0|req: 10/20] 10.222.0.75 () {60 vars in 1291 bytes} [Thu May 26 12:30:34 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 12:30:36.437813 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi [None req-529c7a24-3974-4a7b-8afe-86c873c85d44 admin admin] Calling method '>' {{(pid=103297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:30:36.438870 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: INFO nova.api.openstack.requestlog [None req-529c7a24-3974-4a7b-8afe-86c873c85d44 admin admin] 10.222.0.75 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001528 May 26 12:30:36.439298 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: [pid: 103297|app: 0|req: 11/21] 10.222.0.75 () {54 vars in 930 bytes} [Thu May 26 12:30:36 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 12:30:36.510755 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi [None req-23453fb6-7b7b-4f1a-8ac4-a7a5522a8b13 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "1", "ram": 512, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "m1.tiny", "disk": 1, "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "vcpus": 1, "swap": 0}} {{(pid=103296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 12:30:36.531416 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: INFO nova.api.openstack.requestlog [None req-23453fb6-7b7b-4f1a-8ac4-a7a5522a8b13 admin admin] 10.222.0.75 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.086168 May 26 12:30:36.532094 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: [pid: 103296|app: 0|req: 11/22] 10.222.0.75 () {64 vars in 1282 bytes} [Thu May 26 12:30:36 2022] POST /compute/v2.1/flavors => generated 402 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 26 12:30:36.548066 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi [None req-8fce3933-17a3-44dd-98cc-eac085d0fe48 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 12:30:36.582702 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: INFO nova.api.openstack.requestlog [None req-8fce3933-17a3-44dd-98cc-eac085d0fe48 admin admin] 10.222.0.75 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.039428 May 26 12:30:36.583709 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: [pid: 103297|app: 0|req: 12/23] 10.222.0.75 () {64 vars in 1332 bytes} [Thu May 26 12:30:36 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:30:39.281433 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi [None req-23453fb6-7b7b-4f1a-8ac4-a7a5522a8b13 admin admin] Calling method '>' {{(pid=103296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:30:39.282515 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: INFO nova.api.openstack.requestlog [None req-23453fb6-7b7b-4f1a-8ac4-a7a5522a8b13 admin admin] 10.222.0.75 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001564 May 26 12:30:39.282884 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: [pid: 103296|app: 0|req: 12/24] 10.222.0.75 () {54 vars in 930 bytes} [Thu May 26 12:30:39 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 12:30:39.345335 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi [None req-97fd8b5b-7716-4cd2-a942-e662b9ac5029 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "id": "2", "os-flavor-access:is_public": true, "swap": 0, "disk": 20, "ram": 2048, "name": "m1.small", "vcpus": 1}} {{(pid=103297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 12:30:39.367273 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: INFO nova.api.openstack.requestlog [None req-97fd8b5b-7716-4cd2-a942-e662b9ac5029 admin admin] 10.222.0.75 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.078066 May 26 12:30:39.368068 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: [pid: 103297|app: 0|req: 13/25] 10.222.0.75 () {64 vars in 1282 bytes} [Thu May 26 12:30:39 2022] POST /compute/v2.1/flavors => generated 405 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 26 12:30:39.380998 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi [None req-9e82066d-a461-4ce7-89a0-06dd1012fa25 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 12:30:39.409413 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: INFO nova.api.openstack.requestlog [None req-9e82066d-a461-4ce7-89a0-06dd1012fa25 admin admin] 10.222.0.75 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.032507 May 26 12:30:39.410021 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: [pid: 103296|app: 0|req: 13/26] 10.222.0.75 () {64 vars in 1332 bytes} [Thu May 26 12:30:39 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:30:41.680953 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi [None req-97fd8b5b-7716-4cd2-a942-e662b9ac5029 admin admin] Calling method '>' {{(pid=103297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:30:41.682041 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: INFO nova.api.openstack.requestlog [None req-97fd8b5b-7716-4cd2-a942-e662b9ac5029 admin admin] 10.222.0.75 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001799 May 26 12:30:41.682482 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: [pid: 103297|app: 0|req: 14/27] 10.222.0.75 () {54 vars in 930 bytes} [Thu May 26 12:30:41 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 12:30:41.751460 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi [None req-220087b0-a0f4-4ca1-9834-25020ddede47 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "3", "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 2, "name": "m1.medium", "disk": 40, "swap": 0, "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "ram": 4096}} {{(pid=103296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 12:30:41.774312 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: INFO nova.api.openstack.requestlog [None req-220087b0-a0f4-4ca1-9834-25020ddede47 admin admin] 10.222.0.75 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.085650 May 26 12:30:41.774890 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: [pid: 103296|app: 0|req: 14/28] 10.222.0.75 () {64 vars in 1282 bytes} [Thu May 26 12:30:41 2022] POST /compute/v2.1/flavors => generated 406 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 26 12:30:41.789034 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi [None req-aa867162-9c86-452f-90f4-b97c48c79d6f admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 12:30:41.813067 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: INFO nova.api.openstack.requestlog [None req-aa867162-9c86-452f-90f4-b97c48c79d6f admin admin] 10.222.0.75 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029329 May 26 12:30:41.813629 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: [pid: 103297|app: 0|req: 15/29] 10.222.0.75 () {64 vars in 1332 bytes} [Thu May 26 12:30:41 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 12:30:44.062087 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi [None req-220087b0-a0f4-4ca1-9834-25020ddede47 admin admin] Calling method '>' {{(pid=103296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:30:44.063116 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: INFO nova.api.openstack.requestlog [None req-220087b0-a0f4-4ca1-9834-25020ddede47 admin admin] 10.222.0.75 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001485 May 26 12:30:44.063715 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: [pid: 103296|app: 0|req: 15/30] 10.222.0.75 () {54 vars in 930 bytes} [Thu May 26 12:30:44 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 12:30:44.122831 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi [None req-0c6cb14c-f5de-4211-b768-bf3b1b839b59 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 80, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 8192, "swap": 0, "os-flavor-access:is_public": true, "name": "m1.large", "id": "4", "vcpus": 4}} {{(pid=103297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 12:30:44.141645 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: INFO nova.api.openstack.requestlog [None req-0c6cb14c-f5de-4211-b768-bf3b1b839b59 admin admin] 10.222.0.75 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.072318 May 26 12:30:44.142305 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: [pid: 103297|app: 0|req: 16/31] 10.222.0.75 () {64 vars in 1282 bytes} [Thu May 26 12:30:44 2022] POST /compute/v2.1/flavors => generated 405 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 26 12:30:44.154158 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi [None req-fc31ee5a-3ade-4016-8620-a249642a6be7 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 12:30:44.178456 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: INFO nova.api.openstack.requestlog [None req-fc31ee5a-3ade-4016-8620-a249642a6be7 admin admin] 10.222.0.75 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027918 May 26 12:30:44.179348 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: [pid: 103296|app: 0|req: 16/32] 10.222.0.75 () {64 vars in 1332 bytes} [Thu May 26 12:30:44 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 12:30:46.443477 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi [None req-0c6cb14c-f5de-4211-b768-bf3b1b839b59 admin admin] Calling method '>' {{(pid=103297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:30:46.444727 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: INFO nova.api.openstack.requestlog [None req-0c6cb14c-f5de-4211-b768-bf3b1b839b59 admin admin] 10.222.0.75 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001852 May 26 12:30:46.445467 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: [pid: 103297|app: 0|req: 17/33] 10.222.0.75 () {54 vars in 930 bytes} [Thu May 26 12:30:46 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 12:30:46.509717 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi [None req-3e6c30ca-e8ab-44dc-9a56-8de70278d572 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "ram": 16384, "name": "m1.xlarge", "rxtx_factor": 1.0, "swap": 0, "disk": 160, "vcpus": 8, "id": "5"}} {{(pid=103296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 12:30:46.528467 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: INFO nova.api.openstack.requestlog [None req-3e6c30ca-e8ab-44dc-9a56-8de70278d572 admin admin] 10.222.0.75 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.076625 May 26 12:30:46.529196 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: [pid: 103296|app: 0|req: 17/34] 10.222.0.75 () {64 vars in 1282 bytes} [Thu May 26 12:30:46 2022] POST /compute/v2.1/flavors => generated 408 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 26 12:30:46.541604 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi [None req-c5a70cad-1b0a-4819-b7aa-8362e7551113 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 12:30:46.577834 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: INFO nova.api.openstack.requestlog [None req-c5a70cad-1b0a-4819-b7aa-8362e7551113 admin admin] 10.222.0.75 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.040220 May 26 12:30:46.578430 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: [pid: 103297|app: 0|req: 18/35] 10.222.0.75 () {64 vars in 1332 bytes} [Thu May 26 12:30:46 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:31:11.476058 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi [None req-3e6c30ca-e8ab-44dc-9a56-8de70278d572 admin admin] Calling method '>' {{(pid=103296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:31:11.477305 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: INFO nova.api.openstack.requestlog [None req-3e6c30ca-e8ab-44dc-9a56-8de70278d572 admin admin] 10.222.0.75 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001763 May 26 12:31:11.477788 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: [pid: 103296|app: 0|req: 18/36] 10.222.0.75 () {54 vars in 930 bytes} [Thu May 26 12:31:11 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 12:31:11.489010 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG dbcounter [-] [103297] Writing DB stats nova_api:SELECT=47,nova_api:INSERT=10,nova_api:SAVEPOINT=5,nova_api:RELEASE=5 {{(pid=103297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:31:11.541221 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi [None req-b17d9bb1-0aa8-453e-af9a-c8661ea24f02 admin admin] Calling method '>' {{(pid=103297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:31:11.558728 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: INFO nova.api.openstack.requestlog [None req-b17d9bb1-0aa8-453e-af9a-c8661ea24f02 admin admin] 10.222.0.75 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.074435 May 26 12:31:11.559262 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: [pid: 103297|app: 0|req: 19/37] 10.222.0.75 () {60 vars in 1291 bytes} [Thu May 26 12:31:11 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 12:31:12.567554 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi [None req-3e6c30ca-e8ab-44dc-9a56-8de70278d572 admin admin] Calling method '>' {{(pid=103296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:31:12.568583 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: INFO nova.api.openstack.requestlog [None req-3e6c30ca-e8ab-44dc-9a56-8de70278d572 admin admin] 10.222.0.75 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001472 May 26 12:31:12.569019 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: [pid: 103296|app: 0|req: 19/38] 10.222.0.75 () {56 vars in 1074 bytes} [Thu May 26 12:31:12 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 12:31:12.765353 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi [None req-0b9c7fc9-917b-4735-b32c-de018fd28169 admin admin] Calling method '>' {{(pid=103297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:31:12.771419 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: INFO nova.api.openstack.wsgi [None req-0b9c7fc9-917b-4735-b32c-de018fd28169 admin admin] HTTP exception thrown: Flavor 42 could not be found. May 26 12:31:12.774738 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi [None req-0b9c7fc9-917b-4735-b32c-de018fd28169 admin admin] Request method failure captured: May 26 12:31:12.774738 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 May 26 12:31:12.774738 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: Accept: application/json May 26 12:31:12.774738 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: Accept-Encoding: gzip, deflate May 26 12:31:12.774738 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: Connection: keep-alive May 26 12:31:12.774738 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: Content-Length: 0 May 26 12:31:12.774738 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: Host: 10.222.0.75 May 26 12:31:12.774738 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: Openstack-Api-Version: compute 2.90 May 26 12:31:12.774738 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: Openstack-System-Scope: None May 26 12:31:12.774738 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: User-Agent: python-novaclient May 26 12:31:12.774738 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: X-Auth-Token: gAAAAABij3MQqBnC92GmoKw8s5xgpo24DiZ4q8U7iEfFurRwEbSE4Nstk_AdH2hIgvTppgVCo5edJni5YKgrdnuvPwr5bbpLgTY8oaU4S432mc5Qt7MKqYGKaz107Zmp7csnrOBPbR7d3PXriPZJt6IoqXhTOPxDoB_cjRt2dN4W4Mp3_ym8QJ0 May 26 12:31:12.774738 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: X-Domain-Id: None May 26 12:31:12.774738 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: X-Domain-Name: None May 26 12:31:12.774738 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: X-Identity-Status: Confirmed May 26 12:31:12.774738 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: X-Is-Admin-Project: True May 26 12:31:12.774738 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: X-Openstack-Nova-Api-Version: 2.90 May 26 12:31:12.774738 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: X-Project-Domain-Id: default May 26 12:31:12.774738 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: X-Project-Domain-Name: Default May 26 12:31:12.774738 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: X-Project-Id: f7b62d8bc2904e559160e9d978cde596 May 26 12:31:12.774738 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: X-Project-Name: admin May 26 12:31:12.774738 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: X-Role: admin,member,reader May 26 12:31:12.774738 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: X-Roles: admin,member,reader May 26 12:31:12.776368 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/f7b62d8bc2904e559160e9d978cde596"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.75:8080", "publicURL": "http://10.222.0.75:8080/v1/AUTH_f7b62d8bc2904e559160e9d978cde596"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2/f7b62d8bc2904e559160e9d978cde596"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/f7b62d8bc2904e559160e9d978cde596"}]}] May 26 12:31:12.776368 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: X-Tenant: admin May 26 12:31:12.776368 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: X-Tenant-Id: f7b62d8bc2904e559160e9d978cde596 May 26 12:31:12.776368 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: X-Tenant-Name: admin May 26 12:31:12.776368 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: X-User: admin May 26 12:31:12.776368 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: X-User-Domain-Id: default May 26 12:31:12.776368 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: X-User-Domain-Name: Default May 26 12:31:12.776368 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: X-User-Id: 801932a0f57f4075beaa7d9bf3b3839f May 26 12:31:12.776368 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: X-User-Name: admin May 26 12:31:12.776368 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: method: > May 26 12:31:12.776368 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: exception: Flavor 42 could not be found. May 26 12:31:12.776368 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: action_args: {'id': '42'} May 26 12:31:12.776368 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: {{(pid=103297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 12:31:12.776368 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 12:31:12.777438 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show May 26 12:31:12.777438 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) May 26 12:31:12.777438 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id May 26 12:31:12.777438 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) May 26 12:31:12.777438 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 26 12:31:12.777438 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 26 12:31:12.777438 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id May 26 12:31:12.777438 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, May 26 12:31:12.777438 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper May 26 12:31:12.777438 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 12:31:12.777438 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db May 26 12:31:12.777438 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) May 26 12:31:12.777438 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. May 26 12:31:12.777438 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: ERROR nova.api.openstack.wsgi May 26 12:31:12.777438 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 12:31:12.777438 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: ERROR nova.api.openstack.wsgi May 26 12:31:12.777438 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 12:31:12.777438 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 12:31:12.777438 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 12:31:12.778684 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 12:31:12.778684 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 12:31:12.778684 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 12:31:12.778684 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 12:31:12.778684 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show May 26 12:31:12.778684 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 26 12:31:12.778684 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. May 26 12:31:12.778684 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: ERROR nova.api.openstack.wsgi May 26 12:31:12.778684 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 12:31:12.778684 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: ERROR nova.api.openstack.wsgi May 26 12:31:12.778684 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 12:31:12.778684 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 12:31:12.778684 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 12:31:12.778684 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 12:31:12.778684 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 12:31:12.778684 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. May 26 12:31:12.778684 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: ERROR nova.api.openstack.wsgi May 26 12:31:12.778684 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi [None req-0b9c7fc9-917b-4735-b32c-de018fd28169 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=103297) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 12:31:12.779742 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: INFO nova.api.openstack.requestlog [None req-0b9c7fc9-917b-4735-b32c-de018fd28169 admin admin] 10.222.0.75 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.066660 May 26 12:31:12.779742 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: [pid: 103297|app: 0|req: 20/39] 10.222.0.75 () {60 vars in 1190 bytes} [Thu May 26 12:31:12 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) May 26 12:31:12.786701 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi [None req-c67d7f3f-6dd4-4949-9178-8fbbc90523b7 admin admin] Calling method '>' {{(pid=103296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:31:12.789851 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG dbcounter [-] [103296] Writing DB stats nova_api:SELECT=47,nova_api:SAVEPOINT=5,nova_api:INSERT=10,nova_api:RELEASE=5 {{(pid=103296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:31:12.810112 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: INFO nova.api.openstack.requestlog [None req-c67d7f3f-6dd4-4949-9178-8fbbc90523b7 admin admin] 10.222.0.75 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.027296 May 26 12:31:12.810675 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: [pid: 103296|app: 0|req: 20/40] 10.222.0.75 () {60 vars in 1210 bytes} [Thu May 26 12:31:12 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 12:31:12.823755 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi [None req-506847a0-3ffb-4552-998a-3e650137f035 admin admin] Calling method '>' {{(pid=103297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:31:12.853236 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: INFO nova.api.openstack.requestlog [None req-506847a0-3ffb-4552-998a-3e650137f035 admin admin] 10.222.0.75 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.035717 May 26 12:31:12.853809 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: [pid: 103297|app: 0|req: 21/41] 10.222.0.75 () {60 vars in 1210 bytes} [Thu May 26 12:31:12 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 12:31:12.863773 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi [None req-df1300cc-00d1-44f1-a365-0aeba330e68c admin admin] Calling method '>' {{(pid=103296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:31:12.869748 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: INFO nova.api.openstack.wsgi [None req-df1300cc-00d1-44f1-a365-0aeba330e68c admin admin] HTTP exception thrown: Flavor 42 could not be found. May 26 12:31:12.873077 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi [None req-df1300cc-00d1-44f1-a365-0aeba330e68c admin admin] Request method failure captured: May 26 12:31:12.873077 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 May 26 12:31:12.873077 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: Accept: application/json May 26 12:31:12.873077 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: Accept-Encoding: gzip, deflate May 26 12:31:12.873077 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: Connection: keep-alive May 26 12:31:12.873077 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: Content-Length: 0 May 26 12:31:12.873077 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: Host: 10.222.0.75 May 26 12:31:12.873077 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: Openstack-Api-Version: compute 2.90 May 26 12:31:12.873077 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: Openstack-System-Scope: None May 26 12:31:12.873077 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: User-Agent: python-novaclient May 26 12:31:12.873077 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: X-Auth-Token: gAAAAABij3MQqBnC92GmoKw8s5xgpo24DiZ4q8U7iEfFurRwEbSE4Nstk_AdH2hIgvTppgVCo5edJni5YKgrdnuvPwr5bbpLgTY8oaU4S432mc5Qt7MKqYGKaz107Zmp7csnrOBPbR7d3PXriPZJt6IoqXhTOPxDoB_cjRt2dN4W4Mp3_ym8QJ0 May 26 12:31:12.873077 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: X-Domain-Id: None May 26 12:31:12.873077 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: X-Domain-Name: None May 26 12:31:12.873077 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: X-Identity-Status: Confirmed May 26 12:31:12.873077 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: X-Is-Admin-Project: True May 26 12:31:12.873077 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: X-Openstack-Nova-Api-Version: 2.90 May 26 12:31:12.873077 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: X-Project-Domain-Id: default May 26 12:31:12.873077 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: X-Project-Domain-Name: Default May 26 12:31:12.873077 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: X-Project-Id: f7b62d8bc2904e559160e9d978cde596 May 26 12:31:12.873077 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: X-Project-Name: admin May 26 12:31:12.873077 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: X-Role: admin,member,reader May 26 12:31:12.873077 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: X-Roles: admin,member,reader May 26 12:31:12.874550 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/f7b62d8bc2904e559160e9d978cde596"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.75:8080", "publicURL": "http://10.222.0.75:8080/v1/AUTH_f7b62d8bc2904e559160e9d978cde596"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2/f7b62d8bc2904e559160e9d978cde596"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/f7b62d8bc2904e559160e9d978cde596"}]}] May 26 12:31:12.874550 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: X-Tenant: admin May 26 12:31:12.874550 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: X-Tenant-Id: f7b62d8bc2904e559160e9d978cde596 May 26 12:31:12.874550 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: X-Tenant-Name: admin May 26 12:31:12.874550 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: X-User: admin May 26 12:31:12.874550 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: X-User-Domain-Id: default May 26 12:31:12.874550 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: X-User-Domain-Name: Default May 26 12:31:12.874550 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: X-User-Id: 801932a0f57f4075beaa7d9bf3b3839f May 26 12:31:12.874550 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: X-User-Name: admin May 26 12:31:12.874550 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: method: > May 26 12:31:12.874550 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: exception: Flavor 42 could not be found. May 26 12:31:12.874550 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: action_args: {'id': '42'} May 26 12:31:12.874550 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: {{(pid=103296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 12:31:12.874550 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 12:31:12.875343 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show May 26 12:31:12.875343 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) May 26 12:31:12.875343 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id May 26 12:31:12.875343 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) May 26 12:31:12.875343 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 26 12:31:12.875343 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 26 12:31:12.875343 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id May 26 12:31:12.875343 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, May 26 12:31:12.875343 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper May 26 12:31:12.875343 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 12:31:12.875343 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db May 26 12:31:12.875343 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) May 26 12:31:12.875343 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. May 26 12:31:12.875343 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: ERROR nova.api.openstack.wsgi May 26 12:31:12.875343 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 12:31:12.875343 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: ERROR nova.api.openstack.wsgi May 26 12:31:12.875343 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 12:31:12.875343 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 12:31:12.875343 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 12:31:12.876374 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 12:31:12.876374 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 12:31:12.876374 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 12:31:12.876374 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 12:31:12.876374 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show May 26 12:31:12.876374 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 26 12:31:12.876374 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. May 26 12:31:12.876374 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: ERROR nova.api.openstack.wsgi May 26 12:31:12.876374 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 12:31:12.876374 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: ERROR nova.api.openstack.wsgi May 26 12:31:12.876374 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 12:31:12.876374 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 12:31:12.876374 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 12:31:12.876374 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 12:31:12.876374 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 12:31:12.876374 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. May 26 12:31:12.876374 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: ERROR nova.api.openstack.wsgi May 26 12:31:12.876374 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi [None req-df1300cc-00d1-44f1-a365-0aeba330e68c admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=103296) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 12:31:12.877363 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: INFO nova.api.openstack.requestlog [None req-df1300cc-00d1-44f1-a365-0aeba330e68c admin admin] 10.222.0.75 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.014726 May 26 12:31:12.877363 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: [pid: 103296|app: 0|req: 21/42] 10.222.0.75 () {60 vars in 1190 bytes} [Thu May 26 12:31:12 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 16 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) May 26 12:31:13.744266 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi [None req-506847a0-3ffb-4552-998a-3e650137f035 admin admin] Calling method '>' {{(pid=103297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:31:13.745785 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: INFO nova.api.openstack.requestlog [None req-506847a0-3ffb-4552-998a-3e650137f035 admin admin] 10.222.0.75 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002253 May 26 12:31:13.746369 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: [pid: 103297|app: 0|req: 22/43] 10.222.0.75 () {56 vars in 1074 bytes} [Thu May 26 12:31:13 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 12:31:13.940562 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi [None req-c432fcfb-2ef0-4ac7-aa65-6ee16691f97e admin admin] Calling method '>' {{(pid=103296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:31:13.946066 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: INFO nova.api.openstack.wsgi [None req-c432fcfb-2ef0-4ac7-aa65-6ee16691f97e admin admin] HTTP exception thrown: Flavor 84 could not be found. May 26 12:31:13.947573 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi [None req-c432fcfb-2ef0-4ac7-aa65-6ee16691f97e admin admin] Request method failure captured: May 26 12:31:13.947573 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 May 26 12:31:13.947573 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: Accept: application/json May 26 12:31:13.947573 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: Accept-Encoding: gzip, deflate May 26 12:31:13.947573 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: Connection: keep-alive May 26 12:31:13.947573 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: Content-Length: 0 May 26 12:31:13.947573 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: Host: 10.222.0.75 May 26 12:31:13.947573 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: Openstack-Api-Version: compute 2.90 May 26 12:31:13.947573 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: Openstack-System-Scope: None May 26 12:31:13.947573 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: User-Agent: python-novaclient May 26 12:31:13.947573 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: X-Auth-Token: gAAAAABij3MRzsl9QWaJ4WXRpnm9kA9HBmptT_Mfge8pTnfETFqctipX6Rv-KNpb2iK7isqrk-GskPLh-GA_PEu_Do3ywEMUem5-YYgW2Ap_o6r7-cNIEAuxBE7Mx57LNz8MOz89oMkqKCaJWUVzyHrtnVv4dkKgZsXWT7TFREyDL8oSSp36tZg May 26 12:31:13.947573 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: X-Domain-Id: None May 26 12:31:13.947573 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: X-Domain-Name: None May 26 12:31:13.947573 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: X-Identity-Status: Confirmed May 26 12:31:13.947573 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: X-Is-Admin-Project: True May 26 12:31:13.947573 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: X-Openstack-Nova-Api-Version: 2.90 May 26 12:31:13.947573 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: X-Project-Domain-Id: default May 26 12:31:13.947573 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: X-Project-Domain-Name: Default May 26 12:31:13.947573 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: X-Project-Id: f7b62d8bc2904e559160e9d978cde596 May 26 12:31:13.947573 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: X-Project-Name: admin May 26 12:31:13.947573 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: X-Role: admin,member,reader May 26 12:31:13.947573 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: X-Roles: admin,member,reader May 26 12:31:13.949299 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/f7b62d8bc2904e559160e9d978cde596"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.75:8080", "publicURL": "http://10.222.0.75:8080/v1/AUTH_f7b62d8bc2904e559160e9d978cde596"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2/f7b62d8bc2904e559160e9d978cde596"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/f7b62d8bc2904e559160e9d978cde596"}]}] May 26 12:31:13.949299 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: X-Tenant: admin May 26 12:31:13.949299 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: X-Tenant-Id: f7b62d8bc2904e559160e9d978cde596 May 26 12:31:13.949299 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: X-Tenant-Name: admin May 26 12:31:13.949299 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: X-User: admin May 26 12:31:13.949299 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: X-User-Domain-Id: default May 26 12:31:13.949299 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: X-User-Domain-Name: Default May 26 12:31:13.949299 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: X-User-Id: 801932a0f57f4075beaa7d9bf3b3839f May 26 12:31:13.949299 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: X-User-Name: admin May 26 12:31:13.949299 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: method: > May 26 12:31:13.949299 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: exception: Flavor 84 could not be found. May 26 12:31:13.949299 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: action_args: {'id': '84'} May 26 12:31:13.949299 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: {{(pid=103296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 12:31:13.949299 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 12:31:13.950354 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show May 26 12:31:13.950354 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) May 26 12:31:13.950354 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id May 26 12:31:13.950354 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) May 26 12:31:13.950354 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 26 12:31:13.950354 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 26 12:31:13.950354 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id May 26 12:31:13.950354 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, May 26 12:31:13.950354 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper May 26 12:31:13.950354 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 12:31:13.950354 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db May 26 12:31:13.950354 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) May 26 12:31:13.950354 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. May 26 12:31:13.950354 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: ERROR nova.api.openstack.wsgi May 26 12:31:13.950354 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 12:31:13.950354 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: ERROR nova.api.openstack.wsgi May 26 12:31:13.950354 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 12:31:13.950354 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 12:31:13.950354 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 12:31:13.951709 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 12:31:13.951709 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 12:31:13.951709 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 12:31:13.951709 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 12:31:13.951709 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show May 26 12:31:13.951709 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 26 12:31:13.951709 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. May 26 12:31:13.951709 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: ERROR nova.api.openstack.wsgi May 26 12:31:13.951709 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 12:31:13.951709 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: ERROR nova.api.openstack.wsgi May 26 12:31:13.951709 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 12:31:13.951709 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 12:31:13.951709 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 12:31:13.951709 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 12:31:13.951709 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 12:31:13.951709 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. May 26 12:31:13.951709 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: ERROR nova.api.openstack.wsgi May 26 12:31:13.951709 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi [None req-c432fcfb-2ef0-4ac7-aa65-6ee16691f97e admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=103296) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 12:31:13.952973 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: INFO nova.api.openstack.requestlog [None req-c432fcfb-2ef0-4ac7-aa65-6ee16691f97e admin admin] 10.222.0.75 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.065779 May 26 12:31:13.952973 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: [pid: 103296|app: 0|req: 22/44] 10.222.0.75 () {60 vars in 1190 bytes} [Thu May 26 12:31:13 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) May 26 12:31:13.959646 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi [None req-4423e37c-8fc9-44fc-9d45-a46a7aa6cbe3 admin admin] Calling method '>' {{(pid=103297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:31:13.975487 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: INFO nova.api.openstack.requestlog [None req-4423e37c-8fc9-44fc-9d45-a46a7aa6cbe3 admin admin] 10.222.0.75 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.019672 May 26 12:31:13.976077 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: [pid: 103297|app: 0|req: 23/45] 10.222.0.75 () {60 vars in 1210 bytes} [Thu May 26 12:31:13 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 26 12:31:13.985917 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi [None req-33690319-e3a8-4a9e-bcca-86765c4ef58c admin admin] Calling method '>' {{(pid=103296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:31:14.000563 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: INFO nova.api.openstack.requestlog [None req-33690319-e3a8-4a9e-bcca-86765c4ef58c admin admin] 10.222.0.75 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018253 May 26 12:31:14.001138 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: [pid: 103296|app: 0|req: 23/46] 10.222.0.75 () {60 vars in 1210 bytes} [Thu May 26 12:31:13 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 26 12:31:14.017594 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi [None req-aaf49638-2fe3-42bd-80b1-784ae16b9b43 admin admin] Calling method '>' {{(pid=103297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:31:14.024372 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: INFO nova.api.openstack.wsgi [None req-aaf49638-2fe3-42bd-80b1-784ae16b9b43 admin admin] HTTP exception thrown: Flavor 84 could not be found. May 26 12:31:14.025889 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi [None req-aaf49638-2fe3-42bd-80b1-784ae16b9b43 admin admin] Request method failure captured: May 26 12:31:14.025889 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 May 26 12:31:14.025889 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: Accept: application/json May 26 12:31:14.025889 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: Accept-Encoding: gzip, deflate May 26 12:31:14.025889 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: Connection: keep-alive May 26 12:31:14.025889 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: Content-Length: 0 May 26 12:31:14.025889 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: Host: 10.222.0.75 May 26 12:31:14.025889 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: Openstack-Api-Version: compute 2.90 May 26 12:31:14.025889 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: Openstack-System-Scope: None May 26 12:31:14.025889 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: User-Agent: python-novaclient May 26 12:31:14.025889 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: X-Auth-Token: gAAAAABij3MRzsl9QWaJ4WXRpnm9kA9HBmptT_Mfge8pTnfETFqctipX6Rv-KNpb2iK7isqrk-GskPLh-GA_PEu_Do3ywEMUem5-YYgW2Ap_o6r7-cNIEAuxBE7Mx57LNz8MOz89oMkqKCaJWUVzyHrtnVv4dkKgZsXWT7TFREyDL8oSSp36tZg May 26 12:31:14.025889 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: X-Domain-Id: None May 26 12:31:14.025889 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: X-Domain-Name: None May 26 12:31:14.025889 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: X-Identity-Status: Confirmed May 26 12:31:14.025889 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: X-Is-Admin-Project: True May 26 12:31:14.025889 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: X-Openstack-Nova-Api-Version: 2.90 May 26 12:31:14.025889 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: X-Project-Domain-Id: default May 26 12:31:14.025889 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: X-Project-Domain-Name: Default May 26 12:31:14.025889 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: X-Project-Id: f7b62d8bc2904e559160e9d978cde596 May 26 12:31:14.025889 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: X-Project-Name: admin May 26 12:31:14.025889 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: X-Role: admin,member,reader May 26 12:31:14.025889 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: X-Roles: admin,member,reader May 26 12:31:14.027331 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/f7b62d8bc2904e559160e9d978cde596"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.75:8080", "publicURL": "http://10.222.0.75:8080/v1/AUTH_f7b62d8bc2904e559160e9d978cde596"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2/f7b62d8bc2904e559160e9d978cde596"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/f7b62d8bc2904e559160e9d978cde596"}]}] May 26 12:31:14.027331 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: X-Tenant: admin May 26 12:31:14.027331 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: X-Tenant-Id: f7b62d8bc2904e559160e9d978cde596 May 26 12:31:14.027331 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: X-Tenant-Name: admin May 26 12:31:14.027331 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: X-User: admin May 26 12:31:14.027331 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: X-User-Domain-Id: default May 26 12:31:14.027331 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: X-User-Domain-Name: Default May 26 12:31:14.027331 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: X-User-Id: 801932a0f57f4075beaa7d9bf3b3839f May 26 12:31:14.027331 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: X-User-Name: admin May 26 12:31:14.027331 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: method: > May 26 12:31:14.027331 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: exception: Flavor 84 could not be found. May 26 12:31:14.027331 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: action_args: {'id': '84'} May 26 12:31:14.027331 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: {{(pid=103297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 12:31:14.027331 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 12:31:14.028421 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show May 26 12:31:14.028421 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) May 26 12:31:14.028421 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id May 26 12:31:14.028421 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) May 26 12:31:14.028421 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 26 12:31:14.028421 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 26 12:31:14.028421 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id May 26 12:31:14.028421 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, May 26 12:31:14.028421 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper May 26 12:31:14.028421 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 12:31:14.028421 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db May 26 12:31:14.028421 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) May 26 12:31:14.028421 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. May 26 12:31:14.028421 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: ERROR nova.api.openstack.wsgi May 26 12:31:14.028421 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 12:31:14.028421 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: ERROR nova.api.openstack.wsgi May 26 12:31:14.028421 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 12:31:14.028421 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 12:31:14.028421 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 12:31:14.029650 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 12:31:14.029650 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 12:31:14.029650 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 12:31:14.029650 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 12:31:14.029650 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show May 26 12:31:14.029650 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 26 12:31:14.029650 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. May 26 12:31:14.029650 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: ERROR nova.api.openstack.wsgi May 26 12:31:14.029650 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 12:31:14.029650 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: ERROR nova.api.openstack.wsgi May 26 12:31:14.029650 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 12:31:14.029650 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 12:31:14.029650 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 12:31:14.029650 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 12:31:14.029650 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 12:31:14.029650 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. May 26 12:31:14.029650 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: ERROR nova.api.openstack.wsgi May 26 12:31:14.029650 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi [None req-aaf49638-2fe3-42bd-80b1-784ae16b9b43 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=103297) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 12:31:14.030888 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: INFO nova.api.openstack.requestlog [None req-aaf49638-2fe3-42bd-80b1-784ae16b9b43 admin admin] 10.222.0.75 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.015316 May 26 12:31:14.030888 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: [pid: 103297|app: 0|req: 24/47] 10.222.0.75 () {60 vars in 1190 bytes} [Thu May 26 12:31:14 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 17 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) May 26 12:31:14.905106 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi [None req-33690319-e3a8-4a9e-bcca-86765c4ef58c admin admin] Calling method '>' {{(pid=103296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:31:14.906136 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: INFO nova.api.openstack.requestlog [None req-33690319-e3a8-4a9e-bcca-86765c4ef58c admin admin] 10.222.0.75 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001493 May 26 12:31:14.906529 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: [pid: 103296|app: 0|req: 24/48] 10.222.0.75 () {56 vars in 1074 bytes} [Thu May 26 12:31:14 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 12:31:15.119163 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi [None req-ad2d1546-204f-458a-8baf-a93fb6bc785a admin admin] Calling method '>' {{(pid=103297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:31:15.125132 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: INFO nova.api.openstack.wsgi [None req-ad2d1546-204f-458a-8baf-a93fb6bc785a admin admin] HTTP exception thrown: Flavor 451 could not be found. May 26 12:31:15.126639 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi [None req-ad2d1546-204f-458a-8baf-a93fb6bc785a admin admin] Request method failure captured: May 26 12:31:15.126639 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 May 26 12:31:15.126639 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: Accept: application/json May 26 12:31:15.126639 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: Accept-Encoding: gzip, deflate May 26 12:31:15.126639 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: Connection: keep-alive May 26 12:31:15.126639 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: Content-Length: 0 May 26 12:31:15.126639 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: Host: 10.222.0.75 May 26 12:31:15.126639 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: Openstack-Api-Version: compute 2.90 May 26 12:31:15.126639 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: Openstack-System-Scope: None May 26 12:31:15.126639 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: User-Agent: python-novaclient May 26 12:31:15.126639 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: X-Auth-Token: gAAAAABij3MSvWvMjmn7WjcNZozZWqiyFQwtCwiJcE2r2Z3VT8hbGC33PlfrnQzBhFzW0Xj0jGBsx3k6lFV9oD3-3zIzhDMaUbwbTy2is3NkgjErxE2V5DVyOvlCiodAuBn2DphBoT7QbOv6daTM3zWdrk7MaMoD05eponwfVpybAeGZwvoes6k May 26 12:31:15.126639 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: X-Domain-Id: None May 26 12:31:15.126639 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: X-Domain-Name: None May 26 12:31:15.126639 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: X-Identity-Status: Confirmed May 26 12:31:15.126639 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: X-Is-Admin-Project: True May 26 12:31:15.126639 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: X-Openstack-Nova-Api-Version: 2.90 May 26 12:31:15.126639 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: X-Project-Domain-Id: default May 26 12:31:15.126639 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: X-Project-Domain-Name: Default May 26 12:31:15.126639 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: X-Project-Id: f7b62d8bc2904e559160e9d978cde596 May 26 12:31:15.126639 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: X-Project-Name: admin May 26 12:31:15.126639 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: X-Role: admin,member,reader May 26 12:31:15.126639 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: X-Roles: admin,member,reader May 26 12:31:15.128136 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/f7b62d8bc2904e559160e9d978cde596"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.75:8080", "publicURL": "http://10.222.0.75:8080/v1/AUTH_f7b62d8bc2904e559160e9d978cde596"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2/f7b62d8bc2904e559160e9d978cde596"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/f7b62d8bc2904e559160e9d978cde596"}]}] May 26 12:31:15.128136 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: X-Tenant: admin May 26 12:31:15.128136 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: X-Tenant-Id: f7b62d8bc2904e559160e9d978cde596 May 26 12:31:15.128136 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: X-Tenant-Name: admin May 26 12:31:15.128136 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: X-User: admin May 26 12:31:15.128136 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: X-User-Domain-Id: default May 26 12:31:15.128136 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: X-User-Domain-Name: Default May 26 12:31:15.128136 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: X-User-Id: 801932a0f57f4075beaa7d9bf3b3839f May 26 12:31:15.128136 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: X-User-Name: admin May 26 12:31:15.128136 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: method: > May 26 12:31:15.128136 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: exception: Flavor 451 could not be found. May 26 12:31:15.128136 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: action_args: {'id': '451'} May 26 12:31:15.128136 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: {{(pid=103297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 12:31:15.128136 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 12:31:15.129188 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show May 26 12:31:15.129188 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) May 26 12:31:15.129188 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id May 26 12:31:15.129188 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) May 26 12:31:15.129188 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 26 12:31:15.129188 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 26 12:31:15.129188 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id May 26 12:31:15.129188 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, May 26 12:31:15.129188 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper May 26 12:31:15.129188 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 12:31:15.129188 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db May 26 12:31:15.129188 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) May 26 12:31:15.129188 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. May 26 12:31:15.129188 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: ERROR nova.api.openstack.wsgi May 26 12:31:15.129188 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 12:31:15.129188 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: ERROR nova.api.openstack.wsgi May 26 12:31:15.129188 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 12:31:15.129188 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 12:31:15.129188 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 12:31:15.130207 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 12:31:15.130207 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 12:31:15.130207 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 12:31:15.130207 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 12:31:15.130207 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show May 26 12:31:15.130207 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 26 12:31:15.130207 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. May 26 12:31:15.130207 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: ERROR nova.api.openstack.wsgi May 26 12:31:15.130207 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 12:31:15.130207 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: ERROR nova.api.openstack.wsgi May 26 12:31:15.130207 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 12:31:15.130207 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 12:31:15.130207 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 12:31:15.130207 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 12:31:15.130207 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 12:31:15.130207 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. May 26 12:31:15.130207 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: ERROR nova.api.openstack.wsgi May 26 12:31:15.130207 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi [None req-ad2d1546-204f-458a-8baf-a93fb6bc785a admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=103297) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 12:31:15.131408 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: INFO nova.api.openstack.requestlog [None req-ad2d1546-204f-458a-8baf-a93fb6bc785a admin admin] 10.222.0.75 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.068149 May 26 12:31:15.131408 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: [pid: 103297|app: 0|req: 25/49] 10.222.0.75 () {60 vars in 1193 bytes} [Thu May 26 12:31:15 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) May 26 12:31:15.138117 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi [None req-f33ab174-e060-47c3-858b-c09f9796e62d admin admin] Calling method '>' {{(pid=103296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:31:15.152023 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: INFO nova.api.openstack.requestlog [None req-f33ab174-e060-47c3-858b-c09f9796e62d admin admin] 10.222.0.75 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017502 May 26 12:31:15.152548 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: [pid: 103296|app: 0|req: 25/50] 10.222.0.75 () {60 vars in 1210 bytes} [Thu May 26 12:31:15 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 12:31:15.161923 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi [None req-df13129c-f1b7-4a03-ad81-0f25aef82ade admin admin] Calling method '>' {{(pid=103297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:31:15.176052 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: INFO nova.api.openstack.requestlog [None req-df13129c-f1b7-4a03-ad81-0f25aef82ade admin admin] 10.222.0.75 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017670 May 26 12:31:15.176602 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: [pid: 103297|app: 0|req: 26/51] 10.222.0.75 () {60 vars in 1210 bytes} [Thu May 26 12:31:15 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 12:31:15.185802 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi [None req-cda884f8-756b-44f1-a9c5-ab2c18397f41 admin admin] Calling method '>' {{(pid=103296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:31:15.191445 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: INFO nova.api.openstack.wsgi [None req-cda884f8-756b-44f1-a9c5-ab2c18397f41 admin admin] HTTP exception thrown: Flavor 451 could not be found. May 26 12:31:15.192969 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi [None req-cda884f8-756b-44f1-a9c5-ab2c18397f41 admin admin] Request method failure captured: May 26 12:31:15.192969 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 May 26 12:31:15.192969 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: Accept: application/json May 26 12:31:15.192969 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: Accept-Encoding: gzip, deflate May 26 12:31:15.192969 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: Connection: keep-alive May 26 12:31:15.192969 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: Content-Length: 0 May 26 12:31:15.192969 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: Host: 10.222.0.75 May 26 12:31:15.192969 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: Openstack-Api-Version: compute 2.90 May 26 12:31:15.192969 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: Openstack-System-Scope: None May 26 12:31:15.192969 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: User-Agent: python-novaclient May 26 12:31:15.192969 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: X-Auth-Token: gAAAAABij3MSvWvMjmn7WjcNZozZWqiyFQwtCwiJcE2r2Z3VT8hbGC33PlfrnQzBhFzW0Xj0jGBsx3k6lFV9oD3-3zIzhDMaUbwbTy2is3NkgjErxE2V5DVyOvlCiodAuBn2DphBoT7QbOv6daTM3zWdrk7MaMoD05eponwfVpybAeGZwvoes6k May 26 12:31:15.192969 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: X-Domain-Id: None May 26 12:31:15.192969 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: X-Domain-Name: None May 26 12:31:15.192969 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: X-Identity-Status: Confirmed May 26 12:31:15.192969 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: X-Is-Admin-Project: True May 26 12:31:15.192969 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: X-Openstack-Nova-Api-Version: 2.90 May 26 12:31:15.192969 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: X-Project-Domain-Id: default May 26 12:31:15.192969 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: X-Project-Domain-Name: Default May 26 12:31:15.192969 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: X-Project-Id: f7b62d8bc2904e559160e9d978cde596 May 26 12:31:15.192969 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: X-Project-Name: admin May 26 12:31:15.192969 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: X-Role: admin,member,reader May 26 12:31:15.192969 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: X-Roles: admin,member,reader May 26 12:31:15.194484 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/f7b62d8bc2904e559160e9d978cde596"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.75:8080", "publicURL": "http://10.222.0.75:8080/v1/AUTH_f7b62d8bc2904e559160e9d978cde596"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2/f7b62d8bc2904e559160e9d978cde596"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/f7b62d8bc2904e559160e9d978cde596"}]}] May 26 12:31:15.194484 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: X-Tenant: admin May 26 12:31:15.194484 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: X-Tenant-Id: f7b62d8bc2904e559160e9d978cde596 May 26 12:31:15.194484 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: X-Tenant-Name: admin May 26 12:31:15.194484 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: X-User: admin May 26 12:31:15.194484 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: X-User-Domain-Id: default May 26 12:31:15.194484 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: X-User-Domain-Name: Default May 26 12:31:15.194484 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: X-User-Id: 801932a0f57f4075beaa7d9bf3b3839f May 26 12:31:15.194484 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: X-User-Name: admin May 26 12:31:15.194484 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: method: > May 26 12:31:15.194484 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: exception: Flavor 451 could not be found. May 26 12:31:15.194484 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: action_args: {'id': '451'} May 26 12:31:15.194484 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: {{(pid=103296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 12:31:15.194484 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 12:31:15.195283 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show May 26 12:31:15.195283 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) May 26 12:31:15.195283 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id May 26 12:31:15.195283 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) May 26 12:31:15.195283 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 26 12:31:15.195283 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 26 12:31:15.195283 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id May 26 12:31:15.195283 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, May 26 12:31:15.195283 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper May 26 12:31:15.195283 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 12:31:15.195283 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db May 26 12:31:15.195283 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) May 26 12:31:15.195283 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. May 26 12:31:15.195283 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: ERROR nova.api.openstack.wsgi May 26 12:31:15.195283 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 12:31:15.195283 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: ERROR nova.api.openstack.wsgi May 26 12:31:15.195283 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 12:31:15.195283 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 12:31:15.195283 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 12:31:15.196474 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 12:31:15.196474 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 12:31:15.196474 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 12:31:15.196474 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 12:31:15.196474 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show May 26 12:31:15.196474 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 26 12:31:15.196474 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. May 26 12:31:15.196474 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: ERROR nova.api.openstack.wsgi May 26 12:31:15.196474 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 12:31:15.196474 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: ERROR nova.api.openstack.wsgi May 26 12:31:15.196474 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 12:31:15.196474 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 12:31:15.196474 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 12:31:15.196474 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 12:31:15.196474 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 12:31:15.196474 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. May 26 12:31:15.196474 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: ERROR nova.api.openstack.wsgi May 26 12:31:15.196474 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi [None req-cda884f8-756b-44f1-a9c5-ab2c18397f41 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=103296) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 12:31:15.197554 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: INFO nova.api.openstack.requestlog [None req-cda884f8-756b-44f1-a9c5-ab2c18397f41 admin admin] 10.222.0.75 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.012052 May 26 12:31:15.197554 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: [pid: 103296|app: 0|req: 26/52] 10.222.0.75 () {60 vars in 1193 bytes} [Thu May 26 12:31:15 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) May 26 12:31:16.065150 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi [None req-df13129c-f1b7-4a03-ad81-0f25aef82ade admin admin] Calling method '>' {{(pid=103297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:31:16.066422 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: INFO nova.api.openstack.requestlog [None req-df13129c-f1b7-4a03-ad81-0f25aef82ade admin admin] 10.222.0.75 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001439 May 26 12:31:16.066810 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: [pid: 103297|app: 0|req: 27/53] 10.222.0.75 () {56 vars in 1074 bytes} [Thu May 26 12:31:16 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 12:31:16.256382 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi [None req-bc0e850d-7a14-4084-ab7f-2076fdecdff1 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 12:31:16.278032 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: INFO nova.api.openstack.requestlog [None req-bc0e850d-7a14-4084-ab7f-2076fdecdff1 admin admin] 10.222.0.75 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.077583 May 26 12:31:16.278464 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: [pid: 103296|app: 0|req: 27/54] 10.222.0.75 () {64 vars in 1235 bytes} [Thu May 26 12:31:16 2022] POST /compute/v2.1/flavors => generated 404 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 26 12:31:17.162442 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi [None req-df13129c-f1b7-4a03-ad81-0f25aef82ade admin admin] Calling method '>' {{(pid=103297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:31:17.163439 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: INFO nova.api.openstack.requestlog [None req-df13129c-f1b7-4a03-ad81-0f25aef82ade admin admin] 10.222.0.75 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001420 May 26 12:31:17.163861 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: [pid: 103297|app: 0|req: 28/55] 10.222.0.75 () {56 vars in 1074 bytes} [Thu May 26 12:31:17 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 12:31:17.359799 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi [None req-52eb6da0-61ba-4513-a958-1842d18c5a97 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 12:31:17.380204 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: INFO nova.api.openstack.requestlog [None req-52eb6da0-61ba-4513-a958-1842d18c5a97 admin admin] 10.222.0.75 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.081558 May 26 12:31:17.380739 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: [pid: 103296|app: 0|req: 28/56] 10.222.0.75 () {64 vars in 1235 bytes} [Thu May 26 12:31:17 2022] POST /compute/v2.1/flavors => generated 405 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 26 12:31:18.242747 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi [None req-df13129c-f1b7-4a03-ad81-0f25aef82ade admin admin] Calling method '>' {{(pid=103297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:31:18.243814 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: INFO nova.api.openstack.requestlog [None req-df13129c-f1b7-4a03-ad81-0f25aef82ade admin admin] 10.222.0.75 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001495 May 26 12:31:18.244210 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: [pid: 103297|app: 0|req: 29/57] 10.222.0.75 () {56 vars in 1074 bytes} [Thu May 26 12:31:18 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 12:31:18.449922 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi [None req-2dde97f7-d32e-4379-8b95-fc274858e390 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 12:31:18.468936 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: INFO nova.api.openstack.requestlog [None req-2dde97f7-d32e-4379-8b95-fc274858e390 admin admin] 10.222.0.75 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.090711 May 26 12:31:18.469549 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: [pid: 103296|app: 0|req: 29/58] 10.222.0.75 () {64 vars in 1235 bytes} [Thu May 26 12:31:18 2022] POST /compute/v2.1/flavors => generated 407 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 26 12:31:19.348652 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi [None req-df13129c-f1b7-4a03-ad81-0f25aef82ade admin admin] Calling method '>' {{(pid=103297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:31:19.349661 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: INFO nova.api.openstack.requestlog [None req-df13129c-f1b7-4a03-ad81-0f25aef82ade admin admin] 10.222.0.75 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001438 May 26 12:31:19.350051 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: [pid: 103297|app: 0|req: 30/59] 10.222.0.75 () {56 vars in 1074 bytes} [Thu May 26 12:31:19 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 12:31:19.541854 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi [None req-5a315748-262a-459e-a7de-303339074b83 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 12:31:19.561451 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: INFO nova.api.openstack.requestlog [None req-5a315748-262a-459e-a7de-303339074b83 admin admin] 10.222.0.75 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.072886 May 26 12:31:19.561944 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: [pid: 103296|app: 0|req: 30/60] 10.222.0.75 () {64 vars in 1235 bytes} [Thu May 26 12:31:19 2022] POST /compute/v2.1/flavors => generated 409 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 26 12:31:20.434052 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi [None req-df13129c-f1b7-4a03-ad81-0f25aef82ade admin admin] Calling method '>' {{(pid=103297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:31:20.435046 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: INFO nova.api.openstack.requestlog [None req-df13129c-f1b7-4a03-ad81-0f25aef82ade admin admin] 10.222.0.75 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001428 May 26 12:31:20.435432 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: [pid: 103297|app: 0|req: 31/61] 10.222.0.75 () {56 vars in 1074 bytes} [Thu May 26 12:31:20 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 12:31:20.635374 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi [None req-c939ec0c-eecb-4eb2-b736-b013f5f03c40 admin admin] Calling method '>' {{(pid=103296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:31:20.654486 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: INFO nova.api.openstack.requestlog [None req-c939ec0c-eecb-4eb2-b736-b013f5f03c40 admin admin] 10.222.0.75 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.074712 May 26 12:31:20.655023 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: [pid: 103296|app: 0|req: 31/62] 10.222.0.75 () {60 vars in 1202 bytes} [Thu May 26 12:31:20 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 12:32:22.505178 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi [None req-df13129c-f1b7-4a03-ad81-0f25aef82ade admin admin] Calling method '>' {{(pid=103297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:32:22.506188 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: INFO nova.api.openstack.requestlog [None req-df13129c-f1b7-4a03-ad81-0f25aef82ade admin admin] 10.222.0.75 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001445 May 26 12:32:22.506563 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: [pid: 103297|app: 0|req: 32/63] 10.222.0.75 () {54 vars in 930 bytes} [Thu May 26 12:32:22 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 12:32:22.514704 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG dbcounter [-] [103296] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=4 {{(pid=103296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:32:22.581926 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi [None req-5f31afbd-aeed-4bf8-88a3-a10991262ef4 admin admin] Calling method '>' {{(pid=103296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:32:22.602221 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: INFO nova.api.openstack.requestlog [None req-5f31afbd-aeed-4bf8-88a3-a10991262ef4 admin admin] 10.222.0.75 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.089356 May 26 12:32:22.602737 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: [pid: 103296|app: 0|req: 32/64] 10.222.0.75 () {60 vars in 1291 bytes} [Thu May 26 12:32:22 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 12:32:22.624544 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG dbcounter [-] [103297] Writing DB stats nova_api:SELECT=14 {{(pid=103297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:32:22.628426 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi [None req-08b89c46-fecf-4caa-8253-18b66fa00a31 admin admin] Calling method '>' {{(pid=103297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:32:22.636330 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: INFO nova.api.openstack.requestlog [None req-08b89c46-fecf-4caa-8253-18b66fa00a31 admin admin] 10.222.0.75 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.013790 May 26 12:32:22.636858 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: [pid: 103297|app: 0|req: 33/65] 10.222.0.75 () {60 vars in 1282 bytes} [Thu May 26 12:32:22 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 15 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:32:22.648818 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi [None req-594a9e0b-0e5f-44fd-96c3-b7cb9b7b0541 admin admin] Calling method '>' {{(pid=103296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:32:22.656751 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: INFO nova.api.openstack.requestlog [None req-594a9e0b-0e5f-44fd-96c3-b7cb9b7b0541 admin admin] 10.222.0.75 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011554 May 26 12:32:22.657289 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: [pid: 103296|app: 0|req: 33/66] 10.222.0.75 () {60 vars in 1285 bytes} [Thu May 26 12:32:22 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:32:22.671181 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi [None req-bb0b9b58-d0c5-44fa-a9b3-d615acbab2e8 admin admin] Calling method '>' {{(pid=103297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:32:22.681079 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: INFO nova.api.openstack.requestlog [None req-bb0b9b58-d0c5-44fa-a9b3-d615acbab2e8 admin admin] 10.222.0.75 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.015594 May 26 12:32:22.681596 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: [pid: 103297|app: 0|req: 34/67] 10.222.0.75 () {60 vars in 1285 bytes} [Thu May 26 12:32:22 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 17 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:32:22.694714 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi [None req-a041a2e1-99fc-4752-9344-36cf8ec8472e admin admin] Calling method '>' {{(pid=103296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:32:22.702423 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: INFO nova.api.openstack.requestlog [None req-a041a2e1-99fc-4752-9344-36cf8ec8472e admin admin] 10.222.0.75 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011643 May 26 12:32:22.702939 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: [pid: 103296|app: 0|req: 34/68] 10.222.0.75 () {60 vars in 1282 bytes} [Thu May 26 12:32:22 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:35:59.736041 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi [None req-bb0b9b58-d0c5-44fa-a9b3-d615acbab2e8 admin admin] Calling method '>' {{(pid=103297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:35:59.737051 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: INFO nova.api.openstack.requestlog [None req-bb0b9b58-d0c5-44fa-a9b3-d615acbab2e8 admin admin] 10.222.0.75 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001533 May 26 12:35:59.737425 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: [pid: 103297|app: 0|req: 35/69] 10.222.0.75 () {56 vars in 1074 bytes} [Thu May 26 12:35:59 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 12:35:59.891668 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG dbcounter [-] [103296] Writing DB stats nova_api:SELECT=6 {{(pid=103296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:36:00.023703 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi [None req-4a8a8201-5a8a-409e-923d-ddafb1e40cf2 admin admin] Calling method '>' {{(pid=103296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:36:00.025496 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 26 12:36:00.025496 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: warnings.warn(msg) May 26 12:36:00.027220 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG oslo_concurrency.lockutils [None req-4a8a8201-5a8a-409e-923d-ddafb1e40cf2 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:36:00.027707 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG oslo_concurrency.lockutils [None req-4a8a8201-5a8a-409e-923d-ddafb1e40cf2 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:36:00.028924 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG oslo_concurrency.lockutils [None req-4a8a8201-5a8a-409e-923d-ddafb1e40cf2 admin admin] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:36:00.029416 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG oslo_concurrency.lockutils [None req-4a8a8201-5a8a-409e-923d-ddafb1e40cf2 admin admin] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:36:00.063252 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: INFO nova.api.openstack.requestlog [None req-4a8a8201-5a8a-409e-923d-ddafb1e40cf2 admin admin] 10.222.0.75 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.174633 May 26 12:36:00.063885 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: [pid: 103296|app: 0|req: 35/70] 10.222.0.75 () {60 vars in 1193 bytes} [Thu May 26 12:35:59 2022] GET /compute/v2.1/os-services => generated 791 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 26 12:36:00.936916 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi [None req-bb0b9b58-d0c5-44fa-a9b3-d615acbab2e8 admin admin] Calling method '>' {{(pid=103297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:36:00.937933 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: INFO nova.api.openstack.requestlog [None req-bb0b9b58-d0c5-44fa-a9b3-d615acbab2e8 admin admin] 10.222.0.75 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001456 May 26 12:36:00.938363 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: [pid: 103297|app: 0|req: 36/71] 10.222.0.75 () {56 vars in 1074 bytes} [Thu May 26 12:36:00 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 12:36:01.140329 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi [None req-a4fdb288-8aac-48ae-8744-7748f23dba27 admin admin] Calling method '>' {{(pid=103296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:36:01.141492 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 26 12:36:01.141492 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: warnings.warn(msg) May 26 12:36:01.143027 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG oslo_concurrency.lockutils [None req-a4fdb288-8aac-48ae-8744-7748f23dba27 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:36:01.143461 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG oslo_concurrency.lockutils [None req-a4fdb288-8aac-48ae-8744-7748f23dba27 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:36:01.144259 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG oslo_concurrency.lockutils [None req-a4fdb288-8aac-48ae-8744-7748f23dba27 admin admin] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:36:01.144680 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG oslo_concurrency.lockutils [None req-a4fdb288-8aac-48ae-8744-7748f23dba27 admin admin] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:36:01.163870 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: INFO nova.api.openstack.requestlog [None req-a4fdb288-8aac-48ae-8744-7748f23dba27 admin admin] 10.222.0.75 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.085558 May 26 12:36:01.164410 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: [pid: 103296|app: 0|req: 36/72] 10.222.0.75 () {60 vars in 1193 bytes} [Thu May 26 12:36:01 2022] GET /compute/v2.1/os-services => generated 791 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 26 12:36:12.450993 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi [None req-bb0b9b58-d0c5-44fa-a9b3-d615acbab2e8 admin admin] Calling method '>' {{(pid=103297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:36:12.452028 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: INFO nova.api.openstack.requestlog [None req-bb0b9b58-d0c5-44fa-a9b3-d615acbab2e8 admin admin] 10.222.0.75 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001472 May 26 12:36:12.452432 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: [pid: 103297|app: 0|req: 37/73] 10.222.0.75 () {56 vars in 1074 bytes} [Thu May 26 12:36:12 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 12:36:12.596935 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG dbcounter [-] [103296] Writing DB stats nova_cell0:SELECT=4 {{(pid=103296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:36:12.597957 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG dbcounter [-] [103296] Writing DB stats nova_cell1:SELECT=4 {{(pid=103296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:36:12.598695 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG dbcounter [-] [103296] Writing DB stats nova_api:SELECT=8 {{(pid=103296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:36:12.649957 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi [None req-d1f5461a-24e1-430d-b376-a1fea8054ff5 admin admin] Calling method '>' {{(pid=103296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:36:12.651121 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 26 12:36:12.651121 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: warnings.warn(msg) May 26 12:36:12.652376 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG oslo_concurrency.lockutils [None req-d1f5461a-24e1-430d-b376-a1fea8054ff5 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:36:12.652809 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG oslo_concurrency.lockutils [None req-d1f5461a-24e1-430d-b376-a1fea8054ff5 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:36:12.653590 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG oslo_concurrency.lockutils [None req-d1f5461a-24e1-430d-b376-a1fea8054ff5 admin admin] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:36:12.654004 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG oslo_concurrency.lockutils [None req-d1f5461a-24e1-430d-b376-a1fea8054ff5 admin admin] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:36:12.678900 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: INFO nova.api.openstack.requestlog [None req-d1f5461a-24e1-430d-b376-a1fea8054ff5 admin admin] 10.222.0.75 "GET /compute/v2.1/os-services" status: 200 len: 1011 microversion: 2.90 time: 0.089254 May 26 12:36:12.679370 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: [pid: 103296|app: 0|req: 37/74] 10.222.0.75 () {60 vars in 1193 bytes} [Thu May 26 12:36:12 2022] GET /compute/v2.1/os-services => generated 1011 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 12:36:13.583356 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: DEBUG nova.api.openstack.wsgi [None req-bb0b9b58-d0c5-44fa-a9b3-d615acbab2e8 admin admin] Calling method '>' {{(pid=103297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:36:13.584493 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: INFO nova.api.openstack.requestlog [None req-bb0b9b58-d0c5-44fa-a9b3-d615acbab2e8 admin admin] 10.222.0.75 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001588 May 26 12:36:13.584893 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: [pid: 103297|app: 0|req: 38/75] 10.222.0.75 () {56 vars in 1074 bytes} [Thu May 26 12:36:13 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 12:36:13.782947 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG nova.api.openstack.wsgi [None req-24081edb-657b-4a20-9901-50ef56a8eed0 admin admin] Calling method '>' {{(pid=103296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:36:13.784119 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 26 12:36:13.784119 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: warnings.warn(msg) May 26 12:36:13.785339 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG oslo_concurrency.lockutils [None req-24081edb-657b-4a20-9901-50ef56a8eed0 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:36:13.785781 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG oslo_concurrency.lockutils [None req-24081edb-657b-4a20-9901-50ef56a8eed0 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:36:13.786556 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG oslo_concurrency.lockutils [None req-24081edb-657b-4a20-9901-50ef56a8eed0 admin admin] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:36:13.787019 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: DEBUG oslo_concurrency.lockutils [None req-24081edb-657b-4a20-9901-50ef56a8eed0 admin admin] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:36:13.808514 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: INFO nova.api.openstack.requestlog [None req-24081edb-657b-4a20-9901-50ef56a8eed0 admin admin] 10.222.0.75 "GET /compute/v2.1/os-services" status: 200 len: 1011 microversion: 2.90 time: 0.085082 May 26 12:36:13.809068 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: [pid: 103296|app: 0|req: 38/76] 10.222.0.75 () {60 vars in 1193 bytes} [Thu May 26 12:36:13 2022] GET /compute/v2.1/os-services => generated 1011 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 12:37:13.036576 dv-cinder-819667-4-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... May 26 12:37:13.037334 dv-cinder-819667-4-iscsi devstack@n-api.service[103295]: Thu May 26 12:37:13 2022 - graceful shutdown triggered... May 26 12:37:13.037823 dv-cinder-819667-4-iscsi devstack@n-api.service[103296]: Gracefully killing worker 1 (pid: 103296)... May 26 12:37:13.038528 dv-cinder-819667-4-iscsi devstack@n-api.service[103297]: Gracefully killing worker 2 (pid: 103297)... May 26 12:37:14.038341 dv-cinder-819667-4-iscsi devstack@n-api.service[103295]: worker 1 buried after 1 seconds May 26 12:37:14.038341 dv-cinder-819667-4-iscsi devstack@n-api.service[103295]: worker 2 buried after 1 seconds May 26 12:37:14.038341 dv-cinder-819667-4-iscsi devstack@n-api.service[103295]: goodbye to uWSGI. May 26 12:37:14.041028 dv-cinder-819667-4-iscsi systemd[1]: devstack@n-api.service: Succeeded. May 26 12:37:14.041945 dv-cinder-819667-4-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. May 26 12:37:14.046280 dv-cinder-819667-4-iscsi systemd[1]: Starting Devstack devstack@n-api.service... May 26 12:37:14.068234 dv-cinder-819667-4-iscsi devstack@n-api.service[129308]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini May 26 12:37:14.084810 dv-cinder-819667-4-iscsi devstack@n-api.service[129308]: *** Starting uWSGI 2.0.18-debian (64bit) on [Thu May 26 12:37:14 2022] *** May 26 12:37:14.084810 dv-cinder-819667-4-iscsi devstack@n-api.service[129308]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 May 26 12:37:14.084810 dv-cinder-819667-4-iscsi devstack@n-api.service[129308]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 May 26 12:37:14.084810 dv-cinder-819667-4-iscsi devstack@n-api.service[129308]: nodename: dv-cinder-819667-4-iscsi May 26 12:37:14.084810 dv-cinder-819667-4-iscsi devstack@n-api.service[129308]: machine: x86_64 May 26 12:37:14.084810 dv-cinder-819667-4-iscsi devstack@n-api.service[129308]: clock source: unix May 26 12:37:14.084810 dv-cinder-819667-4-iscsi devstack@n-api.service[129308]: pcre jit disabled May 26 12:37:14.084810 dv-cinder-819667-4-iscsi devstack@n-api.service[129308]: detected number of CPU cores: 4 May 26 12:37:14.084810 dv-cinder-819667-4-iscsi devstack@n-api.service[129308]: current working directory: / May 26 12:37:14.084810 dv-cinder-819667-4-iscsi devstack@n-api.service[129308]: detected binary path: /usr/bin/uwsgi-core May 26 12:37:14.084810 dv-cinder-819667-4-iscsi devstack@n-api.service[129308]: your processes number limit is 47680 May 26 12:37:14.084810 dv-cinder-819667-4-iscsi devstack@n-api.service[129308]: your memory page size is 4096 bytes May 26 12:37:14.084810 dv-cinder-819667-4-iscsi devstack@n-api.service[129308]: detected max file descriptor number: 2048 May 26 12:37:14.084810 dv-cinder-819667-4-iscsi devstack@n-api.service[129308]: lock engine: pthread robust mutexes May 26 12:37:14.085881 dv-cinder-819667-4-iscsi devstack@n-api.service[129308]: thunder lock: enabled May 26 12:37:14.085881 dv-cinder-819667-4-iscsi devstack@n-api.service[129308]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 May 26 12:37:14.085881 dv-cinder-819667-4-iscsi devstack@n-api.service[129308]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] May 26 12:37:14.129885 dv-cinder-819667-4-iscsi devstack@n-api.service[129308]: Python main interpreter initialized at 0x55ffda79e9c0 May 26 12:37:14.129885 dv-cinder-819667-4-iscsi devstack@n-api.service[129308]: python threads support enabled May 26 12:37:14.129885 dv-cinder-819667-4-iscsi devstack@n-api.service[129308]: your server socket listen backlog is limited to 100 connections May 26 12:37:14.129885 dv-cinder-819667-4-iscsi devstack@n-api.service[129308]: your mercy for graceful operations on workers is 90 seconds May 26 12:37:14.130309 dv-cinder-819667-4-iscsi devstack@n-api.service[129308]: mapped 403077 bytes (393 KB) for 2 cores May 26 12:37:14.130309 dv-cinder-819667-4-iscsi devstack@n-api.service[129308]: *** Operational MODE: preforking *** May 26 12:37:14.130566 dv-cinder-819667-4-iscsi devstack@n-api.service[129308]: *** uWSGI is running in multiple interpreter mode *** May 26 12:37:14.130566 dv-cinder-819667-4-iscsi devstack@n-api.service[129308]: spawned uWSGI master process (pid: 129308) May 26 12:37:14.130787 dv-cinder-819667-4-iscsi systemd[1]: Started Devstack devstack@n-api.service. May 26 12:37:14.136758 dv-cinder-819667-4-iscsi devstack@n-api.service[129308]: spawned uWSGI worker 1 (pid: 129321, cores: 1) May 26 12:37:14.136758 dv-cinder-819667-4-iscsi devstack@n-api.service[129308]: spawned uWSGI worker 2 (pid: 129322, cores: 1) May 26 12:37:14.136758 dv-cinder-819667-4-iscsi devstack@n-api.service[129308]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... May 26 12:37:15.296055 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. May 26 12:37:15.304193 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. May 26 12:37:16.083401 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 26 12:37:16.083401 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: from cryptography.utils import int_from_bytes May 26 12:37:16.083731 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 26 12:37:16.083731 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: from cryptography.utils import int_from_bytes May 26 12:37:16.083866 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 26 12:37:16.083866 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: from cryptography.utils import int_from_bytes May 26 12:37:16.083988 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 26 12:37:16.083988 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: from cryptography.utils import int_from_bytes May 26 12:37:18.466734 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=129321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 26 12:37:18.467329 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=129321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 26 12:37:18.467618 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=129321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 26 12:37:18.467937 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=129321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 26 12:37:18.468157 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=129321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 26 12:37:18.469048 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=129321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:37:18.469048 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=129321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:37:18.469215 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=129321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:37:18.469478 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=129321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:37:18.469813 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=129321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:37:18.470126 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=129321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:37:18.470453 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=129321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:37:18.470795 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=129321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:37:18.471127 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=129321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:37:18.471395 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=129321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:37:18.471737 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=129321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:37:18.472053 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-819667-4-iscsi {{(pid=129321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:37:18.472376 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=129321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:37:18.472685 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=129321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:37:18.472996 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=129321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:37:18.473087 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=129322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 26 12:37:18.473486 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=129321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:37:18.473576 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=129322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 26 12:37:18.473658 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=129321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:37:18.473874 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=129322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 26 12:37:18.473987 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=129321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:37:18.474203 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=129321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:37:18.474310 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=129322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 26 12:37:18.474486 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=129322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 26 12:37:18.474702 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=129321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:37:18.474877 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=129322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:37:18.475935 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=129321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:37:18.476053 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=129322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:37:18.476129 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=129321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:37:18.476212 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=129322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:37:18.476288 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=129321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:37:18.476372 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=129322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:37:18.476450 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=129321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:37:18.476531 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=129322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:37:18.476606 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=129321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:37:18.476683 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=129322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:37:18.476753 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=129321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:37:18.476865 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=129322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:37:18.477072 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=129321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:37:18.477228 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=129322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:37:18.477389 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=129321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:37:18.477667 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=129322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:37:18.477802 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=129321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:37:18.477938 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=129322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:37:18.478040 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=129321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:37:18.478354 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=129322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:37:18.478445 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-819667-4-iscsi {{(pid=129321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:37:18.478689 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-819667-4-iscsi {{(pid=129322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:37:18.478794 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=129321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:37:18.479010 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=129321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:37:18.479099 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=129322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:37:18.479324 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=129322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:37:18.479424 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=129321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:37:18.479664 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=129322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:37:18.479787 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=129321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:37:18.479993 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=129322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:37:18.480112 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=129321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:37:18.480306 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=129322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:37:18.480430 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=129321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:37:18.480647 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=129322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:37:18.480758 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=129321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:37:18.480950 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=129322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:37:18.481121 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=129321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:37:18.481256 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=129321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:37:18.481462 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=129322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:37:18.481637 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=129321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:37:18.481776 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=129322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:37:18.481887 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=129321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:37:18.482085 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=129322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:37:18.482208 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=129321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:37:18.482398 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=129322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:37:18.482526 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=129321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:37:18.482738 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=129322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:37:18.482836 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=129321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:37:18.483052 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=129322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:37:18.483154 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=129321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:37:18.483364 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=129322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:37:18.483461 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=129321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:37:18.483718 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=129322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:37:18.483823 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=129321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:37:18.484031 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=129322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:37:18.484135 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=129321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:37:18.484332 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=129321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:37:18.484421 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=129322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:37:18.484586 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=129321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:37:18.484678 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=129322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:37:18.484894 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=129321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:37:18.485047 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-819667-4-iscsi {{(pid=129322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:37:18.485216 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=129321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:37:18.485364 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=129322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:37:18.485534 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=129321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:37:18.485679 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=129322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:37:18.485857 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=129321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:37:18.485995 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=129322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:37:18.486109 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=129321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:37:18.486359 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=129321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:37:18.486450 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=129322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:37:18.486675 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=129321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:37:18.486768 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=129322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:37:18.487001 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=129321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:37:18.487092 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=129322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:37:18.487307 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=129321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:37:18.487398 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=129322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:37:18.487637 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=129321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:37:18.487731 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=129322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:37:18.487947 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=129321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:37:18.488046 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=129322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:37:18.488256 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=129321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:37:18.488354 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=129322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:37:18.488564 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=129321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:37:18.488655 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=129322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:37:18.488869 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=129321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:37:18.488966 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=129322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:37:18.489188 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=129321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:37:18.489303 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=129322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:37:18.489479 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=129321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:37:18.489569 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=129322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:37:18.489794 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=129321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:37:18.489892 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=129322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:37:18.490110 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=129322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:37:18.490239 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=129321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:37:18.490430 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=129321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:37:18.490532 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=129322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:37:18.490734 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=129322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:37:18.490848 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=129321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:37:18.491043 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=129322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:37:18.491161 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=129321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:37:18.491298 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=129322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:37:18.491432 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.75 {{(pid=129321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:37:18.491685 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=129322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:37:18.491778 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.75 {{(pid=129321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:37:18.492003 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=129321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:37:18.492144 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=129322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:37:18.492322 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=129322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:37:18.492447 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=129321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:37:18.492711 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=129322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:37:18.492814 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=129321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:37:18.493036 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=129321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:37:18.493126 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=129322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:37:18.493354 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=129321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:37:18.493505 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=129322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:37:18.493675 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=129321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:37:18.493837 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=129322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:37:18.493983 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=129321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:37:18.494165 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=129322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:37:18.494288 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=129321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:37:18.494478 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=129322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:37:18.494581 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=129321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:37:18.494792 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=129322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:37:18.494937 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=129321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:37:18.495105 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=129322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:37:18.495240 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=129321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:37:18.495417 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=129322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:37:18.495564 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=129321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:37:18.495755 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=129322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:37:18.495855 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=129321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:37:18.496056 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=129321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:37:18.496154 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=129322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:37:18.496362 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=129322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:37:18.496463 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=129321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:37:18.496673 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=129322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:37:18.496764 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=129321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:37:18.496984 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=129321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:37:18.497079 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=129322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:37:18.497292 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=129321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:37:18.497390 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=129322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:37:18.497600 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=129321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:37:18.497701 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=129322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:37:18.497901 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=129321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:37:18.497991 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=129322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:37:18.498209 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=129321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:37:18.498308 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=129322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:37:18.498516 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=129321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:37:18.498608 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.75 {{(pid=129322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:37:18.498822 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=129321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:37:18.498921 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.75 {{(pid=129322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:37:18.499126 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=129321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:37:18.499230 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=129322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:37:18.499599 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=129321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:37:18.499735 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=129322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:37:18.499871 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=129321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:37:18.499997 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=129322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:37:18.500140 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=129321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:37:18.501137 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=129322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:37:18.501372 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=129321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:37:18.501523 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=129322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:37:18.501670 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=129321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:37:18.501810 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=129322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:37:18.501947 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=129321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:37:18.502115 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=129322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:37:18.502263 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=129321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:37:18.502412 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=129322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:37:18.502551 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=129321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:37:18.502697 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=129322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:37:18.502958 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=129321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:37:18.503108 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=129322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:37:18.503246 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=129321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:37:18.503402 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=129322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:37:18.503899 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=129321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:37:18.504051 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=129322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:37:18.504189 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=129321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:37:18.504333 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=129322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:37:18.504472 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=129321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:37:18.504618 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=129322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:37:18.504767 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=129321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:37:18.504905 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=129322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:37:18.505048 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=129321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:37:18.505206 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=129322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:37:18.505355 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=129321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:37:18.505502 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=129322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:37:18.505641 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=129321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:37:18.505786 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=129322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:37:18.505932 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=129321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:37:18.506079 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=129322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:37:18.506224 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=129321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:37:18.506386 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=129322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:37:18.506532 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=129321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:37:18.506671 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=129322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:37:18.506822 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=129321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:37:18.506969 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=129322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:37:18.507116 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=129321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:37:18.507254 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=129322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:37:18.507350 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=129321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:37:18.507434 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=129322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:37:18.507527 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=129321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:37:18.507640 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=129322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:37:18.507732 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=129321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:37:18.507823 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=129322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:37:18.508031 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=129321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:37:18.508301 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=129322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:37:18.508503 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=129321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:37:18.508646 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=129322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:37:18.508747 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=129321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:37:18.508891 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=129322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:37:18.509101 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=129321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:37:18.509262 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=129322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:37:18.509365 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=129321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:37:18.509500 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=129322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:37:18.509599 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=129321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:37:18.509733 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=129322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:37:18.509820 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=129321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:37:18.509976 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=129322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:37:18.510124 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=129321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:37:18.510270 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=129322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:37:18.510508 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=129321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:37:18.510610 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=129322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:37:18.510744 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=129321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:37:18.510939 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=129322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:37:18.511066 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=129321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:37:18.511160 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=129322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:37:18.511306 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=129321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:37:18.511671 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=129322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:37:18.511762 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=129321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:37:18.511885 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=129322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:37:18.511985 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=129321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:37:18.512120 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=129322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:37:18.512214 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=129321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.512357 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=129322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:37:18.512452 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=129321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.512550 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=129322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:37:18.512730 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=129321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.512889 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=129322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:37:18.512982 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=129321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.513065 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=129322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:37:18.513155 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=129321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.513241 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=129322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:37:18.513322 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=129321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.513411 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=129322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:37:18.513500 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=129321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.513679 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=129322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:37:18.513827 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=129321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.513978 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=129322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:37:18.514069 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=129321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.514152 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=129322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:37:18.514234 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=129321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.514322 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=129322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:37:18.514417 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=129321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.514500 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=129322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:37:18.514620 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=129321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.514805 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=129322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:37:18.514933 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=129321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.515040 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=129322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:37:18.515239 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=129322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:37:18.515328 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=129321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.515578 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=129322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:37:18.515683 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=129321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.515872 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=129322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:37:18.515972 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=129321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.516176 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=129322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:37:18.516266 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=129321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.516498 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=129322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:37:18.516587 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=129321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.516824 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=129322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:37:18.516928 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=129321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.517136 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=129321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.517276 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=129322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:37:18.517444 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=129322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:37:18.517536 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=129321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.517754 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=129322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:37:18.517853 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=129321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.518075 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=129322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:37:18.518174 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=129321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.518385 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=129321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.518481 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=129322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.518729 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=129321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.518821 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=129322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.519080 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=129321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.519179 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=129322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.519395 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=129322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.519493 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=129321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.519748 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=129321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.519839 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=129322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.520078 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=129321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.520171 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=129322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.520390 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=129321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.520604 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=129322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.520704 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=129322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.520805 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=129321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.521004 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=129321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.521137 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=129322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.521333 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=129322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.521425 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=129321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.521649 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=129322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.521754 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=129321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.521966 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=129322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.522057 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=129321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.522284 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=129321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.522373 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=129322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.522600 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=129321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.522700 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=129322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.522916 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=129321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.523012 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=129322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.523231 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=129321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.523333 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=129322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.523592 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=129321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.523688 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=129322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.523913 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=129322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.524044 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=129321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.524241 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=129322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.524477 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=129321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.524581 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=129322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.524798 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=129321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.524895 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=129322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.525117 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=129321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.525215 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=129322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.525434 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=129321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.525535 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=129322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.525755 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=129321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.525846 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=129322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.526434 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=129321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.526539 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=129322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.526749 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=129321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.526858 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=129322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.527067 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=129321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.527165 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=129322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.527373 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=129321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.527504 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=129322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.527707 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=129321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.527813 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=129322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.528017 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=129321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.528116 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=129322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.528329 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=129321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.528429 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=129322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.528635 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=129321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.528737 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=129322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.528958 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=129321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.529056 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=129322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.529287 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=129321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.529384 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=129322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.529594 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=129321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.529686 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=129322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.529929 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=129321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.530030 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=129322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.530238 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=129321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.530336 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=129322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.530552 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=129321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.530711 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=129322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.530865 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=129321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.530959 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=129322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.531181 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=129321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.531348 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=129322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.531551 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=129321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.531670 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=129322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.531813 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=129321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.531902 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=129322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.532126 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=129321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.532231 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=129322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.532433 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=129321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.532532 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=129322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.532756 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=129322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.532847 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=129321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.533066 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=129321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.533164 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=129322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.533372 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=129321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.533470 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=129322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.533685 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=129322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.533781 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=129321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.533988 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=129321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.534092 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=129322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.534292 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=129321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.534390 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=129322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.534597 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=129322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.534686 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=129321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.534908 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=129322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.535006 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=129321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.535216 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=129321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.535313 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=129322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.535523 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=129322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.535700 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=129321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.535856 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=129321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.535946 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=129322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.536179 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=129321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.536269 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=129322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.536495 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=129321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.536598 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=129322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.536814 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=129321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.536915 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=129322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.537128 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=129322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.537224 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=129321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.537444 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=129322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.537578 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=129321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.537760 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=129322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.537852 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=129321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.538612 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=129322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.538768 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=129321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.538910 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=129322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.539058 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=129321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.539208 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=129322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.539368 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=129321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.539553 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=129322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.539713 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=129321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.539906 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=129322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.540094 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=129321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.540236 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=129322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.540374 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=129321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.540519 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=129322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.540681 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=129321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.540830 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=129322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.540977 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=129321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.541115 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=129322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.541280 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=129321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.541556 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=129322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.541701 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=129321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.541839 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=129322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.541989 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=129321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.542134 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=129322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.542274 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=129321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.542411 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=129322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.542555 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=129321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.542555 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=129321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.542857 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=129322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.542996 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=129321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.543141 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=129322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.543279 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=129321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.543381 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=129322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.543474 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=129321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.543580 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=129322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.543678 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=129321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.543770 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=129322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.543888 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=129322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.544231 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=129322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.544545 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=129321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.544679 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=129322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.544868 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=129322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.544998 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=129321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.545198 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=129322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.545313 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=129321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.545530 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=129322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.545637 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=129321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.545881 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=129322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.546022 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=129321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.546189 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=129322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.546340 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=129321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.546477 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=129322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.546578 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=129321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.546817 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=129322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.546956 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=129321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.547131 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=129322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.547285 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=129321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.547390 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=129322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.547483 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=129321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.547733 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=129322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.547843 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=129321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.548062 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=129322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.548217 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=129321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.548364 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=129322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.548501 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=129321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.548659 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=129322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.548760 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=129321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.548953 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=129322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.549108 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=129321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.549278 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=129322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.549418 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=129321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.549604 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=129322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.549744 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=129321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.549924 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=129322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.550134 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=129321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.550230 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=129322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.550328 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=129321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.550512 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=129322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.550607 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=129321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.550819 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=129322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.550922 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=129321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.551165 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=129322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.551269 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=129321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.551472 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=129322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.551590 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=129321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.551860 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=129322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.551992 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=129321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.552183 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=129321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.552292 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=129322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.552506 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=129321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.552611 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=129322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.552821 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=129321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.552931 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=129322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.553137 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=129322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.553244 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=129321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.553434 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=129321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.553606 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=129322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.553758 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=129322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.553891 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=129321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.554034 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=129322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.554173 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=129321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.554348 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=129321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.554488 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=129322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.554647 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=129322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.554782 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=129321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.554986 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=129321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.555207 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=129322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.555357 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=129322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.555502 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=129321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.555693 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=129321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.555820 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=129322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.556019 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=129321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.556140 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=129322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.556331 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=129321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.556476 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=129322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.556656 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=129321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.556792 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=129322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.556969 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=129321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.557111 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=129322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.557280 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=129321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.557418 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=129322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.557612 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=129321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.557731 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=129322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.557944 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=129321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.558077 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=129322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.558254 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=129321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.558420 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=129322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.558569 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=129321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.558744 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=129322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.558880 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=129321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.559071 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=129322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.559201 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=129321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.559387 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=129322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.559516 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=129321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.559734 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=129322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.559854 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=129321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.560048 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=129322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.560156 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=129321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.560373 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=129322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.560470 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=129321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.560682 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=129322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.560779 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=129321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.560998 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=129322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.561103 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=129321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.561323 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=129322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.561421 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=129321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.561643 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=129322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.561758 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=129321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.561953 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=129321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.562068 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=129322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.562271 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=129321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.562436 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=129322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.562580 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=129321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.562776 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=129322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.562889 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=129321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.563090 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=129322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.563191 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=129321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.563416 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=129322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.563559 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=129321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.563756 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=129322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.563925 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=129321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.564074 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=129322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.564211 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=129321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.564394 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=129322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.564531 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=129321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.564731 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=129322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.564880 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=129321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.565034 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=129321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.565169 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=129322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.565337 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=129321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.565470 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=129322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.565664 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=129321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.565816 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=129322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.565976 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=129321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.566122 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=129322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.566285 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=129321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.566431 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=129322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.566594 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=129321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.566760 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=129322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.566897 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=129322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.567048 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=129321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.567185 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=129322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.567327 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=129321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.567503 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=129322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.567687 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=129321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.567851 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=129322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.567943 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=129321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.568166 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=129321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.568257 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=129322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.568481 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=129322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.568572 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=129321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.568789 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=129321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.568886 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=129322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.569104 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=129321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.569206 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=129322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.569414 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=129321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.569514 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=129322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.569724 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=129322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.569821 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=129321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.570038 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=129322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.570128 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=129321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.570351 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=129321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.570440 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=129322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.570706 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=129321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.570899 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=129322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.571022 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=129321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.571335 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=129321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.571432 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=129322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.571697 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=129321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.571846 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=129322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.572062 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=129321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.572177 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=129322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.572321 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=129322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.572417 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=129321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.572623 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=129322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.573326 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=129321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.573326 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=129321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.573666 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=129322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.573871 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=129321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.573996 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=129322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.574113 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=129321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.574229 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=129322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.574344 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=129321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.574451 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=129322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.574566 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=129321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.574772 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=129322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.574772 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=129322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.574980 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=129321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.575094 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=129322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.575215 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=129321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.575329 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=129322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.575436 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=129321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.575595 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=129322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.575721 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=129321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.575838 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=129322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.575983 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=129321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.576107 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=129322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.576302 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=129321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.576425 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=129322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.576623 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=129322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.576744 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=129321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.576933 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=129322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.577059 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=129321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.577258 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=129322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.577431 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=129321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.577579 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=129321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.577706 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=129322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.577890 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=129321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.578012 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=129322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.578197 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=129321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.578321 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=129322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.578503 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=129321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.578625 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=129322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.578813 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=129321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.578928 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=129322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.579119 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=129321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.579216 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=129322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.579442 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=129321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.579573 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=129322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.579772 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=129321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.579910 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=129322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.580072 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=129321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.580165 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=129322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.580385 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=129321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.580486 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=129322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.580693 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=129322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.580792 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=129321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.580995 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=129321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.581120 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=129322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.581302 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=129321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.581407 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=129322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.581628 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=129321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.581948 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=129322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.582096 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=129321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.582229 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=129322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.582338 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=129321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.582522 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=129321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.582613 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=129322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.582845 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=129322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.583011 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=129321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.583157 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=129321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.583256 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=129322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.583469 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=129321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.583649 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=129322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.583802 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=129321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.583906 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=129322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.584105 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=129321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.584208 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=129322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.584446 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=129321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.584541 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=129322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.584753 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=129321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.584859 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=129322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.585082 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=129322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.585177 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=129321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.585394 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=129322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.585487 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=129321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.585703 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=129322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.585803 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=129321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.586016 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=129322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.586117 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=129321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.586369 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=129321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.586461 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=129322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.586707 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=129321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.586878 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=129322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.587019 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=129321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.587294 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=129322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.587387 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=129321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.587641 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=129322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.587826 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=129321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.587988 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=129321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.588122 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=129322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.588254 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=129321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.588347 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=129322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.588552 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=129321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.588646 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=129322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.588861 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=129322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.588998 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=129321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.589197 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=129321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.589280 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=129322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.589493 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=129322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.589592 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=129321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.589780 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=129321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.589911 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=129322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.590085 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=129321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.590185 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=129322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.590395 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=129321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.590501 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=129322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.590698 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=129321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.590830 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=129322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.591005 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=129322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.591198 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=129321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.591482 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=129322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.591614 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=129321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.591745 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=129322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.591853 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=129321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.591970 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=129322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.592075 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=129321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.592286 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=129322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.592392 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=129321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.592614 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=129321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.592750 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=129322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.592922 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=129321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.593024 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=129322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.593245 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=129321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.593337 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=129322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.593784 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=129321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.593902 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=129322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.594021 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=129321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.594153 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=129322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.594240 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=129321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.594356 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=129322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.594495 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=129321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.594584 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=129322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.594753 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=129321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.594845 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=129322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.595064 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=129321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.595164 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=129322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.595372 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=129321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.595470 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=129322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.595702 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=129321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.595809 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=129322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.596008 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=129322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.596105 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=129321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.596324 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=129322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.596416 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=129321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.596630 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=129321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.596726 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=129322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.596941 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=129321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.597041 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=129322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.597250 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=129321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.597350 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=129322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.597555 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=129321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.597645 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=129322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.597859 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=129321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.597970 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=129322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.598164 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=129322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.598254 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=129321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.598485 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=129322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.598584 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=129321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.598799 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=129322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.598905 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=129321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.599103 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=129321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.599206 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=129322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.599406 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=129322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.599502 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=129321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.599752 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=129321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.599903 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=129322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.600050 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=129321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.600146 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=129322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.600354 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=129322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.600444 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=129321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.600663 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=129321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.600753 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=129322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.600970 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=129321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.601068 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=129322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.601276 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=129321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.601366 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=129322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.601582 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=129322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.601679 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=129321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.601930 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=129321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.602090 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=129322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.602238 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=129321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.602330 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=129322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.602555 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=129321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.602651 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=129322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.602861 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=129321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.602954 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=129322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.603167 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=129322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.603273 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=129321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.603473 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=129321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.603601 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=129322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.603834 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=129321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.603975 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=129322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.604119 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=129322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.604262 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=129321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.604428 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=129322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.604519 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=129321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.604740 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=129322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.604830 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=129321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.605048 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=129322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.605152 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=129321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.605358 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=129322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.605449 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=129321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.605673 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=129322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.605776 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=129321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.605999 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=129322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.606103 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=129321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.606312 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=129321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.606402 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=129322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.606616 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=129322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.606705 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=129321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.606930 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=129321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.607033 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=129322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.607251 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=129321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.607351 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=129322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.607586 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=129321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.607681 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=129322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.607951 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=129321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.608064 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=129322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.608212 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=129321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.608312 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=129322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.608517 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=129321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.608610 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=129322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.608839 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=129321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.608938 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=129322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.609153 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=129321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.609245 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=129322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.609463 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=129322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.609552 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=129321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.609785 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=129322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.609935 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=129321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.610096 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=129321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.610236 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=129322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.610408 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=129322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.610518 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=129321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.610709 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=129321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.610823 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=129322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.611020 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=129322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.611116 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=129321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.611330 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=129322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.611439 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=129321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.611663 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=129321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.611878 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=129322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.611976 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=129321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.612253 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=129322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.612356 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=129321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.612573 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=129321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.612735 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=129322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.613003 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=129321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.613165 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=129322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.613262 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=129321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.613491 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=129321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.613599 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=129322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.613807 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=129321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.614023 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=129322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.614174 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=129321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.614365 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=129322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.614504 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=129321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.614780 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=129321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.614923 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=129322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.615153 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=129321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.615381 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=129322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.615603 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=129321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.615815 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=129321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.615976 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=129322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.616118 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=129321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.616267 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=129322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.616405 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=129321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.616506 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=129322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.616718 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=129321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.616906 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=129322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.617168 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=129321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.617300 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=129322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.618410 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=129321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.618594 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=129322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.618747 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=129321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.618747 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=129321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.619017 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=129322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.619164 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=129321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.619317 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=129322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.619483 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=129321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.619755 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=129322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.619902 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=129321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.620049 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=129322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.620207 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=129321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.620542 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=129322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.620699 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=129321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.620854 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=129322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.621009 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=129321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.621203 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=129322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.621350 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=129321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.621489 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=129322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.621593 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=129321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.621593 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=129321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.621916 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=129321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.622273 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=129321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.622585 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=129321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.622710 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=129322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.622895 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=129321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.623107 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=129322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.623209 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=129321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.623464 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=129322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.623593 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=129321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.623829 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=129322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.623967 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=129321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.624162 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=129321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.624291 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=129322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.624474 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=129321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.624591 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=129322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.624801 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=129321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.624917 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=129322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.625109 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=129321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.625214 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=129322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.625435 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=129321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.625545 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=129322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.625754 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=129322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.625861 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=129321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.626078 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=129322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.626181 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=129321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.626401 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=129322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.626501 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=129321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.626719 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=129322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.626852 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=129321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.627053 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=129322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.627180 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=129321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.627375 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=129322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.627492 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=129321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.627720 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=129322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.627955 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=129321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.628080 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=129322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.628280 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=129321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.628397 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=129322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.628607 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=129321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.628733 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=129322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.628916 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=129321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.629044 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=129322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.629247 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=129321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.629383 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=129322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.629570 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=129321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.629709 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=129322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.629885 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=129321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.630031 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=129322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.630210 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=129321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.630346 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=129322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.630652 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=129321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.630759 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=129322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.630852 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=129321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.630974 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=129322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.631137 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=129321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.631298 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=129322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.631460 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=129321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.631655 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=129322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.631817 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=129321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.631947 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=129322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.632136 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=129321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.632371 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=129322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.632519 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=129321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.632693 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=129322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.632862 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=129321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.633014 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=129322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.633232 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=129321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.633475 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=129322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.633575 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=129321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.633862 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=129321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.634024 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=129322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.634205 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=129321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.634340 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=129322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.634500 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=129321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.634654 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=129322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.634808 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=129321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.634980 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=129322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.635121 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=129321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.635298 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=129322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.635430 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=129321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.635636 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=129322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.635773 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=129321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.635951 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=129322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.636101 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=129321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.636284 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=129322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.636413 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=129321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.636599 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=129322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.636730 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=129321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.636930 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=129322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.637034 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=129321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.637349 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=129321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.637439 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=129322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.637655 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=129321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.637754 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=129322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.637962 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=129321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.638062 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=129322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.638287 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=129321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.638388 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=129322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.638595 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=129321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.638687 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=129322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.638919 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=129321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.639011 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=129322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.639234 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=129321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.639333 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=129322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.639574 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=129321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.639678 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=129322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.639904 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=129321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.639997 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=129322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.640212 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=129321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.640311 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=129322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.640535 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=129321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.640626 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=129322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.640853 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=129321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.640981 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=129322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.641160 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=129321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.641274 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=129322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.641468 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=129321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.641605 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=129322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.641778 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=129321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.641894 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=129322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.642122 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=129321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.642222 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=129322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.642428 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=129321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.642592 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=129322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.642750 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=129321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.642842 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=129322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.643079 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=129322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.643218 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=129321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.643402 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=129322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.643502 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=129321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.643742 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=129321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.643848 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=129322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.644077 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=129321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.644211 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=129322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.644475 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=129321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.644583 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=129322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.644883 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=129321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.645019 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=129322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.645209 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=129321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.645353 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=129322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.645538 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=129321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.645691 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=129322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.645845 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=129321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.646006 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=129322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.646154 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=129321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.646322 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=129322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.646467 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=129321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.646639 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=129322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.646775 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=129321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.646952 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=129322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.647090 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=129321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.647264 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=129322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.647396 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=129321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.647619 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=129322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.647717 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=129321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.647932 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=129322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.648022 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=129321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.648260 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=129322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.648364 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=129321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.648578 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=129322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.648669 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=129321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.648918 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=129322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.649080 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=129321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.649231 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=129322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.649541 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=129322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.649631 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=129321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.649869 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=129322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.649967 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=129321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.650179 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=129321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.650277 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=129322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.650489 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=129321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.650580 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=129322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.650798 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=129321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.651283 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=129322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.651455 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=129321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.651667 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=129322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.651847 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=129321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.651954 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=129322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.652136 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=129322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.652244 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=129321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.652467 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=129322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.652606 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=129321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.652789 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=129322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.652916 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=129321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.653098 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=129322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.653221 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=129321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.653410 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=129322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.653540 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=129321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.653722 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=129322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.654071 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=129322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.654387 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=129322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.654522 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=129321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.654722 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=129322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.654904 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=129321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.655056 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=129322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.655186 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=129321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.655392 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=129322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.655515 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=129321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.655736 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=129322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.655863 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=129321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.656075 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=129322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.656172 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=129321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.656410 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=129322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.656517 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=129321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.656733 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=129322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.656829 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=129321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.657063 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=129322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.657392 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=129322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.657703 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=129322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.658011 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=129322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.658330 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=129322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.658640 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=129322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.658951 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=129322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.659260 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=129322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.659602 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=129322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.659724 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=129321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.659917 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=129322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.660082 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=129321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.660227 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=129322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.660445 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=129321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.660793 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=129321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.661061 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=129322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.661227 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=129321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.661401 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=129322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.661716 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=129322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.661882 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=129321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.662039 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=129322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.662357 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=129322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.662458 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=129321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.662670 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=129322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.662774 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=129321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.662982 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=129322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.663135 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=129321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.663298 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=129322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.663453 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=129321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.663661 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=129322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.663768 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=129321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.663976 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=129322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.664096 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=129321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.664312 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=129322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.664479 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=129321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.664773 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=129321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.665095 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=129321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.665258 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=129322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.665434 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=129321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.665595 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=129322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.665748 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=129321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.665938 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=129322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.666099 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=129321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.666263 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=129322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.666430 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=129321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.666596 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=129322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.666761 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=129321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.666918 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=129322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.667073 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=129321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.667244 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=129322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.667397 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=129321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.667582 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=129322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.667735 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=129321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.667910 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=129322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.668007 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=129321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.668241 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=129322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.668403 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=129321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.668563 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=129322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.668727 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=129321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.668877 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=129322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.669032 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=129321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.669190 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=129322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.669338 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=129321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.669520 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=129322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.669676 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=129321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.669827 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=129322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.669978 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=129321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.670152 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=129322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.670300 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=129321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.670535 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=129321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.670728 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=129322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.670893 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=129321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.671072 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=129322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.671220 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=129321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.671400 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=129322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.671626 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=129321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.671875 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=129322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.672021 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=129321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.672179 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=129322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.672342 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=129321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.672559 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=129322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.672712 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=129321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.672854 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=129322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.673015 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=129321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.673156 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=129322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.673304 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=129321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.673447 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=129322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.673594 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=129321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.673734 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=129322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.673883 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=129321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.674032 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=129322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.674181 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=129321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.674339 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=129322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.674690 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=129321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.674860 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=129322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.674860 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=129322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.675311 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=129321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.675466 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=129322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.675652 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=129321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.675808 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=129322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.676043 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=129321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.676197 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=129322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.676337 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=129321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.676478 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=129322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.676627 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=129321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.676776 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=129322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.676928 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=129321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.677069 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=129322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.677225 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=129321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.677366 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=129322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.677505 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=129321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.677654 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=129322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.677809 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=129321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.677958 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=129322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.678098 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=129321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.678238 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=129322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.678385 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=129321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.678535 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=129322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.678683 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=129321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.678825 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=129322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.678986 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=129321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.679128 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=129322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.679269 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=129321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.679423 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=129321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.679581 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=129322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.679728 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=129321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.679879 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=129322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.680054 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=129321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.680218 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=129322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.680369 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=129321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.680510 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=129322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.680733 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=129322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.680900 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=129321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.681055 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=129322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.681210 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=129321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.681375 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=129322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.681532 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=129321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.681715 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=129322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.681882 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=129321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.682126 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=129322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.682286 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=129321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.682437 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=129322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.682658 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=129321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.682805 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=129322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.682946 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=129321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.683106 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=129322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.683261 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=129321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.683473 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=129322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.683668 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=129321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.683813 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=129322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.683962 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=129321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.684145 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=129322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.684303 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=129321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.684453 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=129321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.684797 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=129322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.684948 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=129321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.685106 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=129322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.685350 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=129321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.685565 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=129322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.685726 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=129321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.685872 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=129322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.686014 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=129321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.686154 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=129322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.686305 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=129321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.686446 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=129322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.686594 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=129321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.686750 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=129322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.686892 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=129321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.687041 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=129322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.687196 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=129321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.687347 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=129322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.687488 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=129321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.687677 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=129322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.687819 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=129321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.687971 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=129322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.688168 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=129321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.688322 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=129322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.688463 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=129321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.688603 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=129322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.688743 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=129321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.688894 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=129322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.689035 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=129321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.689186 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=129322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.689345 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=129321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.689345 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=129321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.689704 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=129322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.689886 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=129321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.690033 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=129322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.690033 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=129322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.690347 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=129321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.690488 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=129322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.690628 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=129321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.690628 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=129321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.690912 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=129322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.691061 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=129321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.691209 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=129322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.691359 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=129321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.691508 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=129322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.691696 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=129321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.691851 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=129322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.691851 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=129322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.692153 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=129321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.692392 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=129322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.692549 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=129321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.692773 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=129322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.692919 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=129321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.693060 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=129322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.693208 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=129321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.693362 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=129322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.693512 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=129321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.693653 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=129322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.693801 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=129321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.694076 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=129322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.694232 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=129321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.694383 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=129322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.694538 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=129321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.694899 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=129322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.695052 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=129321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.695195 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=129322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.695354 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=129321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.695597 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=129322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.695907 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=129321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.696063 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=129322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.696063 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=129322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.696334 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=129321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.696475 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=129322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.696625 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=129321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.696765 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=129322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.696904 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=129321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.697043 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=129322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.697191 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=129321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.697332 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=129322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.698105 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=129321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.698268 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=129322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.698430 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=129321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.698575 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=129322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.698716 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=129321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.698865 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=129322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.699016 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=129321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.699158 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=129322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.699298 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=129321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.699445 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=129322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.699618 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=129321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.699777 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=129322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.699928 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=129321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.700079 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=129322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.700227 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=129321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.700386 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=129322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.700528 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=129321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.700686 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=129322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.700841 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=129321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.700991 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=129322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.701131 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=129321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.701280 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=129322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.701419 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=129321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.701573 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=129322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.701723 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=129321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.701864 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=129322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.702004 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=129321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.702157 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=129322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.702299 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=129321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.702299 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=129321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.702694 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=129322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.702999 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=129321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.703158 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=129322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.703316 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=129321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.703469 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=129322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.703469 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=129322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.703823 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=129321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.703968 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=129322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.704188 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=129321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.704345 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=129322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.704507 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=129321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.704657 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=129322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.704825 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=129321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.705167 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=129322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.705311 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=129321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.705452 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=129322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.705686 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=129321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.705686 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=129321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.706097 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=129322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.706255 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=129321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.706398 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=129322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.706546 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=129321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.706787 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=129322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.706933 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=129321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.707073 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=129322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.707215 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=129321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.707390 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=129322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.707560 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=129321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.707720 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=129322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.707963 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=129321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.708120 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=129322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.708264 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=129321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.708405 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=129322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.708405 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=129322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.708689 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=129321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.708849 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=129322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.709008 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=129321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.709150 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=129322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.709299 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=129321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.709453 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=129322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.709594 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=129321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.709735 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=129322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.709874 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=129321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.710022 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=129322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.710177 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=129321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.710326 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=129322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.710475 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=129321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.710637 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=129322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.710787 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=129321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.710955 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=129322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.711183 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=129321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.711432 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=129322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.711663 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=129321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.711811 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=129322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.711953 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=129321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.712103 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=129322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.712255 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=129321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.712406 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=129322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.712567 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=129321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.712821 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=129322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.712977 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=129321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.713133 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=129322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.713283 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=129321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.713424 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=129322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.713563 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=129321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.713712 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=129322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.713853 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=129321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.714002 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=129322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.714002 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=129322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.714365 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=129321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.714550 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=129322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.714701 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=129321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.714863 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=129322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.715226 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=129321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.715378 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=129322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.715519 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=129321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.715710 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=129322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.715921 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=129321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.716084 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=129322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.716316 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=129321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.716471 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=129322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.716622 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=129321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.716771 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=129322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.716912 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=129321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.716912 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=129321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.717208 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=129322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.717358 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=129321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.717507 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=129322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.717647 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=129321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.717788 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=129322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.717941 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=129321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.718083 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=129322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.718224 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=129321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.718373 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=129322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.718524 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=129321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.718665 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=129322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.718815 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=129321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.718974 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=129322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.719117 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=129321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.719257 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=129322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.719406 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=129321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.719627 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=129322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.719776 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=129321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.719929 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=129322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.720070 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=129321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.720211 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=129322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.720358 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=129321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.720358 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=129321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.720655 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=129322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.720803 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=129321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.720956 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=129322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.721105 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=129321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.721253 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=129322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.721409 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=129321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.721550 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=129322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.721690 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=129321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.721830 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=129322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.721979 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=129321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.722133 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=129322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.722274 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=129321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.722423 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=129322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.722572 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=129321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.722724 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=129322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.722965 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=129321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.723126 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=129322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.723282 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=129321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.723430 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=129322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.723599 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=129321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.723762 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=129322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.723762 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=129322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.724040 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=129321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.724182 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=129322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.724322 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=129321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.724545 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=129322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.724700 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=129321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.724853 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=129322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.725007 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=129321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.725347 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=129322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.725498 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=129321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.725640 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=129322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.725782 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=129321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.725956 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=129322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.726162 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=129321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.726324 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=129322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.726324 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=129322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.726664 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=129321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.726805 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=129322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.727126 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=129321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.727837 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=129322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.728001 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=129321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.728147 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=129322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.728288 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=129321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.728429 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=129322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.728584 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=129321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.728729 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=129322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.728868 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=129321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.729017 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=129322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.729159 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=129321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.729300 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=129322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.729449 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=129321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.729604 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=129322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.729756 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=129321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.729898 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=129322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.730047 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=129321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.730047 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=129321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.730327 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=129322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.730468 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=129321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.730608 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=129322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.730748 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=129321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.730901 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=129322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.731062 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=129321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.731212 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=129322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.731361 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=129321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.731513 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=129322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.731737 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=129321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.731888 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=129322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.732038 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=129321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.732181 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=129322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.732321 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=129321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.732468 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=129322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.732609 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=129321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.732764 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=129322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.732905 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=129321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.733163 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=129322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.733163 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=129322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.733460 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=129321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.733610 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=129322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.733771 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=129321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.733921 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=129322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.734061 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=129321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.734202 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=129322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.734342 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=129321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.734481 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=129322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.734718 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=129321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.734873 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=129322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.735022 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=129321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.735172 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=129322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.735172 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=129322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.735719 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=129321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.735873 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=129322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.736014 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=129321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.736014 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=129321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.741616 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=129322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.741774 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=129321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.742010 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=129322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.742417 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=129321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.743650 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=129322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.743822 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=129321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 26 12:37:18.743987 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=129322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.743987 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=129322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.743987 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=129322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.743987 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=129322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.743987 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=129322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.743987 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=129322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.743987 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=129322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.743987 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=129322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.745126 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=129322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.745126 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=129322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.745126 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=129322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.745126 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=129322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.745126 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=129322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.745126 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=129322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.745126 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=129322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.745126 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=129322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.748475 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=129322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.748475 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=129322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.748475 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=129322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.748475 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=129322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.748475 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=129322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.748475 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=129322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.748475 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=129322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.748475 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=129322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:18.749598 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=129322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 26 12:37:18.804076 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: INFO dbcounter [None req-e0c6eecf-c296-4490-bd1a-cac0a0acda18 None None] Registered counter for database nova_api May 26 12:37:18.805934 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: INFO dbcounter [None req-b911da83-a442-4da9-bff1-8711d7bb9bbd None None] Registered counter for database nova_api May 26 12:37:18.826315 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_db.sqlalchemy.engines [None req-e0c6eecf-c296-4490-bd1a-cac0a0acda18 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129321) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 26 12:37:18.827844 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_db.sqlalchemy.engines [None req-b911da83-a442-4da9-bff1-8711d7bb9bbd None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129322) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 26 12:37:18.835596 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG dbcounter [-] [129322] Writer thread running {{(pid=129322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 26 12:37:18.837304 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG dbcounter [-] [129321] Writer thread running {{(pid=129321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 26 12:37:18.897813 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.context [None req-b911da83-a442-4da9-bff1-8711d7bb9bbd None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),20e2b1f2-33d6-4e23-a875-4a2cebf4cec0(cell1) {{(pid=129322) load_cells /opt/stack/nova/nova/context.py:464}} May 26 12:37:18.900411 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.context [None req-e0c6eecf-c296-4490-bd1a-cac0a0acda18 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),20e2b1f2-33d6-4e23-a875-4a2cebf4cec0(cell1) {{(pid=129321) load_cells /opt/stack/nova/nova/context.py:464}} May 26 12:37:18.902678 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-b911da83-a442-4da9-bff1-8711d7bb9bbd None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:37:18.904277 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-b911da83-a442-4da9-bff1-8711d7bb9bbd None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:37:18.904927 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-e0c6eecf-c296-4490-bd1a-cac0a0acda18 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:37:18.905071 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-b911da83-a442-4da9-bff1-8711d7bb9bbd None None] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:37:18.906500 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-e0c6eecf-c296-4490-bd1a-cac0a0acda18 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:37:18.907131 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-b911da83-a442-4da9-bff1-8711d7bb9bbd None None] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:37:18.907304 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-e0c6eecf-c296-4490-bd1a-cac0a0acda18 None None] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:37:18.909330 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: INFO dbcounter [None req-b911da83-a442-4da9-bff1-8711d7bb9bbd None None] Registered counter for database nova_cell0 May 26 12:37:18.909443 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-e0c6eecf-c296-4490-bd1a-cac0a0acda18 None None] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:37:18.911350 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: INFO dbcounter [None req-e0c6eecf-c296-4490-bd1a-cac0a0acda18 None None] Registered counter for database nova_cell0 May 26 12:37:18.913414 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: INFO dbcounter [None req-b911da83-a442-4da9-bff1-8711d7bb9bbd None None] Registered counter for database nova_cell1 May 26 12:37:18.915552 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: INFO dbcounter [None req-e0c6eecf-c296-4490-bd1a-cac0a0acda18 None None] Registered counter for database nova_cell1 May 26 12:37:18.921475 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_db.sqlalchemy.engines [None req-b911da83-a442-4da9-bff1-8711d7bb9bbd None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129322) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 26 12:37:18.924113 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_db.sqlalchemy.engines [None req-b911da83-a442-4da9-bff1-8711d7bb9bbd None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129322) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 26 12:37:18.925219 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_db.sqlalchemy.engines [None req-e0c6eecf-c296-4490-bd1a-cac0a0acda18 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129321) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 26 12:37:18.927183 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG dbcounter [-] [129322] Writer thread running {{(pid=129322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 26 12:37:18.927388 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_db.sqlalchemy.engines [None req-e0c6eecf-c296-4490-bd1a-cac0a0acda18 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129321) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 26 12:37:18.932765 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG dbcounter [-] [129321] Writer thread running {{(pid=129321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 26 12:37:18.935311 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG dbcounter [-] [129321] Writer thread running {{(pid=129321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 26 12:37:19.066164 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG dbcounter [-] [129322] Writer thread running {{(pid=129322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 26 12:37:19.075053 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: INFO dbcounter [None req-b911da83-a442-4da9-bff1-8711d7bb9bbd None None] Registered counter for database nova_cell0 May 26 12:37:19.081040 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: INFO dbcounter [None req-e0c6eecf-c296-4490-bd1a-cac0a0acda18 None None] Registered counter for database nova_cell0 May 26 12:37:19.082073 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_db.sqlalchemy.engines [None req-b911da83-a442-4da9-bff1-8711d7bb9bbd None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129322) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 26 12:37:19.086819 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG dbcounter [-] [129322] Writer thread running {{(pid=129322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 26 12:37:19.088074 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_db.sqlalchemy.engines [None req-e0c6eecf-c296-4490-bd1a-cac0a0acda18 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129321) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 26 12:37:19.092733 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG dbcounter [-] [129321] Writer thread running {{(pid=129321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 26 12:37:19.397079 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: WARNING keystonemiddleware.auth_token [None req-b911da83-a442-4da9-bff1-8711d7bb9bbd None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 26 12:37:19.405004 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: WARNING keystonemiddleware.auth_token [None req-b911da83-a442-4da9-bff1-8711d7bb9bbd None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 26 12:37:19.407481 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: WARNING keystonemiddleware.auth_token [None req-e0c6eecf-c296-4490-bd1a-cac0a0acda18 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 26 12:37:19.415145 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: WARNING keystonemiddleware.auth_token [None req-e0c6eecf-c296-4490-bd1a-cac0a0acda18 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 26 12:37:19.761349 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: WARNING keystonemiddleware.auth_token [None req-b911da83-a442-4da9-bff1-8711d7bb9bbd None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 26 12:37:19.765261 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: WARNING keystonemiddleware.auth_token [None req-e0c6eecf-c296-4490-bd1a-cac0a0acda18 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 26 12:37:19.767494 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: WARNING keystonemiddleware.auth_token [None req-b911da83-a442-4da9-bff1-8711d7bb9bbd None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 26 12:37:19.771825 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: WARNING keystonemiddleware.auth_token [None req-e0c6eecf-c296-4490-bd1a-cac0a0acda18 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 26 12:37:19.772905 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55ffda79e9c0 pid: 129322 (default app) May 26 12:37:19.778333 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55ffda79e9c0 pid: 129321 (default app) May 26 12:38:01.543499 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG dbcounter [-] [129322] Writing DB stats nova_api:SELECT=3 {{(pid=129322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:38:01.546226 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG dbcounter [-] [129322] Writing DB stats nova_cell0:SELECT=3 {{(pid=129322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:38:01.550540 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG dbcounter [-] [129322] Writing DB stats nova_cell1:SELECT=3 {{(pid=129322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:38:01.551927 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG dbcounter [-] [129322] Writing DB stats nova_cell0:SELECT=3 {{(pid=129322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:38:01.636189 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG dbcounter [-] [129321] Writing DB stats nova_api:SELECT=3 {{(pid=129321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:38:01.637371 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG dbcounter [-] [129321] Writing DB stats nova_cell1:SELECT=3 {{(pid=129321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:38:01.639180 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG dbcounter [-] [129321] Writing DB stats nova_cell0:SELECT=3 {{(pid=129321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:38:01.640119 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG dbcounter [-] [129321] Writing DB stats nova_cell0:SELECT=3 {{(pid=129321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:38:02.890972 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi [None req-a6175736-9c18-405c-b66b-6a39b1431373 tempest-VolumesSnapshotsTestJSON-1240189566 tempest-VolumesSnapshotsTestJSON-1240189566-project] Action: 'create', calling method: .version_select at 0x7f830a093ca0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-49357380"}} {{(pid=129321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 12:38:03.182219 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi [None req-5eaa0b49-9456-406f-8f32-5b6b995ecfd3 tempest-VolumesGetTestJSON-1862159702 tempest-VolumesGetTestJSON-1862159702-project] Action: 'create', calling method: .version_select at 0x7f830a094d30>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-194587241", "metadata": {"Type": "work"}}} {{(pid=129322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 12:38:04.673581 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: INFO nova.api.openstack.requestlog [None req-a6175736-9c18-405c-b66b-6a39b1431373 tempest-VolumesSnapshotsTestJSON-1240189566 tempest-VolumesSnapshotsTestJSON-1240189566-project] 10.222.0.75 "POST /compute/v2.1/os-volumes" status: 200 len: 343 microversion: 2.1 time: 3.055049 May 26 12:38:04.684339 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: [pid: 129321|app: 0|req: 1/1] 10.222.0.75 () {60 vars in 1154 bytes} [Thu May 26 12:38:01 2022] POST /compute/v2.1/os-volumes => generated 343 bytes in 3068 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) May 26 12:38:04.693896 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi [None req-b8dd85d3-e5be-464a-b4d0-0380981a5090 tempest-VolumesSnapshotsTestJSON-1240189566 tempest-VolumesSnapshotsTestJSON-1240189566-project] Calling method '.version_select at 0x7f8309ee7c10>' {{(pid=129321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:38:04.958818 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: INFO nova.api.openstack.requestlog [None req-b8dd85d3-e5be-464a-b4d0-0380981a5090 tempest-VolumesSnapshotsTestJSON-1240189566 tempest-VolumesSnapshotsTestJSON-1240189566-project] 10.222.0.75 "GET /compute/v2.1/os-volumes/869ac730-f46c-427e-b24f-30760cc63c92" status: 200 len: 343 microversion: 2.1 time: 0.272449 May 26 12:38:04.964981 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: [pid: 129321|app: 0|req: 2/2] 10.222.0.75 () {58 vars in 1244 bytes} [Thu May 26 12:38:04 2022] GET /compute/v2.1/os-volumes/869ac730-f46c-427e-b24f-30760cc63c92 => generated 343 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 12:38:05.057744 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: INFO nova.api.openstack.requestlog [None req-5eaa0b49-9456-406f-8f32-5b6b995ecfd3 tempest-VolumesGetTestJSON-1862159702 tempest-VolumesGetTestJSON-1862159702-project] 10.222.0.75 "POST /compute/v2.1/os-volumes" status: 200 len: 352 microversion: 2.1 time: 3.538959 May 26 12:38:05.058400 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: [pid: 129322|app: 0|req: 1/3] 10.222.0.75 () {60 vars in 1155 bytes} [Thu May 26 12:38:01 2022] POST /compute/v2.1/os-volumes => generated 352 bytes in 3543 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) May 26 12:38:05.071519 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi [None req-c58210e5-2a92-475c-b8fe-477e0621b016 tempest-VolumesGetTestJSON-1862159702 tempest-VolumesGetTestJSON-1862159702-project] Calling method '.version_select at 0x7f8309ee7dc0>' {{(pid=129321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:38:05.181929 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: INFO nova.api.openstack.requestlog [None req-c58210e5-2a92-475c-b8fe-477e0621b016 tempest-VolumesGetTestJSON-1862159702 tempest-VolumesGetTestJSON-1862159702-project] 10.222.0.75 "GET /compute/v2.1/os-volumes/dd012d67-80f8-4682-9f76-13b60e8bab1d" status: 200 len: 352 microversion: 2.1 time: 0.115102 May 26 12:38:05.182919 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: [pid: 129321|app: 0|req: 3/4] 10.222.0.75 () {58 vars in 1244 bytes} [Thu May 26 12:38:05 2022] GET /compute/v2.1/os-volumes/dd012d67-80f8-4682-9f76-13b60e8bab1d => generated 352 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 12:38:05.270600 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi [None req-31185380-18bc-489a-9386-3b9e91eaabf1 tempest-DeleteServersTestJSON-342872481 tempest-DeleteServersTestJSON-342872481-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1603546142", "imageRef": "1e3c323d-d797-4e6d-bd9a-482d90084b0c", "flavorRef": "452", "networks": [{"uuid": "8147ad3a-09f5-453d-b0b3-20549e58318b"}]}} {{(pid=129322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 12:38:05.459561 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.network.neutron [None req-31185380-18bc-489a-9386-3b9e91eaabf1 tempest-DeleteServersTestJSON-342872481 tempest-DeleteServersTestJSON-342872481-project] validate_networks() for [('8147ad3a-09f5-453d-b0b3-20549e58318b', None, None, None, None, None)] {{(pid=129322) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 26 12:38:05.974108 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi [None req-1a565ee7-5cfd-4e0c-9015-c960a5f4ff05 tempest-VolumesSnapshotsTestJSON-1240189566 tempest-VolumesSnapshotsTestJSON-1240189566-project] Calling method '.version_select at 0x7f8309efd430>' {{(pid=129321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:38:06.062557 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: INFO nova.api.openstack.requestlog [None req-1a565ee7-5cfd-4e0c-9015-c960a5f4ff05 tempest-VolumesSnapshotsTestJSON-1240189566 tempest-VolumesSnapshotsTestJSON-1240189566-project] 10.222.0.75 "GET /compute/v2.1/os-volumes/869ac730-f46c-427e-b24f-30760cc63c92" status: 200 len: 344 microversion: 2.1 time: 0.092639 May 26 12:38:06.070259 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: [pid: 129321|app: 0|req: 4/5] 10.222.0.75 () {58 vars in 1244 bytes} [Thu May 26 12:38:05 2022] GET /compute/v2.1/os-volumes/869ac730-f46c-427e-b24f-30760cc63c92 => generated 344 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 12:38:06.075635 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi [None req-d1fb48c2-34a7-418d-83d6-e6f3974f6cba tempest-VolumesTestJSON-2014170337 tempest-VolumesTestJSON-2014170337-project] Calling method '.version_select at 0x7f8309efdaf0>' {{(pid=129321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:38:06.207167 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: INFO nova.api.openstack.requestlog [None req-d1fb48c2-34a7-418d-83d6-e6f3974f6cba tempest-VolumesTestJSON-2014170337 tempest-VolumesTestJSON-2014170337-project] 10.222.0.75 "GET /compute/v2.1/os-volumes/cf6d16f6-ff8b-4c35-8d80-67fa098d5234" status: 200 len: 351 microversion: 2.1 time: 0.135628 May 26 12:38:06.208214 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: [pid: 129321|app: 0|req: 5/6] 10.222.0.75 () {58 vars in 1244 bytes} [Thu May 26 12:38:06 2022] GET /compute/v2.1/os-volumes/cf6d16f6-ff8b-4c35-8d80-67fa098d5234 => generated 351 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 12:38:06.214516 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi [None req-3bda61e1-5971-457c-8324-8145f1ff50b4 tempest-VolumesSnapshotsTestJSON-1240189566 tempest-VolumesSnapshotsTestJSON-1240189566-project] Action: 'create', calling method: .version_select at 0x7f8309efdca0>, body: {"snapshot": {"volume_id": "869ac730-f46c-427e-b24f-30760cc63c92", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-557971726"}} {{(pid=129321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 12:38:06.638381 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: INFO nova.api.openstack.requestlog [None req-3bda61e1-5971-457c-8324-8145f1ff50b4 tempest-VolumesSnapshotsTestJSON-1240189566 tempest-VolumesSnapshotsTestJSON-1240189566-project] 10.222.0.75 "POST /compute/v2.1/os-snapshots" status: 200 len: 286 microversion: 2.1 time: 0.428871 May 26 12:38:06.638976 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: [pid: 129321|app: 0|req: 6/7] 10.222.0.75 () {60 vars in 1161 bytes} [Thu May 26 12:38:06 2022] POST /compute/v2.1/os-snapshots => generated 286 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 12:38:06.647923 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi [None req-16179992-2dc8-4787-92c7-43f58be031a0 tempest-VolumesGetTestJSON-1862159702 tempest-VolumesGetTestJSON-1862159702-project] Calling method '.version_select at 0x7f8309ee7a60>' {{(pid=129321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:38:06.815677 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: INFO nova.api.openstack.requestlog [None req-16179992-2dc8-4787-92c7-43f58be031a0 tempest-VolumesGetTestJSON-1862159702 tempest-VolumesGetTestJSON-1862159702-project] 10.222.0.75 "GET /compute/v2.1/os-volumes/dd012d67-80f8-4682-9f76-13b60e8bab1d" status: 200 len: 353 microversion: 2.1 time: 0.175215 May 26 12:38:06.816677 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: [pid: 129321|app: 0|req: 7/8] 10.222.0.75 () {58 vars in 1244 bytes} [Thu May 26 12:38:06 2022] GET /compute/v2.1/os-volumes/dd012d67-80f8-4682-9f76-13b60e8bab1d => generated 353 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 12:38:06.828271 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi [None req-8dbaa79b-ea59-4f77-b095-e1eb40d4e581 tempest-VolumesSnapshotsTestJSON-1240189566 tempest-VolumesSnapshotsTestJSON-1240189566-project] Calling method '.version_select at 0x7f8309f0a160>' {{(pid=129321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:38:06.955575 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.virt.hardware [None req-31185380-18bc-489a-9386-3b9e91eaabf1 tempest-DeleteServersTestJSON-342872481 tempest-DeleteServersTestJSON-342872481-project] Flavor limits 0:0:0 {{(pid=129322) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 26 12:38:06.956662 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.virt.hardware [None req-31185380-18bc-489a-9386-3b9e91eaabf1 tempest-DeleteServersTestJSON-342872481 tempest-DeleteServersTestJSON-342872481-project] Image limits 0:0:0 {{(pid=129322) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 26 12:38:06.957792 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.virt.hardware [None req-31185380-18bc-489a-9386-3b9e91eaabf1 tempest-DeleteServersTestJSON-342872481 tempest-DeleteServersTestJSON-342872481-project] Flavor pref 0:0:0 {{(pid=129322) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 26 12:38:06.958274 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.virt.hardware [None req-31185380-18bc-489a-9386-3b9e91eaabf1 tempest-DeleteServersTestJSON-342872481 tempest-DeleteServersTestJSON-342872481-project] Image pref 0:0:0 {{(pid=129322) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 26 12:38:06.958774 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.virt.hardware [None req-31185380-18bc-489a-9386-3b9e91eaabf1 tempest-DeleteServersTestJSON-342872481 tempest-DeleteServersTestJSON-342872481-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129322) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 26 12:38:06.985394 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: INFO nova.api.openstack.requestlog [None req-8dbaa79b-ea59-4f77-b095-e1eb40d4e581 tempest-VolumesSnapshotsTestJSON-1240189566 tempest-VolumesSnapshotsTestJSON-1240189566-project] 10.222.0.75 "GET /compute/v2.1/os-snapshots/e9ba4444-4370-4210-b047-22a33bcc3a4d" status: 200 len: 286 microversion: 2.1 time: 0.166932 May 26 12:38:06.987091 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: [pid: 129321|app: 0|req: 8/9] 10.222.0.75 () {58 vars in 1250 bytes} [Thu May 26 12:38:06 2022] GET /compute/v2.1/os-snapshots/e9ba4444-4370-4210-b047-22a33bcc3a4d => generated 286 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 12:38:06.993597 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi [None req-e0920013-6ff3-40aa-8392-0dc02af1acde tempest-VolumesGetTestJSON-1862159702 tempest-VolumesGetTestJSON-1862159702-project] Calling method '.version_select at 0x7f8309ee7af0>' {{(pid=129321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:38:06.997457 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-31185380-18bc-489a-9386-3b9e91eaabf1 tempest-DeleteServersTestJSON-342872481 tempest-DeleteServersTestJSON-342872481-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:38:06.997921 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-31185380-18bc-489a-9386-3b9e91eaabf1 tempest-DeleteServersTestJSON-342872481 tempest-DeleteServersTestJSON-342872481-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:38:07.000290 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-31185380-18bc-489a-9386-3b9e91eaabf1 tempest-DeleteServersTestJSON-342872481 tempest-DeleteServersTestJSON-342872481-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:38:07.000879 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-31185380-18bc-489a-9386-3b9e91eaabf1 tempest-DeleteServersTestJSON-342872481 tempest-DeleteServersTestJSON-342872481-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:38:07.086398 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.quota [None req-31185380-18bc-489a-9386-3b9e91eaabf1 tempest-DeleteServersTestJSON-342872481 tempest-DeleteServersTestJSON-342872481-project] Getting quotas for project f0f340fa7ff24ca899b0f1036d0e6a3b. Resources: {'instances', 'cores', 'ram'} {{(pid=129322) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 26 12:38:07.103000 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.quota [None req-31185380-18bc-489a-9386-3b9e91eaabf1 tempest-DeleteServersTestJSON-342872481 tempest-DeleteServersTestJSON-342872481-project] Getting quotas for user 5d19942e971b4d7fac3ab8f9a5ad6086 and project f0f340fa7ff24ca899b0f1036d0e6a3b. Resources: {'instances', 'cores', 'ram'} {{(pid=129322) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 26 12:38:07.136279 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.compute.api [None req-31185380-18bc-489a-9386-3b9e91eaabf1 tempest-DeleteServersTestJSON-342872481 tempest-DeleteServersTestJSON-342872481-project] Going to run 1 instances... {{(pid=129322) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 26 12:38:07.139357 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.compute.api [None req-31185380-18bc-489a-9386-3b9e91eaabf1 tempest-DeleteServersTestJSON-342872481 tempest-DeleteServersTestJSON-342872481-project] [instance: 10054724-aefc-4a9f-a212-14e5fc5a1672] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1e3c323d-d797-4e6d-bd9a-482d90084b0c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129322) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 26 12:38:07.145025 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: INFO nova.api.openstack.requestlog [None req-e0920013-6ff3-40aa-8392-0dc02af1acde tempest-VolumesGetTestJSON-1862159702 tempest-VolumesGetTestJSON-1862159702-project] 10.222.0.75 "GET /compute/v2.1/os-volumes/dd012d67-80f8-4682-9f76-13b60e8bab1d" status: 200 len: 353 microversion: 2.1 time: 0.156465 May 26 12:38:07.146224 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: [pid: 129321|app: 0|req: 9/10] 10.222.0.75 () {58 vars in 1244 bytes} [Thu May 26 12:38:06 2022] GET /compute/v2.1/os-volumes/dd012d67-80f8-4682-9f76-13b60e8bab1d => generated 353 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 12:38:07.151930 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi [None req-352bd394-bcbe-42ce-a413-fd5c69f70eaf tempest-VolumesSnapshotsTestJSON-1240189566 tempest-VolumesSnapshotsTestJSON-1240189566-project] Calling method '.version_select at 0x7f8309efd4c0>' {{(pid=129321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:38:07.252727 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: INFO nova.api.openstack.requestlog [None req-352bd394-bcbe-42ce-a413-fd5c69f70eaf tempest-VolumesSnapshotsTestJSON-1240189566 tempest-VolumesSnapshotsTestJSON-1240189566-project] 10.222.0.75 "GET /compute/v2.1/os-snapshots" status: 200 len: 289 microversion: 2.1 time: 0.105260 May 26 12:38:07.253981 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: [pid: 129321|app: 0|req: 10/11] 10.222.0.75 () {58 vars in 1139 bytes} [Thu May 26 12:38:07 2022] GET /compute/v2.1/os-snapshots => generated 289 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 12:38:07.260214 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi [None req-dbf9eb46-4512-42c7-96a0-d0738b14396f tempest-VolumesGetTestJSON-1862159702 tempest-VolumesGetTestJSON-1862159702-project] Calling method '.version_select at 0x7f8309f0a4c0>' {{(pid=129321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:38:07.292160 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: INFO nova.api.openstack.requestlog [None req-31185380-18bc-489a-9386-3b9e91eaabf1 tempest-DeleteServersTestJSON-342872481 tempest-DeleteServersTestJSON-342872481-project] 10.222.0.75 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.188407 May 26 12:38:07.294065 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: [pid: 129322|app: 0|req: 2/12] 10.222.0.75 () {60 vars in 1146 bytes} [Thu May 26 12:38:05 2022] POST /compute/v2.1/servers => generated 380 bytes in 2191 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 26 12:38:07.301325 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi [None req-92d78fb3-37ae-41de-b406-1ae83d47c377 tempest-VolumesSnapshotsTestJSON-1240189566 tempest-VolumesSnapshotsTestJSON-1240189566-project] Calling method '.version_select at 0x7f83095fd790>' {{(pid=129322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:38:07.559228 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: INFO nova.api.openstack.requestlog [None req-dbf9eb46-4512-42c7-96a0-d0738b14396f tempest-VolumesGetTestJSON-1862159702 tempest-VolumesGetTestJSON-1862159702-project] 10.222.0.75 "DELETE /compute/v2.1/os-volumes/dd012d67-80f8-4682-9f76-13b60e8bab1d" status: 202 len: 0 microversion: 2.1 time: 0.303971 May 26 12:38:07.563461 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: [pid: 129321|app: 0|req: 11/13] 10.222.0.75 () {58 vars in 1247 bytes} [Thu May 26 12:38:07 2022] DELETE /compute/v2.1/os-volumes/dd012d67-80f8-4682-9f76-13b60e8bab1d => generated 0 bytes in 309 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 26 12:38:07.568341 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi [None req-6695e2cc-dbef-4352-92c6-f260ae5a2343 tempest-DeleteServersTestJSON-342872481 tempest-DeleteServersTestJSON-342872481-project] Calling method '>' {{(pid=129321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:38:07.569364 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.compute.api [None req-6695e2cc-dbef-4352-92c6-f260ae5a2343 tempest-DeleteServersTestJSON-342872481 tempest-DeleteServersTestJSON-342872481-project] [instance: 10054724-aefc-4a9f-a212-14e5fc5a1672] Fetching instance by UUID {{(pid=129321) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:38:07.670920 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: INFO nova.api.openstack.requestlog [None req-92d78fb3-37ae-41de-b406-1ae83d47c377 tempest-VolumesSnapshotsTestJSON-1240189566 tempest-VolumesSnapshotsTestJSON-1240189566-project] 10.222.0.75 "GET /compute/v2.1/os-snapshots/e9ba4444-4370-4210-b047-22a33bcc3a4d" status: 200 len: 286 microversion: 2.1 time: 0.375489 May 26 12:38:07.671736 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: [pid: 129322|app: 0|req: 3/14] 10.222.0.75 () {58 vars in 1250 bytes} [Thu May 26 12:38:07 2022] GET /compute/v2.1/os-snapshots/e9ba4444-4370-4210-b047-22a33bcc3a4d => generated 286 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 12:38:07.676816 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi [None req-f287bba8-9527-4ceb-9ad2-8c8f2f212e25 tempest-VolumesGetTestJSON-1862159702 tempest-VolumesGetTestJSON-1862159702-project] Calling method '.version_select at 0x7f83095fda60>' {{(pid=129322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:38:07.809092 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: INFO nova.api.openstack.requestlog [None req-f287bba8-9527-4ceb-9ad2-8c8f2f212e25 tempest-VolumesGetTestJSON-1862159702 tempest-VolumesGetTestJSON-1862159702-project] 10.222.0.75 "GET /compute/v2.1/os-volumes/dd012d67-80f8-4682-9f76-13b60e8bab1d" status: 200 len: 352 microversion: 2.1 time: 0.136060 May 26 12:38:07.810650 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: [pid: 129322|app: 0|req: 4/15] 10.222.0.75 () {58 vars in 1244 bytes} [Thu May 26 12:38:07 2022] GET /compute/v2.1/os-volumes/dd012d67-80f8-4682-9f76-13b60e8bab1d => generated 352 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 12:38:07.892683 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.policy [None req-6695e2cc-dbef-4352-92c6-f260ae5a2343 tempest-DeleteServersTestJSON-342872481 tempest-DeleteServersTestJSON-342872481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d19942e971b4d7fac3ab8f9a5ad6086', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0f340fa7ff24ca899b0f1036d0e6a3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129321) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:38:07.916906 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: INFO nova.api.openstack.requestlog [None req-6695e2cc-dbef-4352-92c6-f260ae5a2343 tempest-DeleteServersTestJSON-342872481 tempest-DeleteServersTestJSON-342872481-project] 10.222.0.75 "GET /compute/v2.1/servers/10054724-aefc-4a9f-a212-14e5fc5a1672" status: 200 len: 1215 microversion: 2.1 time: 0.352266 May 26 12:38:07.920226 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: [pid: 129321|app: 0|req: 12/16] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 26 12:38:07 2022] GET /compute/v2.1/servers/10054724-aefc-4a9f-a212-14e5fc5a1672 => generated 1215 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:38:08.685485 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi [None req-768c1753-f575-4d7d-8206-686049f1cd81 tempest-VolumesSnapshotsTestJSON-1240189566 tempest-VolumesSnapshotsTestJSON-1240189566-project] Calling method '.version_select at 0x7f83095fd3a0>' {{(pid=129322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:38:08.822835 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi [None req-a5140c5b-2432-4424-a972-7a3f96124d04 tempest-VolumesGetTestJSON-1862159702 tempest-VolumesGetTestJSON-1862159702-project] Calling method '.version_select at 0x7f8309ebc0d0>' {{(pid=129321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:38:08.863817 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: INFO nova.api.openstack.requestlog [None req-768c1753-f575-4d7d-8206-686049f1cd81 tempest-VolumesSnapshotsTestJSON-1240189566 tempest-VolumesSnapshotsTestJSON-1240189566-project] 10.222.0.75 "GET /compute/v2.1/os-snapshots/e9ba4444-4370-4210-b047-22a33bcc3a4d" status: 200 len: 286 microversion: 2.1 time: 0.184736 May 26 12:38:08.864400 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: [pid: 129322|app: 0|req: 5/17] 10.222.0.75 () {58 vars in 1250 bytes} [Thu May 26 12:38:08 2022] GET /compute/v2.1/os-snapshots/e9ba4444-4370-4210-b047-22a33bcc3a4d => generated 286 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 12:38:08.948368 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi [None req-107a21b9-edfb-4b6a-b7d9-78a5cccac0ef tempest-DeleteServersTestJSON-342872481 tempest-DeleteServersTestJSON-342872481-project] Calling method '>' {{(pid=129322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:38:08.950734 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.compute.api [None req-107a21b9-edfb-4b6a-b7d9-78a5cccac0ef tempest-DeleteServersTestJSON-342872481 tempest-DeleteServersTestJSON-342872481-project] [instance: 10054724-aefc-4a9f-a212-14e5fc5a1672] Fetching instance by UUID {{(pid=129322) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:38:08.970269 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: INFO nova.api.openstack.requestlog [None req-a5140c5b-2432-4424-a972-7a3f96124d04 tempest-VolumesGetTestJSON-1862159702 tempest-VolumesGetTestJSON-1862159702-project] 10.222.0.75 "GET /compute/v2.1/os-volumes/dd012d67-80f8-4682-9f76-13b60e8bab1d" status: 200 len: 352 microversion: 2.1 time: 0.151707 May 26 12:38:08.971104 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: [pid: 129321|app: 0|req: 13/18] 10.222.0.75 () {58 vars in 1244 bytes} [Thu May 26 12:38:08 2022] GET /compute/v2.1/os-volumes/dd012d67-80f8-4682-9f76-13b60e8bab1d => generated 352 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 12:38:09.210324 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.policy [None req-107a21b9-edfb-4b6a-b7d9-78a5cccac0ef tempest-DeleteServersTestJSON-342872481 tempest-DeleteServersTestJSON-342872481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d19942e971b4d7fac3ab8f9a5ad6086', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0f340fa7ff24ca899b0f1036d0e6a3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129322) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:38:09.246024 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: INFO nova.api.openstack.requestlog [None req-107a21b9-edfb-4b6a-b7d9-78a5cccac0ef tempest-DeleteServersTestJSON-342872481 tempest-DeleteServersTestJSON-342872481-project] 10.222.0.75 "GET /compute/v2.1/servers/10054724-aefc-4a9f-a212-14e5fc5a1672" status: 200 len: 1215 microversion: 2.1 time: 0.312866 May 26 12:38:09.259894 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: [pid: 129322|app: 0|req: 6/19] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 26 12:38:08 2022] GET /compute/v2.1/servers/10054724-aefc-4a9f-a212-14e5fc5a1672 => generated 1215 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 12:38:09.876530 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi [None req-9f728c2d-da29-417a-8acf-be91e4e21ee0 tempest-VolumesSnapshotsTestJSON-1240189566 tempest-VolumesSnapshotsTestJSON-1240189566-project] Calling method '.version_select at 0x7f8309ec78b0>' {{(pid=129321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:38:09.960932 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: INFO nova.api.openstack.requestlog [None req-9f728c2d-da29-417a-8acf-be91e4e21ee0 tempest-VolumesSnapshotsTestJSON-1240189566 tempest-VolumesSnapshotsTestJSON-1240189566-project] 10.222.0.75 "GET /compute/v2.1/os-snapshots/e9ba4444-4370-4210-b047-22a33bcc3a4d" status: 200 len: 286 microversion: 2.1 time: 0.088403 May 26 12:38:09.964164 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: [pid: 129321|app: 0|req: 14/20] 10.222.0.75 () {58 vars in 1250 bytes} [Thu May 26 12:38:09 2022] GET /compute/v2.1/os-snapshots/e9ba4444-4370-4210-b047-22a33bcc3a4d => generated 286 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 12:38:09.982417 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi [None req-ec5dc548-3cbb-4c9c-a5cd-b15b01ac28e9 tempest-VolumesGetTestJSON-1862159702 tempest-VolumesGetTestJSON-1862159702-project] Calling method '.version_select at 0x7f8308d98280>' {{(pid=129322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:38:10.119147 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: INFO nova.api.openstack.requestlog [None req-ec5dc548-3cbb-4c9c-a5cd-b15b01ac28e9 tempest-VolumesGetTestJSON-1862159702 tempest-VolumesGetTestJSON-1862159702-project] 10.222.0.75 "GET /compute/v2.1/os-volumes/dd012d67-80f8-4682-9f76-13b60e8bab1d" status: 200 len: 352 microversion: 2.1 time: 0.140535 May 26 12:38:10.120270 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: [pid: 129322|app: 0|req: 7/21] 10.222.0.75 () {58 vars in 1244 bytes} [Thu May 26 12:38:09 2022] GET /compute/v2.1/os-volumes/dd012d67-80f8-4682-9f76-13b60e8bab1d => generated 352 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 12:38:10.265174 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi [None req-5f7aeb71-acc1-40b2-8987-39629860a582 tempest-DeleteServersTestJSON-342872481 tempest-DeleteServersTestJSON-342872481-project] Calling method '>' {{(pid=129321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:38:10.265923 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.compute.api [None req-5f7aeb71-acc1-40b2-8987-39629860a582 tempest-DeleteServersTestJSON-342872481 tempest-DeleteServersTestJSON-342872481-project] [instance: 10054724-aefc-4a9f-a212-14e5fc5a1672] Fetching instance by UUID {{(pid=129321) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:38:10.278171 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-5f7aeb71-acc1-40b2-8987-39629860a582 tempest-DeleteServersTestJSON-342872481 tempest-DeleteServersTestJSON-342872481-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:38:10.278890 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-5f7aeb71-acc1-40b2-8987-39629860a582 tempest-DeleteServersTestJSON-342872481 tempest-DeleteServersTestJSON-342872481-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:38:10.281800 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-5f7aeb71-acc1-40b2-8987-39629860a582 tempest-DeleteServersTestJSON-342872481 tempest-DeleteServersTestJSON-342872481-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:38:10.282245 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-5f7aeb71-acc1-40b2-8987-39629860a582 tempest-DeleteServersTestJSON-342872481 tempest-DeleteServersTestJSON-342872481-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:38:10.486955 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.policy [None req-5f7aeb71-acc1-40b2-8987-39629860a582 tempest-DeleteServersTestJSON-342872481 tempest-DeleteServersTestJSON-342872481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d19942e971b4d7fac3ab8f9a5ad6086', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0f340fa7ff24ca899b0f1036d0e6a3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129321) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:38:10.515007 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: INFO nova.api.openstack.requestlog [None req-5f7aeb71-acc1-40b2-8987-39629860a582 tempest-DeleteServersTestJSON-342872481 tempest-DeleteServersTestJSON-342872481-project] 10.222.0.75 "GET /compute/v2.1/servers/10054724-aefc-4a9f-a212-14e5fc5a1672" status: 200 len: 1219 microversion: 2.1 time: 0.252307 May 26 12:38:10.517342 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: [pid: 129321|app: 0|req: 15/22] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 26 12:38:10 2022] GET /compute/v2.1/servers/10054724-aefc-4a9f-a212-14e5fc5a1672 => generated 1219 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:38:10.674856 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi [None req-0404ab19-05d0-4951-94ed-4595ead5926b tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Action: 'create', calling method: .version_select at 0x7f8308dbbca0>, body: {"keypair": {"name": "tempest-keypair-1183200903", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNr8E7sp6kzXLQKRxRIUWoyrQkQTac+xofpHwIaUZmOTYrNw7hzWH1wONB1y4rPjrwdQpzlIE1ZVAOy8GdJGHwLQolA2lehrcg0vVk5DscY9Cq1o8eFUkdRLmU4nZM4ToQ=="}} {{(pid=129322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 12:38:10.719241 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.quota [None req-0404ab19-05d0-4951-94ed-4595ead5926b tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Getting quotas for project 2675272fb40d4847819f83ec04afecef. Resources: {'key_pairs'} {{(pid=129322) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 26 12:38:10.723684 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.quota [None req-0404ab19-05d0-4951-94ed-4595ead5926b tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Getting quotas for user e811736979c44b02b14fecb74c6bd7ab and project 2675272fb40d4847819f83ec04afecef. Resources: {'key_pairs'} {{(pid=129322) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 26 12:38:10.793282 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: INFO nova.api.openstack.requestlog [None req-0404ab19-05d0-4951-94ed-4595ead5926b tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] 10.222.0.75 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.488851 May 26 12:38:10.794284 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: [pid: 129322|app: 0|req: 8/23] 10.222.0.75 () {62 vars in 1199 bytes} [Thu May 26 12:38:10 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 491 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) May 26 12:38:10.982268 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi [None req-f2df4164-302c-4bdb-9d93-75b127c2484b tempest-VolumesSnapshotsTestJSON-1240189566 tempest-VolumesSnapshotsTestJSON-1240189566-project] Calling method '.version_select at 0x7f8309e565e0>' {{(pid=129321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:38:11.062754 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: INFO nova.api.openstack.requestlog [None req-f2df4164-302c-4bdb-9d93-75b127c2484b tempest-VolumesSnapshotsTestJSON-1240189566 tempest-VolumesSnapshotsTestJSON-1240189566-project] 10.222.0.75 "GET /compute/v2.1/os-snapshots/e9ba4444-4370-4210-b047-22a33bcc3a4d" status: 200 len: 286 microversion: 2.1 time: 0.090271 May 26 12:38:11.063348 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: [pid: 129321|app: 0|req: 16/24] 10.222.0.75 () {58 vars in 1250 bytes} [Thu May 26 12:38:10 2022] GET /compute/v2.1/os-snapshots/e9ba4444-4370-4210-b047-22a33bcc3a4d => generated 286 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 12:38:11.135125 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi [None req-1efcef4d-6a20-424f-ae64-5e71f7b7ca08 tempest-VolumesGetTestJSON-1862159702 tempest-VolumesGetTestJSON-1862159702-project] Calling method '.version_select at 0x7f8308dc8ee0>' {{(pid=129322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:38:11.198495 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: INFO nova.api.openstack.requestlog [None req-1efcef4d-6a20-424f-ae64-5e71f7b7ca08 tempest-VolumesGetTestJSON-1862159702 tempest-VolumesGetTestJSON-1862159702-project] 10.222.0.75 "GET /compute/v2.1/os-volumes/dd012d67-80f8-4682-9f76-13b60e8bab1d" status: 200 len: 352 microversion: 2.1 time: 0.068429 May 26 12:38:11.199353 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: [pid: 129322|app: 0|req: 9/25] 10.222.0.75 () {58 vars in 1244 bytes} [Thu May 26 12:38:11 2022] GET /compute/v2.1/os-volumes/dd012d67-80f8-4682-9f76-13b60e8bab1d => generated 352 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 12:38:11.532967 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi [None req-d6e0c2be-625b-403b-9ba3-25efdf58fb6e tempest-DeleteServersTestJSON-342872481 tempest-DeleteServersTestJSON-342872481-project] Calling method '>' {{(pid=129321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:38:11.533603 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.compute.api [None req-d6e0c2be-625b-403b-9ba3-25efdf58fb6e tempest-DeleteServersTestJSON-342872481 tempest-DeleteServersTestJSON-342872481-project] [instance: 10054724-aefc-4a9f-a212-14e5fc5a1672] Fetching instance by UUID {{(pid=129321) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:38:11.544627 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-d6e0c2be-625b-403b-9ba3-25efdf58fb6e tempest-DeleteServersTestJSON-342872481 tempest-DeleteServersTestJSON-342872481-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:38:11.548031 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-d6e0c2be-625b-403b-9ba3-25efdf58fb6e tempest-DeleteServersTestJSON-342872481 tempest-DeleteServersTestJSON-342872481-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:38:11.548962 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-d6e0c2be-625b-403b-9ba3-25efdf58fb6e tempest-DeleteServersTestJSON-342872481 tempest-DeleteServersTestJSON-342872481-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:38:11.549466 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-d6e0c2be-625b-403b-9ba3-25efdf58fb6e tempest-DeleteServersTestJSON-342872481 tempest-DeleteServersTestJSON-342872481-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:38:11.670183 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.policy [None req-d6e0c2be-625b-403b-9ba3-25efdf58fb6e tempest-DeleteServersTestJSON-342872481 tempest-DeleteServersTestJSON-342872481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d19942e971b4d7fac3ab8f9a5ad6086', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0f340fa7ff24ca899b0f1036d0e6a3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129321) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:38:11.678003 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: INFO nova.api.openstack.requestlog [None req-d6e0c2be-625b-403b-9ba3-25efdf58fb6e tempest-DeleteServersTestJSON-342872481 tempest-DeleteServersTestJSON-342872481-project] 10.222.0.75 "GET /compute/v2.1/servers/10054724-aefc-4a9f-a212-14e5fc5a1672" status: 200 len: 1219 microversion: 2.1 time: 0.148769 May 26 12:38:11.690237 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: [pid: 129321|app: 0|req: 17/26] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 26 12:38:11 2022] GET /compute/v2.1/servers/10054724-aefc-4a9f-a212-14e5fc5a1672 => generated 1219 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:38:12.074748 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi [None req-83a6d941-b93d-4496-af03-04b1379def19 tempest-VolumesSnapshotsTestJSON-1240189566 tempest-VolumesSnapshotsTestJSON-1240189566-project] Calling method '.version_select at 0x7f830855a5e0>' {{(pid=129322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:38:12.158877 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: INFO nova.api.openstack.requestlog [None req-83a6d941-b93d-4496-af03-04b1379def19 tempest-VolumesSnapshotsTestJSON-1240189566 tempest-VolumesSnapshotsTestJSON-1240189566-project] 10.222.0.75 "GET /compute/v2.1/os-snapshots/e9ba4444-4370-4210-b047-22a33bcc3a4d" status: 200 len: 286 microversion: 2.1 time: 0.088007 May 26 12:38:12.163886 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: [pid: 129322|app: 0|req: 10/27] 10.222.0.75 () {58 vars in 1250 bytes} [Thu May 26 12:38:12 2022] GET /compute/v2.1/os-snapshots/e9ba4444-4370-4210-b047-22a33bcc3a4d => generated 286 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 12:38:12.214380 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi [None req-7564bd4d-786b-4c54-beb1-9359f4adfc97 tempest-VolumesGetTestJSON-1862159702 tempest-VolumesGetTestJSON-1862159702-project] Calling method '.version_select at 0x7f8309dedd30>' {{(pid=129321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:38:12.352122 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: INFO nova.api.openstack.requestlog [None req-7564bd4d-786b-4c54-beb1-9359f4adfc97 tempest-VolumesGetTestJSON-1862159702 tempest-VolumesGetTestJSON-1862159702-project] 10.222.0.75 "GET /compute/v2.1/os-volumes/dd012d67-80f8-4682-9f76-13b60e8bab1d" status: 200 len: 352 microversion: 2.1 time: 0.145426 May 26 12:38:12.354062 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: [pid: 129321|app: 0|req: 18/28] 10.222.0.75 () {58 vars in 1244 bytes} [Thu May 26 12:38:12 2022] GET /compute/v2.1/os-volumes/dd012d67-80f8-4682-9f76-13b60e8bab1d => generated 352 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 12:38:12.699360 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi [None req-ad52fdff-9e88-41cc-b86c-43e90119b9f5 tempest-DeleteServersTestJSON-342872481 tempest-DeleteServersTestJSON-342872481-project] Calling method '>' {{(pid=129322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:38:12.701139 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.compute.api [None req-ad52fdff-9e88-41cc-b86c-43e90119b9f5 tempest-DeleteServersTestJSON-342872481 tempest-DeleteServersTestJSON-342872481-project] [instance: 10054724-aefc-4a9f-a212-14e5fc5a1672] Fetching instance by UUID {{(pid=129322) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:38:12.730489 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-ad52fdff-9e88-41cc-b86c-43e90119b9f5 tempest-DeleteServersTestJSON-342872481 tempest-DeleteServersTestJSON-342872481-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:38:12.731853 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-ad52fdff-9e88-41cc-b86c-43e90119b9f5 tempest-DeleteServersTestJSON-342872481 tempest-DeleteServersTestJSON-342872481-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:38:12.736080 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-ad52fdff-9e88-41cc-b86c-43e90119b9f5 tempest-DeleteServersTestJSON-342872481 tempest-DeleteServersTestJSON-342872481-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:38:12.737633 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-ad52fdff-9e88-41cc-b86c-43e90119b9f5 tempest-DeleteServersTestJSON-342872481 tempest-DeleteServersTestJSON-342872481-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:38:13.330934 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi [None req-c605669e-24ac-4a96-b379-76a47e526fbe tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-756215892", "imageRef": "1e3c323d-d797-4e6d-bd9a-482d90084b0c", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=129321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 12:38:13.598025 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.policy [None req-ad52fdff-9e88-41cc-b86c-43e90119b9f5 tempest-DeleteServersTestJSON-342872481 tempest-DeleteServersTestJSON-342872481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d19942e971b4d7fac3ab8f9a5ad6086', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0f340fa7ff24ca899b0f1036d0e6a3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129322) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:38:13.609858 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.network.neutron [None req-c605669e-24ac-4a96-b379-76a47e526fbe tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] validate_networks() for [('2f3dce3a-69e6-47f2-9db3-0b2713db2bee', None, None, None, None, None)] {{(pid=129321) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 26 12:38:13.644487 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: INFO nova.api.openstack.requestlog [None req-ad52fdff-9e88-41cc-b86c-43e90119b9f5 tempest-DeleteServersTestJSON-342872481 tempest-DeleteServersTestJSON-342872481-project] 10.222.0.75 "GET /compute/v2.1/servers/10054724-aefc-4a9f-a212-14e5fc5a1672" status: 200 len: 1219 microversion: 2.1 time: 0.953784 May 26 12:38:13.655897 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: [pid: 129322|app: 0|req: 11/29] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 26 12:38:12 2022] GET /compute/v2.1/servers/10054724-aefc-4a9f-a212-14e5fc5a1672 => generated 1219 bytes in 966 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:38:13.691067 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi [None req-3e710930-a91f-442f-9be1-c2c45191629e tempest-VolumesSnapshotsTestJSON-1240189566 tempest-VolumesSnapshotsTestJSON-1240189566-project] Calling method '.version_select at 0x7f830854ce50>' {{(pid=129322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:38:13.791468 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: INFO nova.api.openstack.requestlog [None req-3e710930-a91f-442f-9be1-c2c45191629e tempest-VolumesSnapshotsTestJSON-1240189566 tempest-VolumesSnapshotsTestJSON-1240189566-project] 10.222.0.75 "GET /compute/v2.1/os-snapshots/e9ba4444-4370-4210-b047-22a33bcc3a4d" status: 200 len: 287 microversion: 2.1 time: 0.119943 May 26 12:38:13.792086 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: [pid: 129322|app: 0|req: 12/30] 10.222.0.75 () {58 vars in 1250 bytes} [Thu May 26 12:38:13 2022] GET /compute/v2.1/os-snapshots/e9ba4444-4370-4210-b047-22a33bcc3a4d => generated 287 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 12:38:13.801279 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi [None req-71e5afbe-8612-43e4-9b17-2ffc44c5ad1c tempest-VolumesGetTestJSON-1862159702 tempest-VolumesGetTestJSON-1862159702-project] Calling method '.version_select at 0x7f83084da0d0>' {{(pid=129322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:38:13.986268 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: INFO nova.api.openstack.requestlog [None req-71e5afbe-8612-43e4-9b17-2ffc44c5ad1c tempest-VolumesGetTestJSON-1862159702 tempest-VolumesGetTestJSON-1862159702-project] 10.222.0.75 "GET /compute/v2.1/os-volumes/dd012d67-80f8-4682-9f76-13b60e8bab1d" status: 200 len: 352 microversion: 2.1 time: 0.193087 May 26 12:38:13.989099 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: [pid: 129322|app: 0|req: 13/31] 10.222.0.75 () {58 vars in 1244 bytes} [Thu May 26 12:38:13 2022] GET /compute/v2.1/os-volumes/dd012d67-80f8-4682-9f76-13b60e8bab1d => generated 352 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 12:38:13.996544 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi [None req-cc1d6413-656b-4e39-b019-762978197b55 tempest-VolumesSnapshotsTestJSON-1240189566 tempest-VolumesSnapshotsTestJSON-1240189566-project] Calling method '.version_select at 0x7f830854c8b0>' {{(pid=129322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:38:14.206195 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: INFO nova.api.openstack.requestlog [None req-cc1d6413-656b-4e39-b019-762978197b55 tempest-VolumesSnapshotsTestJSON-1240189566 tempest-VolumesSnapshotsTestJSON-1240189566-project] 10.222.0.75 "DELETE /compute/v2.1/os-snapshots/e9ba4444-4370-4210-b047-22a33bcc3a4d" status: 202 len: 0 microversion: 2.1 time: 0.215867 May 26 12:38:14.211897 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: [pid: 129322|app: 0|req: 14/32] 10.222.0.75 () {58 vars in 1253 bytes} [Thu May 26 12:38:13 2022] DELETE /compute/v2.1/os-snapshots/e9ba4444-4370-4210-b047-22a33bcc3a4d => generated 0 bytes in 222 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 26 12:38:14.232634 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi [None req-df5bbce6-7de0-407b-9189-cb06e9b0aaeb tempest-VolumesSnapshotsTestJSON-1240189566 tempest-VolumesSnapshotsTestJSON-1240189566-project] Calling method '.version_select at 0x7f830855ac10>' {{(pid=129322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:38:14.303697 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: INFO nova.api.openstack.requestlog [None req-df5bbce6-7de0-407b-9189-cb06e9b0aaeb tempest-VolumesSnapshotsTestJSON-1240189566 tempest-VolumesSnapshotsTestJSON-1240189566-project] 10.222.0.75 "GET /compute/v2.1/os-snapshots/e9ba4444-4370-4210-b047-22a33bcc3a4d" status: 200 len: 286 microversion: 2.1 time: 0.089548 May 26 12:38:14.305019 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: [pid: 129322|app: 0|req: 15/33] 10.222.0.75 () {58 vars in 1250 bytes} [Thu May 26 12:38:14 2022] GET /compute/v2.1/os-snapshots/e9ba4444-4370-4210-b047-22a33bcc3a4d => generated 286 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 12:38:14.598577 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi [None req-115ce9fd-a702-468f-b88f-2c9ef149b4d9 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1818378581", "imageRef": "1e3c323d-d797-4e6d-bd9a-482d90084b0c", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "ab4fbad5-47b6-41f0-b9ab-c8045af65685"}], "security_groups": [{"name": "tempest-securitygroup--276081732"}], "key_name": "tempest-keypair-1183200903", "user_data": "}} {{(pid=129322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 12:38:14.894552 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.network.neutron [None req-115ce9fd-a702-468f-b88f-2c9ef149b4d9 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] validate_networks() for [('ab4fbad5-47b6-41f0-b9ab-c8045af65685', None, None, None, None, None)] {{(pid=129322) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 26 12:38:15.524204 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.virt.hardware [None req-115ce9fd-a702-468f-b88f-2c9ef149b4d9 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Flavor limits 0:0:0 {{(pid=129322) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 26 12:38:15.524923 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.virt.hardware [None req-115ce9fd-a702-468f-b88f-2c9ef149b4d9 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Image limits 0:0:0 {{(pid=129322) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 26 12:38:15.525570 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.virt.hardware [None req-115ce9fd-a702-468f-b88f-2c9ef149b4d9 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Flavor pref 0:0:0 {{(pid=129322) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 26 12:38:15.526152 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.virt.hardware [None req-115ce9fd-a702-468f-b88f-2c9ef149b4d9 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Image pref 0:0:0 {{(pid=129322) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 26 12:38:15.527033 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.virt.hardware [None req-115ce9fd-a702-468f-b88f-2c9ef149b4d9 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129322) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 26 12:38:15.539350 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-115ce9fd-a702-468f-b88f-2c9ef149b4d9 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:38:15.540314 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-115ce9fd-a702-468f-b88f-2c9ef149b4d9 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:38:15.541302 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-115ce9fd-a702-468f-b88f-2c9ef149b4d9 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:38:15.541927 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-115ce9fd-a702-468f-b88f-2c9ef149b4d9 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:38:15.572308 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.quota [None req-115ce9fd-a702-468f-b88f-2c9ef149b4d9 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Getting quotas for project 2675272fb40d4847819f83ec04afecef. Resources: {'instances', 'cores', 'ram'} {{(pid=129322) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 26 12:38:15.584157 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.quota [None req-115ce9fd-a702-468f-b88f-2c9ef149b4d9 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Getting quotas for user e811736979c44b02b14fecb74c6bd7ab and project 2675272fb40d4847819f83ec04afecef. Resources: {'instances', 'cores', 'ram'} {{(pid=129322) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 26 12:38:15.609956 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.compute.api [None req-115ce9fd-a702-468f-b88f-2c9ef149b4d9 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Going to run 1 instances... {{(pid=129322) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 26 12:38:15.613857 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.compute.api [None req-115ce9fd-a702-468f-b88f-2c9ef149b4d9 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] [instance: bf2f6303-22b9-4cfa-8d4d-61d2503bc554] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1e3c323d-d797-4e6d-bd9a-482d90084b0c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129322) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 26 12:38:15.699771 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: INFO nova.api.openstack.requestlog [None req-115ce9fd-a702-468f-b88f-2c9ef149b4d9 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] 10.222.0.75 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 1.105485 May 26 12:38:15.700900 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: [pid: 129322|app: 0|req: 16/34] 10.222.0.75 () {62 vars in 1187 bytes} [Thu May 26 12:38:14 2022] POST /compute/v2.1/servers => generated 401 bytes in 1108 msecs (HTTP/1.1 202) 10 headers in 453 bytes (2 switches on core 0) May 26 12:38:15.706388 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi [None req-dc6253d8-b559-4dfa-8fe5-d5c8d62d26ff tempest-DeleteServersTestJSON-342872481 tempest-DeleteServersTestJSON-342872481-project] Calling method '>' {{(pid=129322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:38:15.707426 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.compute.api [None req-dc6253d8-b559-4dfa-8fe5-d5c8d62d26ff tempest-DeleteServersTestJSON-342872481 tempest-DeleteServersTestJSON-342872481-project] [instance: 10054724-aefc-4a9f-a212-14e5fc5a1672] Fetching instance by UUID {{(pid=129322) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:38:15.715068 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-dc6253d8-b559-4dfa-8fe5-d5c8d62d26ff tempest-DeleteServersTestJSON-342872481 tempest-DeleteServersTestJSON-342872481-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:38:15.715853 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-dc6253d8-b559-4dfa-8fe5-d5c8d62d26ff tempest-DeleteServersTestJSON-342872481 tempest-DeleteServersTestJSON-342872481-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:38:15.716781 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-dc6253d8-b559-4dfa-8fe5-d5c8d62d26ff tempest-DeleteServersTestJSON-342872481 tempest-DeleteServersTestJSON-342872481-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:38:15.717347 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-dc6253d8-b559-4dfa-8fe5-d5c8d62d26ff tempest-DeleteServersTestJSON-342872481 tempest-DeleteServersTestJSON-342872481-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:38:15.905536 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.virt.hardware [None req-c605669e-24ac-4a96-b379-76a47e526fbe tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Flavor limits 0:0:0 {{(pid=129321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 26 12:38:15.906920 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.policy [None req-dc6253d8-b559-4dfa-8fe5-d5c8d62d26ff tempest-DeleteServersTestJSON-342872481 tempest-DeleteServersTestJSON-342872481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d19942e971b4d7fac3ab8f9a5ad6086', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0f340fa7ff24ca899b0f1036d0e6a3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129322) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:38:15.907060 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.virt.hardware [None req-c605669e-24ac-4a96-b379-76a47e526fbe tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Image limits 0:0:0 {{(pid=129321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 26 12:38:15.907060 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.virt.hardware [None req-c605669e-24ac-4a96-b379-76a47e526fbe tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Flavor pref 0:0:0 {{(pid=129321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 26 12:38:15.907441 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.virt.hardware [None req-c605669e-24ac-4a96-b379-76a47e526fbe tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Image pref 0:0:0 {{(pid=129321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 26 12:38:15.908304 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.virt.hardware [None req-c605669e-24ac-4a96-b379-76a47e526fbe tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 26 12:38:15.936467 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: INFO nova.api.openstack.requestlog [None req-dc6253d8-b559-4dfa-8fe5-d5c8d62d26ff tempest-DeleteServersTestJSON-342872481 tempest-DeleteServersTestJSON-342872481-project] 10.222.0.75 "GET /compute/v2.1/servers/10054724-aefc-4a9f-a212-14e5fc5a1672" status: 200 len: 1273 microversion: 2.1 time: 0.234288 May 26 12:38:15.939774 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: [pid: 129322|app: 0|req: 17/35] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 26 12:38:15 2022] GET /compute/v2.1/servers/10054724-aefc-4a9f-a212-14e5fc5a1672 => generated 1273 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:38:15.948923 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi [None req-45deae4f-107b-41ed-bc13-bb450b775776 tempest-VolumesTestJSON-2014170337 tempest-VolumesTestJSON-2014170337-project] Calling method '.version_select at 0x7f830850f9d0>' {{(pid=129322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:38:15.953574 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-c605669e-24ac-4a96-b379-76a47e526fbe tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:38:15.958275 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-c605669e-24ac-4a96-b379-76a47e526fbe tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:38:15.964693 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-c605669e-24ac-4a96-b379-76a47e526fbe tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:38:15.965582 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-c605669e-24ac-4a96-b379-76a47e526fbe tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:38:16.091439 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.quota [None req-c605669e-24ac-4a96-b379-76a47e526fbe tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Getting quotas for project 9e36ab03283d4ce6a2fed5e111e03d34. Resources: {'instances', 'cores', 'ram'} {{(pid=129321) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 26 12:38:16.107258 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.quota [None req-c605669e-24ac-4a96-b379-76a47e526fbe tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Getting quotas for user 0431b1f25497443ba483b3c440669080 and project 9e36ab03283d4ce6a2fed5e111e03d34. Resources: {'instances', 'cores', 'ram'} {{(pid=129321) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 26 12:38:16.135810 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: INFO nova.api.openstack.requestlog [None req-45deae4f-107b-41ed-bc13-bb450b775776 tempest-VolumesTestJSON-2014170337 tempest-VolumesTestJSON-2014170337-project] 10.222.0.75 "GET /compute/v2.1/os-volumes/7c3d8593-fe91-4e51-baf2-552e0548aac1" status: 200 len: 350 microversion: 2.1 time: 0.194560 May 26 12:38:16.136415 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: [pid: 129322|app: 0|req: 18/36] 10.222.0.75 () {58 vars in 1244 bytes} [Thu May 26 12:38:15 2022] GET /compute/v2.1/os-volumes/7c3d8593-fe91-4e51-baf2-552e0548aac1 => generated 350 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 12:38:16.142597 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi [None req-c1984cea-45ff-4094-8b63-0fd9840ab599 tempest-VolumesGetTestJSON-1862159702 tempest-VolumesGetTestJSON-1862159702-project] Calling method '.version_select at 0x7f830850f0d0>' {{(pid=129322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:38:16.153148 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.compute.api [None req-c605669e-24ac-4a96-b379-76a47e526fbe tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Going to run 1 instances... {{(pid=129321) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 26 12:38:16.159451 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.compute.api [None req-c605669e-24ac-4a96-b379-76a47e526fbe tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] [instance: f9200aab-6f49-4e6f-812b-93b2f3e1edd9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1e3c323d-d797-4e6d-bd9a-482d90084b0c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129321) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 26 12:38:16.254461 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: INFO nova.api.openstack.wsgi [None req-c1984cea-45ff-4094-8b63-0fd9840ab599 tempest-VolumesGetTestJSON-1862159702 tempest-VolumesGetTestJSON-1862159702-project] HTTP exception thrown: Volume dd012d67-80f8-4682-9f76-13b60e8bab1d could not be found. May 26 12:38:16.260396 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi [None req-c1984cea-45ff-4094-8b63-0fd9840ab599 tempest-VolumesGetTestJSON-1862159702 tempest-VolumesGetTestJSON-1862159702-project] Request method failure captured: May 26 12:38:16.260396 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: request: GET /compute/v2.1/os-volumes/dd012d67-80f8-4682-9f76-13b60e8bab1d HTTP/1.1 May 26 12:38:16.260396 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: Accept: application/json May 26 12:38:16.260396 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: Accept-Encoding: identity May 26 12:38:16.260396 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: Connection: close May 26 12:38:16.260396 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: Content-Length: 0 May 26 12:38:16.260396 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: Content-Type: application/json May 26 12:38:16.260396 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: Host: 10.222.0.75 May 26 12:38:16.260396 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: Openstack-System-Scope: None May 26 12:38:16.260396 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: User-Agent: python-urllib3/1.26.9 May 26 12:38:16.260396 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: X-Auth-Token: gAAAAABij3Sp45t1xoyvrN6_zqVQn4dPI1TdzyOZlBfONBUGRYyUHgH7KF7otNmbccAajKWsOH-31M9DAeZMt8LpfBlpIn8PJmGgiSFTV5jscYtLE2zX63U9rqxLaSvc6CAnfxxmPy4eWkZsV_CrxhLpRlYRmZZACkSLHPGIprw6RYdhE3rTNTo May 26 12:38:16.260396 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: X-Domain-Id: None May 26 12:38:16.260396 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: X-Domain-Name: None May 26 12:38:16.260396 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: X-Identity-Status: Confirmed May 26 12:38:16.260396 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: X-Is-Admin-Project: True May 26 12:38:16.260396 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: X-Project-Domain-Id: default May 26 12:38:16.260396 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: X-Project-Domain-Name: Default May 26 12:38:16.260396 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: X-Project-Id: 8af34fa3679e4dacafe5402b1520a70c May 26 12:38:16.260396 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: X-Project-Name: tempest-VolumesGetTestJSON-1862159702 May 26 12:38:16.260396 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: X-Role: member,reader May 26 12:38:16.260396 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: X-Roles: member,reader May 26 12:38:16.261740 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/8af34fa3679e4dacafe5402b1520a70c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.75:8080", "publicURL": "http://10.222.0.75:8080/v1/AUTH_8af34fa3679e4dacafe5402b1520a70c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2/8af34fa3679e4dacafe5402b1520a70c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/8af34fa3679e4dacafe5402b1520a70c"}]}] May 26 12:38:16.261740 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: X-Tenant: tempest-VolumesGetTestJSON-1862159702 May 26 12:38:16.261740 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: X-Tenant-Id: 8af34fa3679e4dacafe5402b1520a70c May 26 12:38:16.261740 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: X-Tenant-Name: tempest-VolumesGetTestJSON-1862159702 May 26 12:38:16.261740 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: X-User: tempest-VolumesGetTestJSON-1862159702-project May 26 12:38:16.261740 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: X-User-Domain-Id: default May 26 12:38:16.261740 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: X-User-Domain-Name: Default May 26 12:38:16.261740 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: X-User-Id: ea99e631ab594cd889a62ab1c61cb5e0 May 26 12:38:16.261740 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: X-User-Name: tempest-VolumesGetTestJSON-1862159702-project May 26 12:38:16.261740 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: method: May 26 12:38:16.261740 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: exception: Volume dd012d67-80f8-4682-9f76-13b60e8bab1d could not be found. May 26 12:38:16.261740 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: action_args: {'id': 'dd012d67-80f8-4682-9f76-13b60e8bab1d'} May 26 12:38:16.261740 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: {{(pid=129322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 12:38:16.262751 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 12:38:16.262751 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 26 12:38:16.262751 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 26 12:38:16.262751 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 26 12:38:16.262751 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi item = cinderclient( May 26 12:38:16.262751 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 26 12:38:16.262751 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 26 12:38:16.262751 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 26 12:38:16.262751 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 26 12:38:16.262751 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 26 12:38:16.262751 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 26 12:38:16.262751 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 26 12:38:16.262751 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 26 12:38:16.262751 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 26 12:38:16.262751 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 26 12:38:16.262751 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume dd012d67-80f8-4682-9f76-13b60e8bab1d could not be found. (HTTP 404) (Request-ID: req-294a1a91-2bb1-4fa7-89e1-efc765c7a26c) May 26 12:38:16.262751 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi May 26 12:38:16.262751 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 12:38:16.262751 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi May 26 12:38:16.263960 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 12:38:16.263960 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show May 26 12:38:16.263960 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) May 26 12:38:16.263960 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 26 12:38:16.263960 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 26 12:38:16.263960 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 26 12:38:16.263960 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 26 12:38:16.263960 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 26 12:38:16.263960 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 26 12:38:16.263960 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 26 12:38:16.263960 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 26 12:38:16.263960 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 26 12:38:16.263960 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi item = cinderclient( May 26 12:38:16.263960 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 26 12:38:16.263960 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 26 12:38:16.263960 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 26 12:38:16.263960 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 26 12:38:16.263960 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 26 12:38:16.263960 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 26 12:38:16.265031 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 26 12:38:16.265031 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 26 12:38:16.265031 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 26 12:38:16.265031 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 26 12:38:16.265031 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume dd012d67-80f8-4682-9f76-13b60e8bab1d could not be found. May 26 12:38:16.265031 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi May 26 12:38:16.265031 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 12:38:16.265031 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi May 26 12:38:16.265031 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 12:38:16.265031 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 12:38:16.265031 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 12:38:16.265031 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 12:38:16.265031 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 12:38:16.265031 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 26 12:38:16.265031 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 26 12:38:16.265031 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 12:38:16.265031 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 12:38:16.265031 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show May 26 12:38:16.265031 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 12:38:16.266553 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume dd012d67-80f8-4682-9f76-13b60e8bab1d could not be found. May 26 12:38:16.266553 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi May 26 12:38:16.266553 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 12:38:16.266553 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi May 26 12:38:16.266553 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 12:38:16.266553 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 12:38:16.266553 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 12:38:16.266553 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 12:38:16.266553 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 12:38:16.266553 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume dd012d67-80f8-4682-9f76-13b60e8bab1d could not be found. May 26 12:38:16.266553 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi May 26 12:38:16.266553 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi [None req-c1984cea-45ff-4094-8b63-0fd9840ab599 tempest-VolumesGetTestJSON-1862159702 tempest-VolumesGetTestJSON-1862159702-project] Returning 404 to user: Volume dd012d67-80f8-4682-9f76-13b60e8bab1d could not be found. {{(pid=129322) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 12:38:16.266553 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: INFO nova.api.openstack.requestlog [None req-c1984cea-45ff-4094-8b63-0fd9840ab599 tempest-VolumesGetTestJSON-1862159702 tempest-VolumesGetTestJSON-1862159702-project] 10.222.0.75 "GET /compute/v2.1/os-volumes/dd012d67-80f8-4682-9f76-13b60e8bab1d" status: 404 len: 109 microversion: 2.1 time: 0.124322 May 26 12:38:16.271906 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: [pid: 129322|app: 0|req: 19/37] 10.222.0.75 () {58 vars in 1244 bytes} [Thu May 26 12:38:16 2022] GET /compute/v2.1/os-volumes/dd012d67-80f8-4682-9f76-13b60e8bab1d => generated 109 bytes in 131 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 26 12:38:16.301157 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi [None req-a1a8e518-ea8a-4a10-beac-66f9d1797a23 tempest-VolumesSnapshotsTestJSON-1240189566 tempest-VolumesSnapshotsTestJSON-1240189566-project] Calling method '.version_select at 0x7f83084bc430>' {{(pid=129322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:38:16.407081 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: INFO nova.api.openstack.requestlog [None req-c605669e-24ac-4a96-b379-76a47e526fbe tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] 10.222.0.75 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 3.417572 May 26 12:38:16.413919 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: [pid: 129321|app: 0|req: 19/38] 10.222.0.75 () {60 vars in 1146 bytes} [Thu May 26 12:38:12 2022] POST /compute/v2.1/servers => generated 383 bytes in 3425 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 26 12:38:16.426706 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: INFO nova.api.openstack.wsgi [None req-a1a8e518-ea8a-4a10-beac-66f9d1797a23 tempest-VolumesSnapshotsTestJSON-1240189566 tempest-VolumesSnapshotsTestJSON-1240189566-project] HTTP exception thrown: Snapshot e9ba4444-4370-4210-b047-22a33bcc3a4d could not be found. May 26 12:38:16.429127 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi [None req-a1a8e518-ea8a-4a10-beac-66f9d1797a23 tempest-VolumesSnapshotsTestJSON-1240189566 tempest-VolumesSnapshotsTestJSON-1240189566-project] Request method failure captured: May 26 12:38:16.429127 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: request: GET /compute/v2.1/os-snapshots/e9ba4444-4370-4210-b047-22a33bcc3a4d HTTP/1.1 May 26 12:38:16.429127 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: Accept: application/json May 26 12:38:16.429127 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: Accept-Encoding: identity May 26 12:38:16.429127 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: Connection: close May 26 12:38:16.429127 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: Content-Length: 0 May 26 12:38:16.429127 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: Content-Type: application/json May 26 12:38:16.429127 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: Host: 10.222.0.75 May 26 12:38:16.429127 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: Openstack-System-Scope: None May 26 12:38:16.429127 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: User-Agent: python-urllib3/1.26.9 May 26 12:38:16.429127 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: X-Auth-Token: gAAAAABij3SpVeXhwuAO00EXkto8UiM45W0nXTBfLoQHCHc2ndKYLkMUT1jpbtoGURuEVOu46zkuNuJg3h0cyy-lQOvbMX1pSAorNbss0KbnDIpvZnmjBuK5NnmtlOMnBVSIg1YaJn8PANjEMvTtiMYegVvF98PhfFfIfmdn9s3xlwDzbTRK6pI May 26 12:38:16.429127 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: X-Domain-Id: None May 26 12:38:16.429127 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: X-Domain-Name: None May 26 12:38:16.429127 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: X-Identity-Status: Confirmed May 26 12:38:16.429127 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: X-Is-Admin-Project: True May 26 12:38:16.429127 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: X-Project-Domain-Id: default May 26 12:38:16.429127 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: X-Project-Domain-Name: Default May 26 12:38:16.429127 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: X-Project-Id: 782a2f5efd3f44b0ba01b2a22d3702f8 May 26 12:38:16.429127 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1240189566 May 26 12:38:16.429127 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: X-Role: member,reader May 26 12:38:16.429127 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: X-Roles: member,reader May 26 12:38:16.430592 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/782a2f5efd3f44b0ba01b2a22d3702f8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.75:8080", "publicURL": "http://10.222.0.75:8080/v1/AUTH_782a2f5efd3f44b0ba01b2a22d3702f8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2/782a2f5efd3f44b0ba01b2a22d3702f8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/782a2f5efd3f44b0ba01b2a22d3702f8"}]}] May 26 12:38:16.430592 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1240189566 May 26 12:38:16.430592 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: X-Tenant-Id: 782a2f5efd3f44b0ba01b2a22d3702f8 May 26 12:38:16.430592 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1240189566 May 26 12:38:16.430592 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: X-User: tempest-VolumesSnapshotsTestJSON-1240189566-project May 26 12:38:16.430592 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: X-User-Domain-Id: default May 26 12:38:16.430592 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: X-User-Domain-Name: Default May 26 12:38:16.430592 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: X-User-Id: fbd43b05f56b43b4a04d3b6caba1b828 May 26 12:38:16.430592 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1240189566-project May 26 12:38:16.430592 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: method: May 26 12:38:16.430592 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: exception: Snapshot e9ba4444-4370-4210-b047-22a33bcc3a4d could not be found. May 26 12:38:16.430592 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: action_args: {'id': 'e9ba4444-4370-4210-b047-22a33bcc3a4d'} May 26 12:38:16.430592 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: {{(pid=129322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 12:38:16.431663 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 12:38:16.431663 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper May 26 12:38:16.431663 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) May 26 12:38:16.431663 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot May 26 12:38:16.431663 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) May 26 12:38:16.431663 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get May 26 12:38:16.431663 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") May 26 12:38:16.431663 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 26 12:38:16.431663 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 26 12:38:16.431663 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 26 12:38:16.431663 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 26 12:38:16.431663 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 26 12:38:16.431663 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 26 12:38:16.431663 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 26 12:38:16.431663 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 26 12:38:16.431663 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot e9ba4444-4370-4210-b047-22a33bcc3a4d could not be found. (HTTP 404) (Request-ID: req-724956f3-9d22-447c-a9c8-337291ab33e5) May 26 12:38:16.431663 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi May 26 12:38:16.431663 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 12:38:16.432891 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi May 26 12:38:16.432891 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 12:38:16.432891 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show May 26 12:38:16.432891 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) May 26 12:38:16.432891 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 26 12:38:16.432891 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 26 12:38:16.432891 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper May 26 12:38:16.432891 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) May 26 12:38:16.432891 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 26 12:38:16.432891 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 26 12:38:16.432891 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper May 26 12:38:16.432891 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) May 26 12:38:16.432891 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot May 26 12:38:16.432891 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) May 26 12:38:16.432891 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get May 26 12:38:16.432891 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") May 26 12:38:16.432891 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 26 12:38:16.432891 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 26 12:38:16.432891 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 26 12:38:16.433993 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 26 12:38:16.433993 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 26 12:38:16.433993 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 26 12:38:16.433993 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 26 12:38:16.433993 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 26 12:38:16.433993 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot e9ba4444-4370-4210-b047-22a33bcc3a4d could not be found. May 26 12:38:16.433993 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi May 26 12:38:16.433993 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 12:38:16.433993 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi May 26 12:38:16.433993 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 12:38:16.433993 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 12:38:16.433993 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 12:38:16.433993 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 12:38:16.433993 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 12:38:16.433993 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 26 12:38:16.433993 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 26 12:38:16.433993 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 12:38:16.433993 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 12:38:16.433993 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show May 26 12:38:16.433993 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 12:38:16.435257 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot e9ba4444-4370-4210-b047-22a33bcc3a4d could not be found. May 26 12:38:16.435257 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi May 26 12:38:16.435257 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 12:38:16.435257 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi May 26 12:38:16.435257 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 12:38:16.435257 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 12:38:16.435257 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 12:38:16.435257 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 12:38:16.435257 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 12:38:16.435257 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot e9ba4444-4370-4210-b047-22a33bcc3a4d could not be found. May 26 12:38:16.435257 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi May 26 12:38:16.435257 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi [None req-a1a8e518-ea8a-4a10-beac-66f9d1797a23 tempest-VolumesSnapshotsTestJSON-1240189566 tempest-VolumesSnapshotsTestJSON-1240189566-project] Returning 404 to user: Snapshot e9ba4444-4370-4210-b047-22a33bcc3a4d could not be found. {{(pid=129322) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 12:38:16.435257 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: INFO nova.api.openstack.requestlog [None req-a1a8e518-ea8a-4a10-beac-66f9d1797a23 tempest-VolumesSnapshotsTestJSON-1240189566 tempest-VolumesSnapshotsTestJSON-1240189566-project] 10.222.0.75 "GET /compute/v2.1/os-snapshots/e9ba4444-4370-4210-b047-22a33bcc3a4d" status: 404 len: 111 microversion: 2.1 time: 0.159203 May 26 12:38:16.436050 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: [pid: 129322|app: 0|req: 20/39] 10.222.0.75 () {58 vars in 1250 bytes} [Thu May 26 12:38:16 2022] GET /compute/v2.1/os-snapshots/e9ba4444-4370-4210-b047-22a33bcc3a4d => generated 111 bytes in 166 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 26 12:38:16.439962 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi [None req-0cba70d6-c2db-490e-b6de-ca70860ee6d1 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Calling method '>' {{(pid=129321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:38:16.440895 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.compute.api [None req-0cba70d6-c2db-490e-b6de-ca70860ee6d1 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] [instance: bf2f6303-22b9-4cfa-8d4d-61d2503bc554] Fetching instance by UUID {{(pid=129321) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:38:16.454414 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi [None req-b2cb9b72-5ac7-435f-b93b-265814f9a16c tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Calling method '>' {{(pid=129322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:38:16.457174 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.compute.api [None req-b2cb9b72-5ac7-435f-b93b-265814f9a16c tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] [instance: f9200aab-6f49-4e6f-812b-93b2f3e1edd9] Fetching instance by UUID {{(pid=129322) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:38:16.615190 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.policy [None req-b2cb9b72-5ac7-435f-b93b-265814f9a16c tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0431b1f25497443ba483b3c440669080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e36ab03283d4ce6a2fed5e111e03d34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129322) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:38:16.624355 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: INFO nova.api.openstack.requestlog [None req-b2cb9b72-5ac7-435f-b93b-265814f9a16c tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] 10.222.0.75 "GET /compute/v2.1/servers/f9200aab-6f49-4e6f-812b-93b2f3e1edd9" status: 200 len: 1221 microversion: 2.1 time: 0.188502 May 26 12:38:16.624871 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: [pid: 129322|app: 0|req: 21/40] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 26 12:38:16 2022] GET /compute/v2.1/servers/f9200aab-6f49-4e6f-812b-93b2f3e1edd9 => generated 1221 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:38:16.652015 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi [None req-ad0397de-6e28-4f62-87b4-1522e6c5f2d0 tempest-VolumesSnapshotsTestJSON-1240189566 tempest-VolumesSnapshotsTestJSON-1240189566-project] Calling method '.version_select at 0x7f830842f940>' {{(pid=129322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:38:16.928745 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: INFO nova.api.openstack.requestlog [None req-ad0397de-6e28-4f62-87b4-1522e6c5f2d0 tempest-VolumesSnapshotsTestJSON-1240189566 tempest-VolumesSnapshotsTestJSON-1240189566-project] 10.222.0.75 "DELETE /compute/v2.1/os-volumes/869ac730-f46c-427e-b24f-30760cc63c92" status: 202 len: 0 microversion: 2.1 time: 0.300977 May 26 12:38:16.930333 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: [pid: 129322|app: 0|req: 22/41] 10.222.0.75 () {58 vars in 1247 bytes} [Thu May 26 12:38:16 2022] DELETE /compute/v2.1/os-volumes/869ac730-f46c-427e-b24f-30760cc63c92 => generated 0 bytes in 303 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 26 12:38:16.943638 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi [None req-1c4b355f-3aa7-4c4b-a9c6-6f36d6f8c1ca tempest-VolumesSnapshotsTestJSON-1240189566 tempest-VolumesSnapshotsTestJSON-1240189566-project] Calling method '.version_select at 0x7f830842fdc0>' {{(pid=129322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:38:17.034813 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: INFO nova.api.openstack.requestlog [None req-1c4b355f-3aa7-4c4b-a9c6-6f36d6f8c1ca tempest-VolumesSnapshotsTestJSON-1240189566 tempest-VolumesSnapshotsTestJSON-1240189566-project] 10.222.0.75 "GET /compute/v2.1/os-volumes/869ac730-f46c-427e-b24f-30760cc63c92" status: 200 len: 343 microversion: 2.1 time: 0.100185 May 26 12:38:17.036905 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: [pid: 129322|app: 0|req: 23/42] 10.222.0.75 () {58 vars in 1244 bytes} [Thu May 26 12:38:16 2022] GET /compute/v2.1/os-volumes/869ac730-f46c-427e-b24f-30760cc63c92 => generated 343 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 26 12:38:17.047812 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi [None req-fc86c3de-f83e-4668-84a8-e724653277aa tempest-DeleteServersTestJSON-342872481 tempest-DeleteServersTestJSON-342872481-project] Calling method '>' {{(pid=129322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:38:17.048979 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.compute.api [None req-fc86c3de-f83e-4668-84a8-e724653277aa tempest-DeleteServersTestJSON-342872481 tempest-DeleteServersTestJSON-342872481-project] [instance: 10054724-aefc-4a9f-a212-14e5fc5a1672] Fetching instance by UUID {{(pid=129322) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:38:17.066908 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-fc86c3de-f83e-4668-84a8-e724653277aa tempest-DeleteServersTestJSON-342872481 tempest-DeleteServersTestJSON-342872481-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:38:17.067637 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-fc86c3de-f83e-4668-84a8-e724653277aa tempest-DeleteServersTestJSON-342872481 tempest-DeleteServersTestJSON-342872481-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:38:17.073646 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-fc86c3de-f83e-4668-84a8-e724653277aa tempest-DeleteServersTestJSON-342872481 tempest-DeleteServersTestJSON-342872481-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:38:17.074161 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-fc86c3de-f83e-4668-84a8-e724653277aa tempest-DeleteServersTestJSON-342872481 tempest-DeleteServersTestJSON-342872481-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:38:17.260913 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.policy [None req-0cba70d6-c2db-490e-b6de-ca70860ee6d1 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e811736979c44b02b14fecb74c6bd7ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675272fb40d4847819f83ec04afecef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129321) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:38:17.277955 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.policy [None req-0cba70d6-c2db-490e-b6de-ca70860ee6d1 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e811736979c44b02b14fecb74c6bd7ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675272fb40d4847819f83ec04afecef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129321) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:38:17.279902 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.policy [None req-0cba70d6-c2db-490e-b6de-ca70860ee6d1 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e811736979c44b02b14fecb74c6bd7ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675272fb40d4847819f83ec04afecef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129321) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:38:17.286015 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: INFO nova.api.openstack.requestlog [None req-0cba70d6-c2db-490e-b6de-ca70860ee6d1 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] 10.222.0.75 "GET /compute/v2.1/servers/bf2f6303-22b9-4cfa-8d4d-61d2503bc554" status: 200 len: 1282 microversion: 2.20 time: 0.870614 May 26 12:38:17.297466 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: [pid: 129321|app: 0|req: 20/43] 10.222.0.75 () {60 vars in 1276 bytes} [Thu May 26 12:38:16 2022] GET /compute/v2.1/servers/bf2f6303-22b9-4cfa-8d4d-61d2503bc554 => generated 1282 bytes in 883 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 12:38:17.354991 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi [None req-fa36b20f-a618-4391-be32-7fd2a8c30a20 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-2061617706", "imageRef": "1e3c323d-d797-4e6d-bd9a-482d90084b0c", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=129321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 12:38:17.546516 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.network.neutron [None req-fa36b20f-a618-4391-be32-7fd2a8c30a20 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] validate_networks() for [('2f3dce3a-69e6-47f2-9db3-0b2713db2bee', None, None, None, None, None)] {{(pid=129321) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 26 12:38:17.552756 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.policy [None req-fc86c3de-f83e-4668-84a8-e724653277aa tempest-DeleteServersTestJSON-342872481 tempest-DeleteServersTestJSON-342872481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d19942e971b4d7fac3ab8f9a5ad6086', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0f340fa7ff24ca899b0f1036d0e6a3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129322) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:38:17.565487 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: INFO nova.api.openstack.requestlog [None req-fc86c3de-f83e-4668-84a8-e724653277aa tempest-DeleteServersTestJSON-342872481 tempest-DeleteServersTestJSON-342872481-project] 10.222.0.75 "GET /compute/v2.1/servers/10054724-aefc-4a9f-a212-14e5fc5a1672" status: 200 len: 1315 microversion: 2.1 time: 0.526883 May 26 12:38:17.580620 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: [pid: 129322|app: 0|req: 24/44] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 26 12:38:17 2022] GET /compute/v2.1/servers/10054724-aefc-4a9f-a212-14e5fc5a1672 => generated 1315 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:38:18.051094 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi [None req-525ffc41-500c-4d18-a39f-a8745d2a393d tempest-VolumesSnapshotsTestJSON-1240189566 tempest-VolumesSnapshotsTestJSON-1240189566-project] Calling method '.version_select at 0x7f83084bcb80>' {{(pid=129322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:38:18.144248 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: INFO nova.api.openstack.requestlog [None req-525ffc41-500c-4d18-a39f-a8745d2a393d tempest-VolumesSnapshotsTestJSON-1240189566 tempest-VolumesSnapshotsTestJSON-1240189566-project] 10.222.0.75 "GET /compute/v2.1/os-volumes/869ac730-f46c-427e-b24f-30760cc63c92" status: 200 len: 343 microversion: 2.1 time: 0.098338 May 26 12:38:18.145378 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: [pid: 129322|app: 0|req: 25/45] 10.222.0.75 () {58 vars in 1244 bytes} [Thu May 26 12:38:18 2022] GET /compute/v2.1/os-volumes/869ac730-f46c-427e-b24f-30760cc63c92 => generated 343 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 12:38:18.304704 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi [None req-4aee0f70-b407-4239-9e3b-dfb87ef568d8 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Calling method '>' {{(pid=129322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:38:18.309045 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.compute.api [None req-4aee0f70-b407-4239-9e3b-dfb87ef568d8 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] [instance: bf2f6303-22b9-4cfa-8d4d-61d2503bc554] Fetching instance by UUID {{(pid=129322) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:38:18.335416 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-4aee0f70-b407-4239-9e3b-dfb87ef568d8 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:38:18.340213 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-4aee0f70-b407-4239-9e3b-dfb87ef568d8 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:38:18.342733 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-4aee0f70-b407-4239-9e3b-dfb87ef568d8 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:38:18.343879 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-4aee0f70-b407-4239-9e3b-dfb87ef568d8 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:38:18.527243 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.policy [None req-4aee0f70-b407-4239-9e3b-dfb87ef568d8 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e811736979c44b02b14fecb74c6bd7ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675272fb40d4847819f83ec04afecef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129322) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:38:18.528659 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.virt.hardware [None req-fa36b20f-a618-4391-be32-7fd2a8c30a20 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Flavor limits 0:0:0 {{(pid=129321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 26 12:38:18.529185 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.virt.hardware [None req-fa36b20f-a618-4391-be32-7fd2a8c30a20 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Image limits 0:0:0 {{(pid=129321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 26 12:38:18.529539 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.virt.hardware [None req-fa36b20f-a618-4391-be32-7fd2a8c30a20 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Flavor pref 0:0:0 {{(pid=129321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 26 12:38:18.530114 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.virt.hardware [None req-fa36b20f-a618-4391-be32-7fd2a8c30a20 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Image pref 0:0:0 {{(pid=129321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 26 12:38:18.530689 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.virt.hardware [None req-fa36b20f-a618-4391-be32-7fd2a8c30a20 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 26 12:38:18.536777 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.policy [None req-4aee0f70-b407-4239-9e3b-dfb87ef568d8 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e811736979c44b02b14fecb74c6bd7ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675272fb40d4847819f83ec04afecef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129322) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:38:18.538396 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.policy [None req-4aee0f70-b407-4239-9e3b-dfb87ef568d8 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e811736979c44b02b14fecb74c6bd7ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675272fb40d4847819f83ec04afecef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129322) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:38:18.539798 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: INFO nova.api.openstack.requestlog [None req-4aee0f70-b407-4239-9e3b-dfb87ef568d8 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] 10.222.0.75 "GET /compute/v2.1/servers/bf2f6303-22b9-4cfa-8d4d-61d2503bc554" status: 200 len: 1286 microversion: 2.20 time: 0.239574 May 26 12:38:18.550365 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-fa36b20f-a618-4391-be32-7fd2a8c30a20 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:38:18.550365 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-fa36b20f-a618-4391-be32-7fd2a8c30a20 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:38:18.551646 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-fa36b20f-a618-4391-be32-7fd2a8c30a20 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:38:18.552426 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-fa36b20f-a618-4391-be32-7fd2a8c30a20 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:38:18.552865 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: [pid: 129322|app: 0|req: 26/46] 10.222.0.75 () {60 vars in 1276 bytes} [Thu May 26 12:38:18 2022] GET /compute/v2.1/servers/bf2f6303-22b9-4cfa-8d4d-61d2503bc554 => generated 1286 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 12:38:18.585109 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi [None req-8af7eee9-355b-4069-a173-ede185ae0583 tempest-DeleteServersTestJSON-342872481 tempest-DeleteServersTestJSON-342872481-project] Calling method '>' {{(pid=129322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:38:18.586119 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.compute.api [None req-8af7eee9-355b-4069-a173-ede185ae0583 tempest-DeleteServersTestJSON-342872481 tempest-DeleteServersTestJSON-342872481-project] [instance: 10054724-aefc-4a9f-a212-14e5fc5a1672] Fetching instance by UUID {{(pid=129322) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:38:18.593296 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-8af7eee9-355b-4069-a173-ede185ae0583 tempest-DeleteServersTestJSON-342872481 tempest-DeleteServersTestJSON-342872481-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:38:18.602848 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-8af7eee9-355b-4069-a173-ede185ae0583 tempest-DeleteServersTestJSON-342872481 tempest-DeleteServersTestJSON-342872481-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:38:18.606477 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-8af7eee9-355b-4069-a173-ede185ae0583 tempest-DeleteServersTestJSON-342872481 tempest-DeleteServersTestJSON-342872481-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:38:18.608531 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-8af7eee9-355b-4069-a173-ede185ae0583 tempest-DeleteServersTestJSON-342872481 tempest-DeleteServersTestJSON-342872481-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:38:18.620936 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.quota [None req-fa36b20f-a618-4391-be32-7fd2a8c30a20 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Getting quotas for project 9e36ab03283d4ce6a2fed5e111e03d34. Resources: {'instances', 'cores', 'ram'} {{(pid=129321) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 26 12:38:18.643154 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.quota [None req-fa36b20f-a618-4391-be32-7fd2a8c30a20 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Getting quotas for user 0431b1f25497443ba483b3c440669080 and project 9e36ab03283d4ce6a2fed5e111e03d34. Resources: {'instances', 'cores', 'ram'} {{(pid=129321) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 26 12:38:18.687829 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.compute.api [None req-fa36b20f-a618-4391-be32-7fd2a8c30a20 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Going to run 1 instances... {{(pid=129321) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 26 12:38:18.692414 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.compute.api [None req-fa36b20f-a618-4391-be32-7fd2a8c30a20 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] [instance: 605b9171-aa87-432a-b179-c552640e73dd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1e3c323d-d797-4e6d-bd9a-482d90084b0c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129321) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 26 12:38:18.825090 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: INFO nova.api.openstack.requestlog [None req-fa36b20f-a618-4391-be32-7fd2a8c30a20 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] 10.222.0.75 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.473867 May 26 12:38:18.827906 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: [pid: 129321|app: 0|req: 21/47] 10.222.0.75 () {60 vars in 1146 bytes} [Thu May 26 12:38:17 2022] POST /compute/v2.1/servers => generated 383 bytes in 1479 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) May 26 12:38:18.840109 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi [None req-5066df25-d06f-4613-ad77-90197adace72 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Calling method '>' {{(pid=129321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:38:18.842556 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.compute.api [None req-5066df25-d06f-4613-ad77-90197adace72 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] [instance: 605b9171-aa87-432a-b179-c552640e73dd] Fetching instance by UUID {{(pid=129321) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:38:18.930796 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.policy [None req-8af7eee9-355b-4069-a173-ede185ae0583 tempest-DeleteServersTestJSON-342872481 tempest-DeleteServersTestJSON-342872481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d19942e971b4d7fac3ab8f9a5ad6086', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0f340fa7ff24ca899b0f1036d0e6a3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129322) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:38:18.944960 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: INFO nova.api.openstack.requestlog [None req-8af7eee9-355b-4069-a173-ede185ae0583 tempest-DeleteServersTestJSON-342872481 tempest-DeleteServersTestJSON-342872481-project] 10.222.0.75 "GET /compute/v2.1/servers/10054724-aefc-4a9f-a212-14e5fc5a1672" status: 200 len: 1315 microversion: 2.1 time: 0.364169 May 26 12:38:18.946964 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: [pid: 129322|app: 0|req: 27/48] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 26 12:38:18 2022] GET /compute/v2.1/servers/10054724-aefc-4a9f-a212-14e5fc5a1672 => generated 1315 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:38:18.963087 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.policy [None req-5066df25-d06f-4613-ad77-90197adace72 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0431b1f25497443ba483b3c440669080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e36ab03283d4ce6a2fed5e111e03d34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129321) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:38:18.972494 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: INFO nova.api.openstack.requestlog [None req-5066df25-d06f-4613-ad77-90197adace72 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] 10.222.0.75 "GET /compute/v2.1/servers/605b9171-aa87-432a-b179-c552640e73dd" status: 200 len: 1222 microversion: 2.1 time: 0.138457 May 26 12:38:18.974071 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: [pid: 129321|app: 0|req: 22/49] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 26 12:38:18 2022] GET /compute/v2.1/servers/605b9171-aa87-432a-b179-c552640e73dd => generated 1222 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:38:19.158022 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi [None req-836a6fb8-d7b5-477a-bbc2-d8bb4baf6861 tempest-VolumesSnapshotsTestJSON-1240189566 tempest-VolumesSnapshotsTestJSON-1240189566-project] Calling method '.version_select at 0x7f830842f280>' {{(pid=129322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:38:19.262849 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: INFO nova.api.openstack.requestlog [None req-836a6fb8-d7b5-477a-bbc2-d8bb4baf6861 tempest-VolumesSnapshotsTestJSON-1240189566 tempest-VolumesSnapshotsTestJSON-1240189566-project] 10.222.0.75 "GET /compute/v2.1/os-volumes/869ac730-f46c-427e-b24f-30760cc63c92" status: 200 len: 343 microversion: 2.1 time: 0.108462 May 26 12:38:19.268637 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: [pid: 129322|app: 0|req: 28/50] 10.222.0.75 () {58 vars in 1244 bytes} [Thu May 26 12:38:19 2022] GET /compute/v2.1/os-volumes/869ac730-f46c-427e-b24f-30760cc63c92 => generated 343 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 26 12:38:19.570667 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi [None req-9b628c4c-17ec-452c-9f11-cb1477fae299 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Calling method '>' {{(pid=129321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:38:19.573070 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.compute.api [None req-9b628c4c-17ec-452c-9f11-cb1477fae299 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] [instance: bf2f6303-22b9-4cfa-8d4d-61d2503bc554] Fetching instance by UUID {{(pid=129321) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:38:19.593057 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-9b628c4c-17ec-452c-9f11-cb1477fae299 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:38:19.593840 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-9b628c4c-17ec-452c-9f11-cb1477fae299 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:38:19.595334 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-9b628c4c-17ec-452c-9f11-cb1477fae299 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:38:19.601903 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-9b628c4c-17ec-452c-9f11-cb1477fae299 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:38:19.786305 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.policy [None req-9b628c4c-17ec-452c-9f11-cb1477fae299 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e811736979c44b02b14fecb74c6bd7ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675272fb40d4847819f83ec04afecef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129321) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:38:19.806967 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.policy [None req-9b628c4c-17ec-452c-9f11-cb1477fae299 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e811736979c44b02b14fecb74c6bd7ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675272fb40d4847819f83ec04afecef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129321) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:38:19.808953 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.policy [None req-9b628c4c-17ec-452c-9f11-cb1477fae299 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e811736979c44b02b14fecb74c6bd7ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675272fb40d4847819f83ec04afecef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129321) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:38:19.810724 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: INFO nova.api.openstack.requestlog [None req-9b628c4c-17ec-452c-9f11-cb1477fae299 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] 10.222.0.75 "GET /compute/v2.1/servers/bf2f6303-22b9-4cfa-8d4d-61d2503bc554" status: 200 len: 1286 microversion: 2.20 time: 0.253399 May 26 12:38:19.822914 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: [pid: 129321|app: 0|req: 23/51] 10.222.0.75 () {60 vars in 1276 bytes} [Thu May 26 12:38:19 2022] GET /compute/v2.1/servers/bf2f6303-22b9-4cfa-8d4d-61d2503bc554 => generated 1286 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 12:38:19.969367 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi [None req-df1a9eea-0c14-4a2e-90d6-42d3d5b03aa0 tempest-DeleteServersTestJSON-342872481 tempest-DeleteServersTestJSON-342872481-project] Calling method '>' {{(pid=129322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:38:19.970339 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.compute.api [None req-df1a9eea-0c14-4a2e-90d6-42d3d5b03aa0 tempest-DeleteServersTestJSON-342872481 tempest-DeleteServersTestJSON-342872481-project] [instance: 10054724-aefc-4a9f-a212-14e5fc5a1672] Fetching instance by UUID {{(pid=129322) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:38:19.982087 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-df1a9eea-0c14-4a2e-90d6-42d3d5b03aa0 tempest-DeleteServersTestJSON-342872481 tempest-DeleteServersTestJSON-342872481-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:38:19.982873 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-df1a9eea-0c14-4a2e-90d6-42d3d5b03aa0 tempest-DeleteServersTestJSON-342872481 tempest-DeleteServersTestJSON-342872481-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:38:19.984385 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-df1a9eea-0c14-4a2e-90d6-42d3d5b03aa0 tempest-DeleteServersTestJSON-342872481 tempest-DeleteServersTestJSON-342872481-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:38:19.993304 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi [None req-97bfebd5-896e-46c9-a1b6-47d3ca72aa48 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Calling method '>' {{(pid=129321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:38:19.994552 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.compute.api [None req-97bfebd5-896e-46c9-a1b6-47d3ca72aa48 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] [instance: 605b9171-aa87-432a-b179-c552640e73dd] Fetching instance by UUID {{(pid=129321) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:38:19.998084 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-df1a9eea-0c14-4a2e-90d6-42d3d5b03aa0 tempest-DeleteServersTestJSON-342872481 tempest-DeleteServersTestJSON-342872481-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:38:20.008218 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-97bfebd5-896e-46c9-a1b6-47d3ca72aa48 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:38:20.009058 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-97bfebd5-896e-46c9-a1b6-47d3ca72aa48 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:38:20.011469 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-97bfebd5-896e-46c9-a1b6-47d3ca72aa48 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:38:20.012676 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-97bfebd5-896e-46c9-a1b6-47d3ca72aa48 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:38:20.205137 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.policy [None req-97bfebd5-896e-46c9-a1b6-47d3ca72aa48 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0431b1f25497443ba483b3c440669080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e36ab03283d4ce6a2fed5e111e03d34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129321) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:38:20.218678 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: INFO nova.api.openstack.requestlog [None req-97bfebd5-896e-46c9-a1b6-47d3ca72aa48 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] 10.222.0.75 "GET /compute/v2.1/servers/605b9171-aa87-432a-b179-c552640e73dd" status: 200 len: 1226 microversion: 2.1 time: 0.229180 May 26 12:38:20.219340 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: [pid: 129321|app: 0|req: 24/52] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 26 12:38:19 2022] GET /compute/v2.1/servers/605b9171-aa87-432a-b179-c552640e73dd => generated 1226 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 12:38:20.281920 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi [None req-deaf4790-64ad-4f43-92fb-7182970ac3cd tempest-VolumesSnapshotsTestJSON-1240189566 tempest-VolumesSnapshotsTestJSON-1240189566-project] Calling method '.version_select at 0x7f83094f9160>' {{(pid=129321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:38:20.305134 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.policy [None req-df1a9eea-0c14-4a2e-90d6-42d3d5b03aa0 tempest-DeleteServersTestJSON-342872481 tempest-DeleteServersTestJSON-342872481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d19942e971b4d7fac3ab8f9a5ad6086', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0f340fa7ff24ca899b0f1036d0e6a3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129322) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:38:20.316748 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: INFO nova.api.openstack.requestlog [None req-df1a9eea-0c14-4a2e-90d6-42d3d5b03aa0 tempest-DeleteServersTestJSON-342872481 tempest-DeleteServersTestJSON-342872481-project] 10.222.0.75 "GET /compute/v2.1/servers/10054724-aefc-4a9f-a212-14e5fc5a1672" status: 200 len: 1315 microversion: 2.1 time: 0.357868 May 26 12:38:20.319283 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: [pid: 129322|app: 0|req: 29/53] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 26 12:38:19 2022] GET /compute/v2.1/servers/10054724-aefc-4a9f-a212-14e5fc5a1672 => generated 1315 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:38:20.363811 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: INFO nova.api.openstack.requestlog [None req-deaf4790-64ad-4f43-92fb-7182970ac3cd tempest-VolumesSnapshotsTestJSON-1240189566 tempest-VolumesSnapshotsTestJSON-1240189566-project] 10.222.0.75 "GET /compute/v2.1/os-volumes/869ac730-f46c-427e-b24f-30760cc63c92" status: 200 len: 343 microversion: 2.1 time: 0.086269 May 26 12:38:20.369107 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: [pid: 129321|app: 0|req: 25/54] 10.222.0.75 () {58 vars in 1244 bytes} [Thu May 26 12:38:20 2022] GET /compute/v2.1/os-volumes/869ac730-f46c-427e-b24f-30760cc63c92 => generated 343 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 26 12:38:20.829493 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi [None req-36dab97f-80a9-4674-9f63-cd8fd82d1969 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Calling method '>' {{(pid=129322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:38:20.830112 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.compute.api [None req-36dab97f-80a9-4674-9f63-cd8fd82d1969 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] [instance: bf2f6303-22b9-4cfa-8d4d-61d2503bc554] Fetching instance by UUID {{(pid=129322) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:38:20.836628 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-36dab97f-80a9-4674-9f63-cd8fd82d1969 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:38:20.837324 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-36dab97f-80a9-4674-9f63-cd8fd82d1969 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:38:20.838138 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-36dab97f-80a9-4674-9f63-cd8fd82d1969 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:38:20.838555 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-36dab97f-80a9-4674-9f63-cd8fd82d1969 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:38:20.909127 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.policy [None req-36dab97f-80a9-4674-9f63-cd8fd82d1969 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e811736979c44b02b14fecb74c6bd7ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675272fb40d4847819f83ec04afecef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129322) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:38:20.924283 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.policy [None req-36dab97f-80a9-4674-9f63-cd8fd82d1969 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e811736979c44b02b14fecb74c6bd7ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675272fb40d4847819f83ec04afecef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129322) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:38:20.924283 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.policy [None req-36dab97f-80a9-4674-9f63-cd8fd82d1969 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e811736979c44b02b14fecb74c6bd7ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675272fb40d4847819f83ec04afecef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129322) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:38:20.924283 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: INFO nova.api.openstack.requestlog [None req-36dab97f-80a9-4674-9f63-cd8fd82d1969 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] 10.222.0.75 "GET /compute/v2.1/servers/bf2f6303-22b9-4cfa-8d4d-61d2503bc554" status: 200 len: 1286 microversion: 2.20 time: 0.098091 May 26 12:38:20.930968 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: [pid: 129322|app: 0|req: 30/55] 10.222.0.75 () {60 vars in 1276 bytes} [Thu May 26 12:38:20 2022] GET /compute/v2.1/servers/bf2f6303-22b9-4cfa-8d4d-61d2503bc554 => generated 1286 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 12:38:21.236540 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi [None req-e202040c-c3e3-4f09-a31e-1f3e9ca80a78 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Calling method '>' {{(pid=129321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:38:21.237289 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.compute.api [None req-e202040c-c3e3-4f09-a31e-1f3e9ca80a78 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] [instance: 605b9171-aa87-432a-b179-c552640e73dd] Fetching instance by UUID {{(pid=129321) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:38:21.244305 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-e202040c-c3e3-4f09-a31e-1f3e9ca80a78 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:38:21.244910 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-e202040c-c3e3-4f09-a31e-1f3e9ca80a78 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:38:21.245691 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-e202040c-c3e3-4f09-a31e-1f3e9ca80a78 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:38:21.246130 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-e202040c-c3e3-4f09-a31e-1f3e9ca80a78 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:38:21.332081 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.policy [None req-e202040c-c3e3-4f09-a31e-1f3e9ca80a78 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0431b1f25497443ba483b3c440669080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e36ab03283d4ce6a2fed5e111e03d34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129321) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:38:21.341457 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi [None req-ce6d36a5-9427-4146-a795-c934a0d6d5b2 tempest-DeleteServersTestJSON-342872481 tempest-DeleteServersTestJSON-342872481-project] Calling method '>' {{(pid=129322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:38:21.342203 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.compute.api [None req-ce6d36a5-9427-4146-a795-c934a0d6d5b2 tempest-DeleteServersTestJSON-342872481 tempest-DeleteServersTestJSON-342872481-project] [instance: 10054724-aefc-4a9f-a212-14e5fc5a1672] Fetching instance by UUID {{(pid=129322) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:38:21.346087 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: INFO nova.api.openstack.requestlog [None req-e202040c-c3e3-4f09-a31e-1f3e9ca80a78 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] 10.222.0.75 "GET /compute/v2.1/servers/605b9171-aa87-432a-b179-c552640e73dd" status: 200 len: 1226 microversion: 2.1 time: 0.114580 May 26 12:38:21.348657 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-ce6d36a5-9427-4146-a795-c934a0d6d5b2 tempest-DeleteServersTestJSON-342872481 tempest-DeleteServersTestJSON-342872481-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:38:21.351792 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-ce6d36a5-9427-4146-a795-c934a0d6d5b2 tempest-DeleteServersTestJSON-342872481 tempest-DeleteServersTestJSON-342872481-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:38:21.354652 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-ce6d36a5-9427-4146-a795-c934a0d6d5b2 tempest-DeleteServersTestJSON-342872481 tempest-DeleteServersTestJSON-342872481-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:38:21.356518 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: [pid: 129321|app: 0|req: 26/56] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 26 12:38:21 2022] GET /compute/v2.1/servers/605b9171-aa87-432a-b179-c552640e73dd => generated 1226 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:38:21.360298 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-ce6d36a5-9427-4146-a795-c934a0d6d5b2 tempest-DeleteServersTestJSON-342872481 tempest-DeleteServersTestJSON-342872481-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:38:21.377763 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi [None req-1f28da59-127b-49bf-8805-b8f33bb8970a tempest-VolumesSnapshotsTestJSON-1240189566 tempest-VolumesSnapshotsTestJSON-1240189566-project] Calling method '.version_select at 0x7f8308c9b790>' {{(pid=129321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:38:21.508504 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: INFO nova.api.openstack.requestlog [None req-1f28da59-127b-49bf-8805-b8f33bb8970a tempest-VolumesSnapshotsTestJSON-1240189566 tempest-VolumesSnapshotsTestJSON-1240189566-project] 10.222.0.75 "GET /compute/v2.1/os-volumes/869ac730-f46c-427e-b24f-30760cc63c92" status: 200 len: 343 microversion: 2.1 time: 0.125815 May 26 12:38:21.509322 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: [pid: 129321|app: 0|req: 27/57] 10.222.0.75 () {58 vars in 1244 bytes} [Thu May 26 12:38:21 2022] GET /compute/v2.1/os-volumes/869ac730-f46c-427e-b24f-30760cc63c92 => generated 343 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 26 12:38:21.671169 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.policy [None req-ce6d36a5-9427-4146-a795-c934a0d6d5b2 tempest-DeleteServersTestJSON-342872481 tempest-DeleteServersTestJSON-342872481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d19942e971b4d7fac3ab8f9a5ad6086', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0f340fa7ff24ca899b0f1036d0e6a3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129322) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:38:21.681896 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: INFO nova.api.openstack.requestlog [None req-ce6d36a5-9427-4146-a795-c934a0d6d5b2 tempest-DeleteServersTestJSON-342872481 tempest-DeleteServersTestJSON-342872481-project] 10.222.0.75 "GET /compute/v2.1/servers/10054724-aefc-4a9f-a212-14e5fc5a1672" status: 200 len: 1315 microversion: 2.1 time: 0.350223 May 26 12:38:21.682788 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: [pid: 129322|app: 0|req: 31/58] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 26 12:38:21 2022] GET /compute/v2.1/servers/10054724-aefc-4a9f-a212-14e5fc5a1672 => generated 1315 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:38:21.949630 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi [None req-b5f32d07-8ea8-49ec-8d3c-35c99672b1c0 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Calling method '>' {{(pid=129321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:38:21.950524 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.compute.api [None req-b5f32d07-8ea8-49ec-8d3c-35c99672b1c0 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] [instance: bf2f6303-22b9-4cfa-8d4d-61d2503bc554] Fetching instance by UUID {{(pid=129321) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:38:21.959275 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-b5f32d07-8ea8-49ec-8d3c-35c99672b1c0 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:38:21.964970 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-b5f32d07-8ea8-49ec-8d3c-35c99672b1c0 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:38:21.967027 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-b5f32d07-8ea8-49ec-8d3c-35c99672b1c0 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:38:21.967647 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-b5f32d07-8ea8-49ec-8d3c-35c99672b1c0 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:38:22.098039 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.policy [None req-b5f32d07-8ea8-49ec-8d3c-35c99672b1c0 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e811736979c44b02b14fecb74c6bd7ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675272fb40d4847819f83ec04afecef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129321) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:38:22.111080 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.policy [None req-b5f32d07-8ea8-49ec-8d3c-35c99672b1c0 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e811736979c44b02b14fecb74c6bd7ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675272fb40d4847819f83ec04afecef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129321) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:38:22.113040 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.policy [None req-b5f32d07-8ea8-49ec-8d3c-35c99672b1c0 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e811736979c44b02b14fecb74c6bd7ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675272fb40d4847819f83ec04afecef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129321) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:38:22.114218 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: INFO nova.api.openstack.requestlog [None req-b5f32d07-8ea8-49ec-8d3c-35c99672b1c0 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] 10.222.0.75 "GET /compute/v2.1/servers/bf2f6303-22b9-4cfa-8d4d-61d2503bc554" status: 200 len: 1286 microversion: 2.20 time: 0.176611 May 26 12:38:22.115413 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: [pid: 129321|app: 0|req: 28/59] 10.222.0.75 () {60 vars in 1276 bytes} [Thu May 26 12:38:21 2022] GET /compute/v2.1/servers/bf2f6303-22b9-4cfa-8d4d-61d2503bc554 => generated 1286 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 12:38:22.364436 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi [None req-4c065be0-b548-431b-a559-5b67e8ec372c tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Calling method '>' {{(pid=129322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:38:22.365080 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.compute.api [None req-4c065be0-b548-431b-a559-5b67e8ec372c tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] [instance: 605b9171-aa87-432a-b179-c552640e73dd] Fetching instance by UUID {{(pid=129322) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:38:22.376633 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-4c065be0-b548-431b-a559-5b67e8ec372c tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:38:22.377059 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-4c065be0-b548-431b-a559-5b67e8ec372c tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:38:22.377894 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-4c065be0-b548-431b-a559-5b67e8ec372c tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:38:22.380586 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-4c065be0-b548-431b-a559-5b67e8ec372c tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:38:22.481623 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.policy [None req-4c065be0-b548-431b-a559-5b67e8ec372c tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0431b1f25497443ba483b3c440669080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e36ab03283d4ce6a2fed5e111e03d34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129322) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:38:22.495363 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: INFO nova.api.openstack.requestlog [None req-4c065be0-b548-431b-a559-5b67e8ec372c tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] 10.222.0.75 "GET /compute/v2.1/servers/605b9171-aa87-432a-b179-c552640e73dd" status: 200 len: 1226 microversion: 2.1 time: 0.135663 May 26 12:38:22.496017 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: [pid: 129322|app: 0|req: 32/60] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 26 12:38:22 2022] GET /compute/v2.1/servers/605b9171-aa87-432a-b179-c552640e73dd => generated 1226 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:38:22.521584 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi [None req-3ddc371d-447d-4714-ae89-230fd39fd49a tempest-VolumesSnapshotsTestJSON-1240189566 tempest-VolumesSnapshotsTestJSON-1240189566-project] Calling method '.version_select at 0x7f8308c9b310>' {{(pid=129321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:38:22.588594 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: INFO nova.api.openstack.wsgi [None req-3ddc371d-447d-4714-ae89-230fd39fd49a tempest-VolumesSnapshotsTestJSON-1240189566 tempest-VolumesSnapshotsTestJSON-1240189566-project] HTTP exception thrown: Volume 869ac730-f46c-427e-b24f-30760cc63c92 could not be found. May 26 12:38:22.592792 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi [None req-3ddc371d-447d-4714-ae89-230fd39fd49a tempest-VolumesSnapshotsTestJSON-1240189566 tempest-VolumesSnapshotsTestJSON-1240189566-project] Request method failure captured: May 26 12:38:22.592792 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: request: GET /compute/v2.1/os-volumes/869ac730-f46c-427e-b24f-30760cc63c92 HTTP/1.1 May 26 12:38:22.592792 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: Accept: application/json May 26 12:38:22.592792 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: Accept-Encoding: identity May 26 12:38:22.592792 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: Connection: close May 26 12:38:22.592792 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: Content-Length: 0 May 26 12:38:22.592792 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: Content-Type: application/json May 26 12:38:22.592792 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: Host: 10.222.0.75 May 26 12:38:22.592792 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: Openstack-System-Scope: None May 26 12:38:22.592792 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: User-Agent: python-urllib3/1.26.9 May 26 12:38:22.592792 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: X-Auth-Token: gAAAAABij3SpVeXhwuAO00EXkto8UiM45W0nXTBfLoQHCHc2ndKYLkMUT1jpbtoGURuEVOu46zkuNuJg3h0cyy-lQOvbMX1pSAorNbss0KbnDIpvZnmjBuK5NnmtlOMnBVSIg1YaJn8PANjEMvTtiMYegVvF98PhfFfIfmdn9s3xlwDzbTRK6pI May 26 12:38:22.592792 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: X-Domain-Id: None May 26 12:38:22.592792 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: X-Domain-Name: None May 26 12:38:22.592792 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: X-Identity-Status: Confirmed May 26 12:38:22.592792 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: X-Is-Admin-Project: True May 26 12:38:22.592792 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: X-Project-Domain-Id: default May 26 12:38:22.592792 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: X-Project-Domain-Name: Default May 26 12:38:22.592792 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: X-Project-Id: 782a2f5efd3f44b0ba01b2a22d3702f8 May 26 12:38:22.592792 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1240189566 May 26 12:38:22.592792 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: X-Role: member,reader May 26 12:38:22.592792 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: X-Roles: member,reader May 26 12:38:22.594142 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/782a2f5efd3f44b0ba01b2a22d3702f8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.75:8080", "publicURL": "http://10.222.0.75:8080/v1/AUTH_782a2f5efd3f44b0ba01b2a22d3702f8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2/782a2f5efd3f44b0ba01b2a22d3702f8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/782a2f5efd3f44b0ba01b2a22d3702f8"}]}] May 26 12:38:22.594142 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1240189566 May 26 12:38:22.594142 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: X-Tenant-Id: 782a2f5efd3f44b0ba01b2a22d3702f8 May 26 12:38:22.594142 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1240189566 May 26 12:38:22.594142 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: X-User: tempest-VolumesSnapshotsTestJSON-1240189566-project May 26 12:38:22.594142 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: X-User-Domain-Id: default May 26 12:38:22.594142 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: X-User-Domain-Name: Default May 26 12:38:22.594142 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: X-User-Id: fbd43b05f56b43b4a04d3b6caba1b828 May 26 12:38:22.594142 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1240189566-project May 26 12:38:22.594142 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: method: May 26 12:38:22.594142 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: exception: Volume 869ac730-f46c-427e-b24f-30760cc63c92 could not be found. May 26 12:38:22.594142 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: action_args: {'id': '869ac730-f46c-427e-b24f-30760cc63c92'} May 26 12:38:22.594142 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: {{(pid=129321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 12:38:22.595073 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 12:38:22.595073 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 26 12:38:22.595073 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 26 12:38:22.595073 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 26 12:38:22.595073 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi item = cinderclient( May 26 12:38:22.595073 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 26 12:38:22.595073 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 26 12:38:22.595073 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 26 12:38:22.595073 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 26 12:38:22.595073 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 26 12:38:22.595073 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 26 12:38:22.595073 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 26 12:38:22.595073 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 26 12:38:22.595073 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 26 12:38:22.595073 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 26 12:38:22.595073 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 869ac730-f46c-427e-b24f-30760cc63c92 could not be found. (HTTP 404) (Request-ID: req-3e2e7210-5063-4ca7-a58a-11bd413dfe72) May 26 12:38:22.595073 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi May 26 12:38:22.595073 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 12:38:22.595073 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi May 26 12:38:22.596151 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 12:38:22.596151 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show May 26 12:38:22.596151 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) May 26 12:38:22.596151 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 26 12:38:22.596151 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 26 12:38:22.596151 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 26 12:38:22.596151 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 26 12:38:22.596151 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 26 12:38:22.596151 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 26 12:38:22.596151 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 26 12:38:22.596151 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 26 12:38:22.596151 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 26 12:38:22.596151 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi item = cinderclient( May 26 12:38:22.596151 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 26 12:38:22.596151 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 26 12:38:22.596151 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 26 12:38:22.596151 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 26 12:38:22.596151 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 26 12:38:22.596151 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 26 12:38:22.597072 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 26 12:38:22.597072 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 26 12:38:22.597072 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 26 12:38:22.597072 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 26 12:38:22.597072 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 869ac730-f46c-427e-b24f-30760cc63c92 could not be found. May 26 12:38:22.597072 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi May 26 12:38:22.597072 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 12:38:22.597072 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi May 26 12:38:22.597072 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 12:38:22.597072 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 12:38:22.597072 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 12:38:22.597072 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 12:38:22.597072 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 12:38:22.597072 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 26 12:38:22.597072 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 26 12:38:22.597072 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 12:38:22.597072 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 12:38:22.597072 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show May 26 12:38:22.597072 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 12:38:22.598271 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 869ac730-f46c-427e-b24f-30760cc63c92 could not be found. May 26 12:38:22.598271 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi May 26 12:38:22.598271 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 12:38:22.598271 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi May 26 12:38:22.598271 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 12:38:22.598271 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 12:38:22.598271 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 12:38:22.598271 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 12:38:22.598271 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 12:38:22.598271 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 869ac730-f46c-427e-b24f-30760cc63c92 could not be found. May 26 12:38:22.598271 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi May 26 12:38:22.598271 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi [None req-3ddc371d-447d-4714-ae89-230fd39fd49a tempest-VolumesSnapshotsTestJSON-1240189566 tempest-VolumesSnapshotsTestJSON-1240189566-project] Returning 404 to user: Volume 869ac730-f46c-427e-b24f-30760cc63c92 could not be found. {{(pid=129321) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 12:38:22.598271 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: INFO nova.api.openstack.requestlog [None req-3ddc371d-447d-4714-ae89-230fd39fd49a tempest-VolumesSnapshotsTestJSON-1240189566 tempest-VolumesSnapshotsTestJSON-1240189566-project] 10.222.0.75 "GET /compute/v2.1/os-volumes/869ac730-f46c-427e-b24f-30760cc63c92" status: 404 len: 109 microversion: 2.1 time: 0.076897 May 26 12:38:22.598271 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: [pid: 129321|app: 0|req: 29/61] 10.222.0.75 () {58 vars in 1244 bytes} [Thu May 26 12:38:22 2022] GET /compute/v2.1/os-volumes/869ac730-f46c-427e-b24f-30760cc63c92 => generated 109 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 26 12:38:22.618120 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi [None req-c734d1f4-ddf2-40bc-997c-3d8056d4d097 tempest-VolumesSnapshotsTestJSON-1240189566 tempest-VolumesSnapshotsTestJSON-1240189566-project] Calling method '.version_select at 0x7f83084bc940>' {{(pid=129322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:38:22.701920 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi [None req-0272564b-3814-4bf0-b2ff-3683f17919a3 tempest-DeleteServersTestJSON-342872481 tempest-DeleteServersTestJSON-342872481-project] Calling method '>' {{(pid=129321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:38:22.702804 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.compute.api [None req-0272564b-3814-4bf0-b2ff-3683f17919a3 tempest-DeleteServersTestJSON-342872481 tempest-DeleteServersTestJSON-342872481-project] [instance: 10054724-aefc-4a9f-a212-14e5fc5a1672] Fetching instance by UUID {{(pid=129321) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:38:22.709837 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-0272564b-3814-4bf0-b2ff-3683f17919a3 tempest-DeleteServersTestJSON-342872481 tempest-DeleteServersTestJSON-342872481-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:38:22.710417 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-0272564b-3814-4bf0-b2ff-3683f17919a3 tempest-DeleteServersTestJSON-342872481 tempest-DeleteServersTestJSON-342872481-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:38:22.711421 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-0272564b-3814-4bf0-b2ff-3683f17919a3 tempest-DeleteServersTestJSON-342872481 tempest-DeleteServersTestJSON-342872481-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:38:22.712109 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-0272564b-3814-4bf0-b2ff-3683f17919a3 tempest-DeleteServersTestJSON-342872481 tempest-DeleteServersTestJSON-342872481-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:38:22.770711 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: INFO nova.api.openstack.wsgi [None req-c734d1f4-ddf2-40bc-997c-3d8056d4d097 tempest-VolumesSnapshotsTestJSON-1240189566 tempest-VolumesSnapshotsTestJSON-1240189566-project] HTTP exception thrown: Volume 869ac730-f46c-427e-b24f-30760cc63c92 could not be found. May 26 12:38:22.772822 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi [None req-c734d1f4-ddf2-40bc-997c-3d8056d4d097 tempest-VolumesSnapshotsTestJSON-1240189566 tempest-VolumesSnapshotsTestJSON-1240189566-project] Request method failure captured: May 26 12:38:22.772822 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: request: DELETE /compute/v2.1/os-volumes/869ac730-f46c-427e-b24f-30760cc63c92 HTTP/1.1 May 26 12:38:22.772822 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: Accept: application/json May 26 12:38:22.772822 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: Accept-Encoding: identity May 26 12:38:22.772822 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: Connection: close May 26 12:38:22.772822 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: Content-Length: 0 May 26 12:38:22.772822 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: Content-Type: application/json May 26 12:38:22.772822 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: Host: 10.222.0.75 May 26 12:38:22.772822 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: Openstack-System-Scope: None May 26 12:38:22.772822 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: User-Agent: python-urllib3/1.26.9 May 26 12:38:22.772822 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: X-Auth-Token: gAAAAABij3SpVeXhwuAO00EXkto8UiM45W0nXTBfLoQHCHc2ndKYLkMUT1jpbtoGURuEVOu46zkuNuJg3h0cyy-lQOvbMX1pSAorNbss0KbnDIpvZnmjBuK5NnmtlOMnBVSIg1YaJn8PANjEMvTtiMYegVvF98PhfFfIfmdn9s3xlwDzbTRK6pI May 26 12:38:22.772822 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: X-Domain-Id: None May 26 12:38:22.772822 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: X-Domain-Name: None May 26 12:38:22.772822 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: X-Identity-Status: Confirmed May 26 12:38:22.772822 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: X-Is-Admin-Project: True May 26 12:38:22.772822 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: X-Project-Domain-Id: default May 26 12:38:22.772822 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: X-Project-Domain-Name: Default May 26 12:38:22.772822 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: X-Project-Id: 782a2f5efd3f44b0ba01b2a22d3702f8 May 26 12:38:22.772822 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1240189566 May 26 12:38:22.772822 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: X-Role: member,reader May 26 12:38:22.772822 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: X-Roles: member,reader May 26 12:38:22.774568 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/782a2f5efd3f44b0ba01b2a22d3702f8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.75:8080", "publicURL": "http://10.222.0.75:8080/v1/AUTH_782a2f5efd3f44b0ba01b2a22d3702f8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2/782a2f5efd3f44b0ba01b2a22d3702f8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/782a2f5efd3f44b0ba01b2a22d3702f8"}]}] May 26 12:38:22.774568 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1240189566 May 26 12:38:22.774568 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: X-Tenant-Id: 782a2f5efd3f44b0ba01b2a22d3702f8 May 26 12:38:22.774568 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1240189566 May 26 12:38:22.774568 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: X-User: tempest-VolumesSnapshotsTestJSON-1240189566-project May 26 12:38:22.774568 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: X-User-Domain-Id: default May 26 12:38:22.774568 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: X-User-Domain-Name: Default May 26 12:38:22.774568 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: X-User-Id: fbd43b05f56b43b4a04d3b6caba1b828 May 26 12:38:22.774568 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1240189566-project May 26 12:38:22.774568 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: method: May 26 12:38:22.774568 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: exception: Volume 869ac730-f46c-427e-b24f-30760cc63c92 could not be found. May 26 12:38:22.774568 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: action_args: {'id': '869ac730-f46c-427e-b24f-30760cc63c92'} May 26 12:38:22.774568 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: {{(pid=129322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 12:38:22.778490 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 12:38:22.778490 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 26 12:38:22.778490 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 26 12:38:22.778490 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete May 26 12:38:22.778490 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) May 26 12:38:22.778490 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete May 26 12:38:22.778490 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi return self._delete(loc) May 26 12:38:22.778490 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete May 26 12:38:22.778490 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) May 26 12:38:22.778490 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete May 26 12:38:22.778490 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) May 26 12:38:22.778490 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 26 12:38:22.778490 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 26 12:38:22.778490 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 26 12:38:22.778490 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 26 12:38:22.778490 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 869ac730-f46c-427e-b24f-30760cc63c92 could not be found. (HTTP 404) (Request-ID: req-755d8065-8df9-4319-b0c0-ea72b24dd60b) May 26 12:38:22.778490 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi May 26 12:38:22.778490 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 12:38:22.778490 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi May 26 12:38:22.779649 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 12:38:22.779649 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete May 26 12:38:22.779649 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) May 26 12:38:22.779649 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 26 12:38:22.779649 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 26 12:38:22.779649 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 26 12:38:22.779649 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 26 12:38:22.779649 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 26 12:38:22.779649 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 26 12:38:22.779649 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 26 12:38:22.779649 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 26 12:38:22.779649 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete May 26 12:38:22.779649 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) May 26 12:38:22.779649 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete May 26 12:38:22.779649 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi return self._delete(loc) May 26 12:38:22.779649 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete May 26 12:38:22.779649 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) May 26 12:38:22.779649 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete May 26 12:38:22.779649 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) May 26 12:38:22.780702 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 26 12:38:22.780702 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 26 12:38:22.780702 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 26 12:38:22.780702 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 26 12:38:22.780702 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 869ac730-f46c-427e-b24f-30760cc63c92 could not be found. May 26 12:38:22.780702 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi May 26 12:38:22.780702 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 12:38:22.780702 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi May 26 12:38:22.780702 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 12:38:22.780702 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 12:38:22.780702 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 12:38:22.780702 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 12:38:22.780702 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 12:38:22.780702 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 26 12:38:22.780702 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 26 12:38:22.780702 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 12:38:22.780702 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 12:38:22.780702 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete May 26 12:38:22.780702 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 12:38:22.781865 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 869ac730-f46c-427e-b24f-30760cc63c92 could not be found. May 26 12:38:22.781865 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi May 26 12:38:22.781865 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 12:38:22.781865 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi May 26 12:38:22.781865 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 12:38:22.781865 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 12:38:22.781865 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 12:38:22.781865 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 12:38:22.781865 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 12:38:22.781865 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 869ac730-f46c-427e-b24f-30760cc63c92 could not be found. May 26 12:38:22.781865 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi May 26 12:38:22.781865 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi [None req-c734d1f4-ddf2-40bc-997c-3d8056d4d097 tempest-VolumesSnapshotsTestJSON-1240189566 tempest-VolumesSnapshotsTestJSON-1240189566-project] Returning 404 to user: Volume 869ac730-f46c-427e-b24f-30760cc63c92 could not be found. {{(pid=129322) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 12:38:22.781865 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: INFO nova.api.openstack.requestlog [None req-c734d1f4-ddf2-40bc-997c-3d8056d4d097 tempest-VolumesSnapshotsTestJSON-1240189566 tempest-VolumesSnapshotsTestJSON-1240189566-project] 10.222.0.75 "DELETE /compute/v2.1/os-volumes/869ac730-f46c-427e-b24f-30760cc63c92" status: 404 len: 109 microversion: 2.1 time: 0.169566 May 26 12:38:22.781865 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: [pid: 129322|app: 0|req: 33/62] 10.222.0.75 () {58 vars in 1247 bytes} [Thu May 26 12:38:22 2022] DELETE /compute/v2.1/os-volumes/869ac730-f46c-427e-b24f-30760cc63c92 => generated 109 bytes in 171 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 26 12:38:22.786337 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi [None req-e65f1fb4-fa00-4334-ac97-a1f78bf263c9 tempest-VolumesTestJSON-2014170337 tempest-VolumesTestJSON-2014170337-project] Calling method '.version_select at 0x7f830842f4c0>' {{(pid=129322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:38:22.858060 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: INFO nova.api.openstack.requestlog [None req-e65f1fb4-fa00-4334-ac97-a1f78bf263c9 tempest-VolumesTestJSON-2014170337 tempest-VolumesTestJSON-2014170337-project] 10.222.0.75 "GET /compute/v2.1/os-volumes/bb408b44-b05b-458a-a67a-66e6d124892a" status: 200 len: 351 microversion: 2.1 time: 0.081810 May 26 12:38:22.859602 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: [pid: 129322|app: 0|req: 34/63] 10.222.0.75 () {58 vars in 1244 bytes} [Thu May 26 12:38:22 2022] GET /compute/v2.1/os-volumes/bb408b44-b05b-458a-a67a-66e6d124892a => generated 351 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 12:38:22.868505 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi [None req-2a85ec95-0834-460d-bb51-b95d2d98032d tempest-VolumesSnapshotsTestJSON-1240189566 tempest-VolumesSnapshotsTestJSON-1240189566-project] Calling method '.version_select at 0x7f8308456310>' {{(pid=129322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:38:22.913289 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: INFO nova.api.openstack.wsgi [None req-2a85ec95-0834-460d-bb51-b95d2d98032d tempest-VolumesSnapshotsTestJSON-1240189566 tempest-VolumesSnapshotsTestJSON-1240189566-project] HTTP exception thrown: Volume 869ac730-f46c-427e-b24f-30760cc63c92 could not be found. May 26 12:38:22.916265 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi [None req-2a85ec95-0834-460d-bb51-b95d2d98032d tempest-VolumesSnapshotsTestJSON-1240189566 tempest-VolumesSnapshotsTestJSON-1240189566-project] Request method failure captured: May 26 12:38:22.916265 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: request: GET /compute/v2.1/os-volumes/869ac730-f46c-427e-b24f-30760cc63c92 HTTP/1.1 May 26 12:38:22.916265 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: Accept: application/json May 26 12:38:22.916265 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: Accept-Encoding: identity May 26 12:38:22.916265 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: Connection: close May 26 12:38:22.916265 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: Content-Length: 0 May 26 12:38:22.916265 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: Content-Type: application/json May 26 12:38:22.916265 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: Host: 10.222.0.75 May 26 12:38:22.916265 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: Openstack-System-Scope: None May 26 12:38:22.916265 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: User-Agent: python-urllib3/1.26.9 May 26 12:38:22.916265 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: X-Auth-Token: gAAAAABij3SpVeXhwuAO00EXkto8UiM45W0nXTBfLoQHCHc2ndKYLkMUT1jpbtoGURuEVOu46zkuNuJg3h0cyy-lQOvbMX1pSAorNbss0KbnDIpvZnmjBuK5NnmtlOMnBVSIg1YaJn8PANjEMvTtiMYegVvF98PhfFfIfmdn9s3xlwDzbTRK6pI May 26 12:38:22.916265 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: X-Domain-Id: None May 26 12:38:22.916265 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: X-Domain-Name: None May 26 12:38:22.916265 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: X-Identity-Status: Confirmed May 26 12:38:22.916265 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: X-Is-Admin-Project: True May 26 12:38:22.916265 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: X-Project-Domain-Id: default May 26 12:38:22.916265 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: X-Project-Domain-Name: Default May 26 12:38:22.916265 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: X-Project-Id: 782a2f5efd3f44b0ba01b2a22d3702f8 May 26 12:38:22.916265 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1240189566 May 26 12:38:22.916265 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: X-Role: member,reader May 26 12:38:22.916265 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: X-Roles: member,reader May 26 12:38:22.918039 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/782a2f5efd3f44b0ba01b2a22d3702f8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.75:8080", "publicURL": "http://10.222.0.75:8080/v1/AUTH_782a2f5efd3f44b0ba01b2a22d3702f8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2/782a2f5efd3f44b0ba01b2a22d3702f8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/782a2f5efd3f44b0ba01b2a22d3702f8"}]}] May 26 12:38:22.918039 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1240189566 May 26 12:38:22.918039 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: X-Tenant-Id: 782a2f5efd3f44b0ba01b2a22d3702f8 May 26 12:38:22.918039 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1240189566 May 26 12:38:22.918039 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: X-User: tempest-VolumesSnapshotsTestJSON-1240189566-project May 26 12:38:22.918039 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: X-User-Domain-Id: default May 26 12:38:22.918039 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: X-User-Domain-Name: Default May 26 12:38:22.918039 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: X-User-Id: fbd43b05f56b43b4a04d3b6caba1b828 May 26 12:38:22.918039 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1240189566-project May 26 12:38:22.918039 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: method: May 26 12:38:22.918039 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: exception: Volume 869ac730-f46c-427e-b24f-30760cc63c92 could not be found. May 26 12:38:22.918039 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: action_args: {'id': '869ac730-f46c-427e-b24f-30760cc63c92'} May 26 12:38:22.918039 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: {{(pid=129322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 12:38:22.919116 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 12:38:22.919116 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 26 12:38:22.919116 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 26 12:38:22.919116 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 26 12:38:22.919116 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi item = cinderclient( May 26 12:38:22.919116 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 26 12:38:22.919116 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 26 12:38:22.919116 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 26 12:38:22.919116 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 26 12:38:22.919116 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 26 12:38:22.919116 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 26 12:38:22.919116 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 26 12:38:22.919116 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 26 12:38:22.919116 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 26 12:38:22.919116 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 26 12:38:22.919116 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 869ac730-f46c-427e-b24f-30760cc63c92 could not be found. (HTTP 404) (Request-ID: req-94ebf502-deea-4dfb-86d8-248ec9a1d566) May 26 12:38:22.919116 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi May 26 12:38:22.919116 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 12:38:22.919116 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi May 26 12:38:22.920523 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 12:38:22.920523 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show May 26 12:38:22.920523 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) May 26 12:38:22.920523 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 26 12:38:22.920523 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 26 12:38:22.920523 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 26 12:38:22.920523 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 26 12:38:22.920523 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 26 12:38:22.920523 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 26 12:38:22.920523 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 26 12:38:22.920523 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 26 12:38:22.920523 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 26 12:38:22.920523 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi item = cinderclient( May 26 12:38:22.920523 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 26 12:38:22.920523 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 26 12:38:22.920523 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 26 12:38:22.920523 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 26 12:38:22.920523 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 26 12:38:22.920523 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 26 12:38:22.922491 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 26 12:38:22.922491 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 26 12:38:22.922491 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 26 12:38:22.922491 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 26 12:38:22.922491 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 869ac730-f46c-427e-b24f-30760cc63c92 could not be found. May 26 12:38:22.922491 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi May 26 12:38:22.922491 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 12:38:22.922491 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi May 26 12:38:22.922491 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 12:38:22.922491 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 12:38:22.922491 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 12:38:22.922491 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 12:38:22.922491 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 12:38:22.922491 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 26 12:38:22.922491 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 26 12:38:22.922491 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 12:38:22.922491 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 12:38:22.922491 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show May 26 12:38:22.922491 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 12:38:22.924676 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 869ac730-f46c-427e-b24f-30760cc63c92 could not be found. May 26 12:38:22.924676 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi May 26 12:38:22.924676 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 12:38:22.924676 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi May 26 12:38:22.924676 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 12:38:22.924676 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 12:38:22.924676 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 12:38:22.924676 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 12:38:22.924676 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 12:38:22.924676 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 869ac730-f46c-427e-b24f-30760cc63c92 could not be found. May 26 12:38:22.924676 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi May 26 12:38:22.927062 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi [None req-2a85ec95-0834-460d-bb51-b95d2d98032d tempest-VolumesSnapshotsTestJSON-1240189566 tempest-VolumesSnapshotsTestJSON-1240189566-project] Returning 404 to user: Volume 869ac730-f46c-427e-b24f-30760cc63c92 could not be found. {{(pid=129322) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 12:38:22.928250 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: INFO nova.api.openstack.requestlog [None req-2a85ec95-0834-460d-bb51-b95d2d98032d tempest-VolumesSnapshotsTestJSON-1240189566 tempest-VolumesSnapshotsTestJSON-1240189566-project] 10.222.0.75 "GET /compute/v2.1/os-volumes/869ac730-f46c-427e-b24f-30760cc63c92" status: 404 len: 109 microversion: 2.1 time: 0.067353 May 26 12:38:22.929676 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: [pid: 129322|app: 0|req: 35/64] 10.222.0.75 () {58 vars in 1244 bytes} [Thu May 26 12:38:22 2022] GET /compute/v2.1/os-volumes/869ac730-f46c-427e-b24f-30760cc63c92 => generated 109 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 26 12:38:22.935266 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi [None req-76c15f6c-d8eb-440c-b62d-121ba41c7ee0 tempest-VolumesTestJSON-2014170337 tempest-VolumesTestJSON-2014170337-project] Calling method '.version_select at 0x7f83084bc3a0>' {{(pid=129322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:38:23.012039 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.policy [None req-0272564b-3814-4bf0-b2ff-3683f17919a3 tempest-DeleteServersTestJSON-342872481 tempest-DeleteServersTestJSON-342872481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d19942e971b4d7fac3ab8f9a5ad6086', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0f340fa7ff24ca899b0f1036d0e6a3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129321) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:38:23.033364 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: INFO nova.api.openstack.requestlog [None req-0272564b-3814-4bf0-b2ff-3683f17919a3 tempest-DeleteServersTestJSON-342872481 tempest-DeleteServersTestJSON-342872481-project] 10.222.0.75 "GET /compute/v2.1/servers/10054724-aefc-4a9f-a212-14e5fc5a1672" status: 200 len: 1315 microversion: 2.1 time: 0.335887 May 26 12:38:23.036173 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: [pid: 129321|app: 0|req: 30/65] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 26 12:38:22 2022] GET /compute/v2.1/servers/10054724-aefc-4a9f-a212-14e5fc5a1672 => generated 1315 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:38:23.061132 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: INFO nova.api.openstack.requestlog [None req-76c15f6c-d8eb-440c-b62d-121ba41c7ee0 tempest-VolumesTestJSON-2014170337 tempest-VolumesTestJSON-2014170337-project] 10.222.0.75 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.130048 May 26 12:38:23.061990 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: [pid: 129322|app: 0|req: 36/66] 10.222.0.75 () {58 vars in 1133 bytes} [Thu May 26 12:38:22 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:38:23.081504 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi [None req-d0bc5c73-a39d-44f5-81b9-ac554c303200 tempest-VolumesTestJSON-2014170337 tempest-VolumesTestJSON-2014170337-project] Calling method '.version_select at 0x7f8309e095e0>' {{(pid=129321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:38:23.138835 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi [None req-8f3f728f-b3cd-46ab-8e99-98738398eb84 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Calling method '>' {{(pid=129322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:38:23.139763 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.compute.api [None req-8f3f728f-b3cd-46ab-8e99-98738398eb84 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] [instance: bf2f6303-22b9-4cfa-8d4d-61d2503bc554] Fetching instance by UUID {{(pid=129322) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:38:23.155873 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-8f3f728f-b3cd-46ab-8e99-98738398eb84 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:38:23.157661 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-8f3f728f-b3cd-46ab-8e99-98738398eb84 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:38:23.159884 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-8f3f728f-b3cd-46ab-8e99-98738398eb84 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:38:23.161648 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-8f3f728f-b3cd-46ab-8e99-98738398eb84 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:38:23.240689 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: INFO nova.api.openstack.requestlog [None req-d0bc5c73-a39d-44f5-81b9-ac554c303200 tempest-VolumesTestJSON-2014170337 tempest-VolumesTestJSON-2014170337-project] 10.222.0.75 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.165123 May 26 12:38:23.247658 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: [pid: 129321|app: 0|req: 31/67] 10.222.0.75 () {58 vars in 1148 bytes} [Thu May 26 12:38:23 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 694 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 12:38:23.257187 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi [None req-8ebdb2e4-010b-466e-9e09-5074d29f2f8b tempest-VolumesTestJSON-2014170337 tempest-VolumesTestJSON-2014170337-project] Calling method '.version_select at 0x7f8308c188b0>' {{(pid=129321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:38:23.272517 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.policy [None req-8f3f728f-b3cd-46ab-8e99-98738398eb84 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e811736979c44b02b14fecb74c6bd7ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675272fb40d4847819f83ec04afecef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129322) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:38:23.284723 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.policy [None req-8f3f728f-b3cd-46ab-8e99-98738398eb84 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e811736979c44b02b14fecb74c6bd7ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675272fb40d4847819f83ec04afecef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129322) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:38:23.287160 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.policy [None req-8f3f728f-b3cd-46ab-8e99-98738398eb84 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e811736979c44b02b14fecb74c6bd7ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675272fb40d4847819f83ec04afecef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129322) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:38:23.288891 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: INFO nova.api.openstack.requestlog [None req-8f3f728f-b3cd-46ab-8e99-98738398eb84 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] 10.222.0.75 "GET /compute/v2.1/servers/bf2f6303-22b9-4cfa-8d4d-61d2503bc554" status: 200 len: 1286 microversion: 2.20 time: 0.158990 May 26 12:38:23.291178 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: [pid: 129322|app: 0|req: 37/68] 10.222.0.75 () {60 vars in 1276 bytes} [Thu May 26 12:38:23 2022] GET /compute/v2.1/servers/bf2f6303-22b9-4cfa-8d4d-61d2503bc554 => generated 1286 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 12:38:23.431984 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: INFO nova.api.openstack.requestlog [None req-8ebdb2e4-010b-466e-9e09-5074d29f2f8b tempest-VolumesTestJSON-2014170337 tempest-VolumesTestJSON-2014170337-project] 10.222.0.75 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.181780 May 26 12:38:23.432681 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: [pid: 129321|app: 0|req: 32/69] 10.222.0.75 () {58 vars in 1133 bytes} [Thu May 26 12:38:23 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:38:23.444112 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi [None req-55916102-6665-41fb-b243-3f0d3704b316 tempest-VolumesTestJSON-2014170337 tempest-VolumesTestJSON-2014170337-project] Calling method '.version_select at 0x7f83084bcee0>' {{(pid=129322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:38:23.514620 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi [None req-5fe94faa-1e3d-4962-87fd-1a8bfaf91e97 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Calling method '>' {{(pid=129321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:38:23.515836 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.compute.api [None req-5fe94faa-1e3d-4962-87fd-1a8bfaf91e97 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] [instance: 605b9171-aa87-432a-b179-c552640e73dd] Fetching instance by UUID {{(pid=129321) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:38:23.524112 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-5fe94faa-1e3d-4962-87fd-1a8bfaf91e97 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:38:23.525458 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-5fe94faa-1e3d-4962-87fd-1a8bfaf91e97 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:38:23.528181 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-5fe94faa-1e3d-4962-87fd-1a8bfaf91e97 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:38:23.545823 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-5fe94faa-1e3d-4962-87fd-1a8bfaf91e97 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:38:23.573679 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: INFO nova.api.openstack.requestlog [None req-55916102-6665-41fb-b243-3f0d3704b316 tempest-VolumesTestJSON-2014170337 tempest-VolumesTestJSON-2014170337-project] 10.222.0.75 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.133358 May 26 12:38:23.574567 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: [pid: 129322|app: 0|req: 38/70] 10.222.0.75 () {58 vars in 1166 bytes} [Thu May 26 12:38:23 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 353 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 12:38:23.588274 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi [None req-5a4a043f-3856-4473-aa4b-6c282df516ea tempest-VolumesTestJSON-2014170337 tempest-VolumesTestJSON-2014170337-project] Calling method '.version_select at 0x7f830842f0d0>' {{(pid=129322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:38:23.658549 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.policy [None req-5fe94faa-1e3d-4962-87fd-1a8bfaf91e97 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0431b1f25497443ba483b3c440669080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e36ab03283d4ce6a2fed5e111e03d34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129321) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:38:23.677860 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: INFO nova.api.openstack.requestlog [None req-5fe94faa-1e3d-4962-87fd-1a8bfaf91e97 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] 10.222.0.75 "GET /compute/v2.1/servers/605b9171-aa87-432a-b179-c552640e73dd" status: 200 len: 1226 microversion: 2.1 time: 0.169475 May 26 12:38:23.693404 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: [pid: 129321|app: 0|req: 33/71] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 26 12:38:23 2022] GET /compute/v2.1/servers/605b9171-aa87-432a-b179-c552640e73dd => generated 1226 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:38:23.753319 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: INFO nova.api.openstack.requestlog [None req-5a4a043f-3856-4473-aa4b-6c282df516ea tempest-VolumesTestJSON-2014170337 tempest-VolumesTestJSON-2014170337-project] 10.222.0.75 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.169279 May 26 12:38:23.754385 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: [pid: 129322|app: 0|req: 39/72] 10.222.0.75 () {58 vars in 1169 bytes} [Thu May 26 12:38:23 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 694 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 12:38:23.769502 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi [None req-ba161796-7a32-4919-abb5-b7a7c8737084 tempest-VolumesTestJSON-2014170337 tempest-VolumesTestJSON-2014170337-project] Calling method '.version_select at 0x7f8309511310>' {{(pid=129321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:38:23.890335 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: INFO nova.api.openstack.requestlog [None req-ba161796-7a32-4919-abb5-b7a7c8737084 tempest-VolumesTestJSON-2014170337 tempest-VolumesTestJSON-2014170337-project] 10.222.0.75 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.124830 May 26 12:38:23.891320 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: [pid: 129321|app: 0|req: 34/73] 10.222.0.75 () {58 vars in 1154 bytes} [Thu May 26 12:38:23 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:38:23.904859 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi [None req-917044e2-6ce2-4c91-ba61-5a5efc0972e3 tempest-VolumesTestJSON-2014170337 tempest-VolumesTestJSON-2014170337-project] Calling method '.version_select at 0x7f83083ed940>' {{(pid=129322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:38:24.064609 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi [None req-9508632f-b182-4ca2-bde6-ec880fbcfceb tempest-DeleteServersTestJSON-342872481 tempest-DeleteServersTestJSON-342872481-project] Calling method '>' {{(pid=129321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:38:24.065521 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.compute.api [None req-9508632f-b182-4ca2-bde6-ec880fbcfceb tempest-DeleteServersTestJSON-342872481 tempest-DeleteServersTestJSON-342872481-project] [instance: 10054724-aefc-4a9f-a212-14e5fc5a1672] Fetching instance by UUID {{(pid=129321) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:38:24.076619 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-9508632f-b182-4ca2-bde6-ec880fbcfceb tempest-DeleteServersTestJSON-342872481 tempest-DeleteServersTestJSON-342872481-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:38:24.079344 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-9508632f-b182-4ca2-bde6-ec880fbcfceb tempest-DeleteServersTestJSON-342872481 tempest-DeleteServersTestJSON-342872481-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:38:24.080239 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-9508632f-b182-4ca2-bde6-ec880fbcfceb tempest-DeleteServersTestJSON-342872481 tempest-DeleteServersTestJSON-342872481-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:38:24.080677 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-9508632f-b182-4ca2-bde6-ec880fbcfceb tempest-DeleteServersTestJSON-342872481 tempest-DeleteServersTestJSON-342872481-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:38:24.087570 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: INFO nova.api.openstack.requestlog [None req-917044e2-6ce2-4c91-ba61-5a5efc0972e3 tempest-VolumesTestJSON-2014170337 tempest-VolumesTestJSON-2014170337-project] 10.222.0.75 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.187939 May 26 12:38:24.088459 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: [pid: 129322|app: 0|req: 40/74] 10.222.0.75 () {58 vars in 1187 bytes} [Thu May 26 12:38:23 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 353 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 12:38:24.105736 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi [None req-8bf3b010-5f35-467f-916b-43ad6f9aeb9d tempest-VolumesTestJSON-2014170337 tempest-VolumesTestJSON-2014170337-project] Calling method '.version_select at 0x7f830842f9d0>' {{(pid=129322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:38:24.353188 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: INFO nova.api.openstack.requestlog [None req-8bf3b010-5f35-467f-916b-43ad6f9aeb9d tempest-VolumesTestJSON-2014170337 tempest-VolumesTestJSON-2014170337-project] 10.222.0.75 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.255716 May 26 12:38:24.353801 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: [pid: 129322|app: 0|req: 41/75] 10.222.0.75 () {58 vars in 1154 bytes} [Thu May 26 12:38:24 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:38:24.373857 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi [None req-3e9b1eab-ab33-47b4-bd0e-95b95e50b6e9 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Calling method '>' {{(pid=129322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:38:24.374579 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.compute.api [None req-3e9b1eab-ab33-47b4-bd0e-95b95e50b6e9 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] [instance: bf2f6303-22b9-4cfa-8d4d-61d2503bc554] Fetching instance by UUID {{(pid=129322) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:38:24.379722 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.policy [None req-9508632f-b182-4ca2-bde6-ec880fbcfceb tempest-DeleteServersTestJSON-342872481 tempest-DeleteServersTestJSON-342872481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d19942e971b4d7fac3ab8f9a5ad6086', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0f340fa7ff24ca899b0f1036d0e6a3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129321) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:38:24.400914 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: INFO nova.api.openstack.requestlog [None req-9508632f-b182-4ca2-bde6-ec880fbcfceb tempest-DeleteServersTestJSON-342872481 tempest-DeleteServersTestJSON-342872481-project] 10.222.0.75 "GET /compute/v2.1/servers/10054724-aefc-4a9f-a212-14e5fc5a1672" status: 200 len: 1315 microversion: 2.1 time: 0.346051 May 26 12:38:24.401413 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-3e9b1eab-ab33-47b4-bd0e-95b95e50b6e9 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:38:24.402070 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-3e9b1eab-ab33-47b4-bd0e-95b95e50b6e9 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:38:24.404034 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: [pid: 129321|app: 0|req: 35/76] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 26 12:38:24 2022] GET /compute/v2.1/servers/10054724-aefc-4a9f-a212-14e5fc5a1672 => generated 1315 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 12:38:24.404707 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-3e9b1eab-ab33-47b4-bd0e-95b95e50b6e9 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:38:24.408036 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-3e9b1eab-ab33-47b4-bd0e-95b95e50b6e9 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:38:24.593512 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.policy [None req-3e9b1eab-ab33-47b4-bd0e-95b95e50b6e9 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e811736979c44b02b14fecb74c6bd7ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675272fb40d4847819f83ec04afecef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129322) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:38:24.608556 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.policy [None req-3e9b1eab-ab33-47b4-bd0e-95b95e50b6e9 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e811736979c44b02b14fecb74c6bd7ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675272fb40d4847819f83ec04afecef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129322) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:38:24.617564 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.policy [None req-3e9b1eab-ab33-47b4-bd0e-95b95e50b6e9 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e811736979c44b02b14fecb74c6bd7ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675272fb40d4847819f83ec04afecef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129322) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:38:24.622717 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: INFO nova.api.openstack.requestlog [None req-3e9b1eab-ab33-47b4-bd0e-95b95e50b6e9 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] 10.222.0.75 "GET /compute/v2.1/servers/bf2f6303-22b9-4cfa-8d4d-61d2503bc554" status: 200 len: 1286 microversion: 2.20 time: 0.255213 May 26 12:38:24.626672 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: [pid: 129322|app: 0|req: 42/77] 10.222.0.75 () {60 vars in 1276 bytes} [Thu May 26 12:38:24 2022] GET /compute/v2.1/servers/bf2f6303-22b9-4cfa-8d4d-61d2503bc554 => generated 1286 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 12:38:24.716761 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi [None req-1f3d303e-9727-494e-bd30-4344d0a9caee tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Calling method '>' {{(pid=129321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:38:24.717646 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.compute.api [None req-1f3d303e-9727-494e-bd30-4344d0a9caee tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] [instance: 605b9171-aa87-432a-b179-c552640e73dd] Fetching instance by UUID {{(pid=129321) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:38:24.739042 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-1f3d303e-9727-494e-bd30-4344d0a9caee tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:38:24.742242 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-1f3d303e-9727-494e-bd30-4344d0a9caee tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:38:24.745048 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-1f3d303e-9727-494e-bd30-4344d0a9caee tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:38:24.747066 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-1f3d303e-9727-494e-bd30-4344d0a9caee tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:38:24.978557 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.policy [None req-1f3d303e-9727-494e-bd30-4344d0a9caee tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0431b1f25497443ba483b3c440669080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e36ab03283d4ce6a2fed5e111e03d34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129321) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:38:24.992086 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: INFO nova.api.openstack.requestlog [None req-1f3d303e-9727-494e-bd30-4344d0a9caee tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] 10.222.0.75 "GET /compute/v2.1/servers/605b9171-aa87-432a-b179-c552640e73dd" status: 200 len: 1226 microversion: 2.1 time: 0.282292 May 26 12:38:24.993599 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: [pid: 129321|app: 0|req: 36/78] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 26 12:38:24 2022] GET /compute/v2.1/servers/605b9171-aa87-432a-b179-c552640e73dd => generated 1226 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:38:25.421112 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi [None req-dd1f4fa3-b658-453b-88fe-beefbb1dfb64 tempest-DeleteServersTestJSON-342872481 tempest-DeleteServersTestJSON-342872481-project] Calling method '>' {{(pid=129322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:38:25.424707 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.compute.api [None req-dd1f4fa3-b658-453b-88fe-beefbb1dfb64 tempest-DeleteServersTestJSON-342872481 tempest-DeleteServersTestJSON-342872481-project] [instance: 10054724-aefc-4a9f-a212-14e5fc5a1672] Fetching instance by UUID {{(pid=129322) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:38:25.435844 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-dd1f4fa3-b658-453b-88fe-beefbb1dfb64 tempest-DeleteServersTestJSON-342872481 tempest-DeleteServersTestJSON-342872481-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:38:25.437606 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-dd1f4fa3-b658-453b-88fe-beefbb1dfb64 tempest-DeleteServersTestJSON-342872481 tempest-DeleteServersTestJSON-342872481-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:38:25.440006 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-dd1f4fa3-b658-453b-88fe-beefbb1dfb64 tempest-DeleteServersTestJSON-342872481 tempest-DeleteServersTestJSON-342872481-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:38:25.441495 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-dd1f4fa3-b658-453b-88fe-beefbb1dfb64 tempest-DeleteServersTestJSON-342872481 tempest-DeleteServersTestJSON-342872481-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:38:25.553871 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG dbcounter [-] [129322] Writing DB stats nova_cell0:SELECT=4 {{(pid=129322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:38:25.645184 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi [None req-108c40f7-3cf5-4851-9c89-b6e8cca3d2a0 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Calling method '>' {{(pid=129321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:38:25.645992 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.compute.api [None req-108c40f7-3cf5-4851-9c89-b6e8cca3d2a0 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] [instance: bf2f6303-22b9-4cfa-8d4d-61d2503bc554] Fetching instance by UUID {{(pid=129321) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:38:25.656747 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-108c40f7-3cf5-4851-9c89-b6e8cca3d2a0 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:38:25.667304 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-108c40f7-3cf5-4851-9c89-b6e8cca3d2a0 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:38:25.668394 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-108c40f7-3cf5-4851-9c89-b6e8cca3d2a0 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:38:25.668866 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-108c40f7-3cf5-4851-9c89-b6e8cca3d2a0 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:38:25.750244 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.policy [None req-dd1f4fa3-b658-453b-88fe-beefbb1dfb64 tempest-DeleteServersTestJSON-342872481 tempest-DeleteServersTestJSON-342872481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d19942e971b4d7fac3ab8f9a5ad6086', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0f340fa7ff24ca899b0f1036d0e6a3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129322) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:38:25.792006 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: INFO nova.api.openstack.requestlog [None req-dd1f4fa3-b658-453b-88fe-beefbb1dfb64 tempest-DeleteServersTestJSON-342872481 tempest-DeleteServersTestJSON-342872481-project] 10.222.0.75 "GET /compute/v2.1/servers/10054724-aefc-4a9f-a212-14e5fc5a1672" status: 200 len: 1315 microversion: 2.1 time: 0.376251 May 26 12:38:25.792849 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: [pid: 129322|app: 0|req: 43/79] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 26 12:38:25 2022] GET /compute/v2.1/servers/10054724-aefc-4a9f-a212-14e5fc5a1672 => generated 1315 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:38:25.864439 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.policy [None req-108c40f7-3cf5-4851-9c89-b6e8cca3d2a0 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e811736979c44b02b14fecb74c6bd7ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675272fb40d4847819f83ec04afecef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129321) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:38:25.874068 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.policy [None req-108c40f7-3cf5-4851-9c89-b6e8cca3d2a0 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e811736979c44b02b14fecb74c6bd7ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675272fb40d4847819f83ec04afecef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129321) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:38:25.901347 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.policy [None req-108c40f7-3cf5-4851-9c89-b6e8cca3d2a0 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e811736979c44b02b14fecb74c6bd7ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675272fb40d4847819f83ec04afecef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129321) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:38:25.903912 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: INFO nova.api.openstack.requestlog [None req-108c40f7-3cf5-4851-9c89-b6e8cca3d2a0 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] 10.222.0.75 "GET /compute/v2.1/servers/bf2f6303-22b9-4cfa-8d4d-61d2503bc554" status: 200 len: 1278 microversion: 2.20 time: 0.263275 May 26 12:38:25.904739 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: [pid: 129321|app: 0|req: 37/80] 10.222.0.75 () {60 vars in 1276 bytes} [Thu May 26 12:38:25 2022] GET /compute/v2.1/servers/bf2f6303-22b9-4cfa-8d4d-61d2503bc554 => generated 1278 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 26 12:38:26.014562 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi [None req-161243f8-9d87-4f75-868f-3c56e54c9dfe tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Calling method '>' {{(pid=129322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:38:26.015131 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.compute.api [None req-161243f8-9d87-4f75-868f-3c56e54c9dfe tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] [instance: 605b9171-aa87-432a-b179-c552640e73dd] Fetching instance by UUID {{(pid=129322) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:38:26.026320 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-161243f8-9d87-4f75-868f-3c56e54c9dfe tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:38:26.026748 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-161243f8-9d87-4f75-868f-3c56e54c9dfe tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:38:26.029404 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-161243f8-9d87-4f75-868f-3c56e54c9dfe tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:38:26.031819 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-161243f8-9d87-4f75-868f-3c56e54c9dfe tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:38:26.174216 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.policy [None req-161243f8-9d87-4f75-868f-3c56e54c9dfe tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0431b1f25497443ba483b3c440669080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e36ab03283d4ce6a2fed5e111e03d34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129322) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:38:26.183121 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: INFO nova.api.openstack.requestlog [None req-161243f8-9d87-4f75-868f-3c56e54c9dfe tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] 10.222.0.75 "GET /compute/v2.1/servers/605b9171-aa87-432a-b179-c552640e73dd" status: 200 len: 1226 microversion: 2.1 time: 0.175317 May 26 12:38:26.187475 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: [pid: 129322|app: 0|req: 44/81] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 26 12:38:26 2022] GET /compute/v2.1/servers/605b9171-aa87-432a-b179-c552640e73dd => generated 1226 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:38:26.809038 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi [None req-e92a6f73-ddec-4d8c-b232-12e4e3396c9d tempest-DeleteServersTestJSON-342872481 tempest-DeleteServersTestJSON-342872481-project] Calling method '>' {{(pid=129321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:38:26.809664 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.compute.api [None req-e92a6f73-ddec-4d8c-b232-12e4e3396c9d tempest-DeleteServersTestJSON-342872481 tempest-DeleteServersTestJSON-342872481-project] [instance: 10054724-aefc-4a9f-a212-14e5fc5a1672] Fetching instance by UUID {{(pid=129321) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:38:26.815810 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-e92a6f73-ddec-4d8c-b232-12e4e3396c9d tempest-DeleteServersTestJSON-342872481 tempest-DeleteServersTestJSON-342872481-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:38:26.816253 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-e92a6f73-ddec-4d8c-b232-12e4e3396c9d tempest-DeleteServersTestJSON-342872481 tempest-DeleteServersTestJSON-342872481-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:38:26.817000 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-e92a6f73-ddec-4d8c-b232-12e4e3396c9d tempest-DeleteServersTestJSON-342872481 tempest-DeleteServersTestJSON-342872481-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:38:26.817426 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-e92a6f73-ddec-4d8c-b232-12e4e3396c9d tempest-DeleteServersTestJSON-342872481 tempest-DeleteServersTestJSON-342872481-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:38:26.924132 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi [None req-bbf05049-1f6e-4b81-8ca7-46b478baf168 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Calling method '>' {{(pid=129322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:38:26.924742 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.compute.api [None req-bbf05049-1f6e-4b81-8ca7-46b478baf168 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] [instance: bf2f6303-22b9-4cfa-8d4d-61d2503bc554] Fetching instance by UUID {{(pid=129322) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:38:26.927847 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG dbcounter [-] [129322] Writing DB stats nova_cell0:SELECT=20 {{(pid=129322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:38:26.935193 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-bbf05049-1f6e-4b81-8ca7-46b478baf168 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:38:26.935751 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-bbf05049-1f6e-4b81-8ca7-46b478baf168 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:38:26.936644 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-bbf05049-1f6e-4b81-8ca7-46b478baf168 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:38:26.937131 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-bbf05049-1f6e-4b81-8ca7-46b478baf168 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:38:26.974288 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.policy [None req-e92a6f73-ddec-4d8c-b232-12e4e3396c9d tempest-DeleteServersTestJSON-342872481 tempest-DeleteServersTestJSON-342872481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d19942e971b4d7fac3ab8f9a5ad6086', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0f340fa7ff24ca899b0f1036d0e6a3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129321) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:38:26.984289 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: INFO nova.api.openstack.requestlog [None req-e92a6f73-ddec-4d8c-b232-12e4e3396c9d tempest-DeleteServersTestJSON-342872481 tempest-DeleteServersTestJSON-342872481-project] 10.222.0.75 "GET /compute/v2.1/servers/10054724-aefc-4a9f-a212-14e5fc5a1672" status: 200 len: 1315 microversion: 2.1 time: 0.179101 May 26 12:38:26.984880 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: [pid: 129321|app: 0|req: 38/82] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 26 12:38:26 2022] GET /compute/v2.1/servers/10054724-aefc-4a9f-a212-14e5fc5a1672 => generated 1315 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:38:27.004619 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.policy [None req-bbf05049-1f6e-4b81-8ca7-46b478baf168 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e811736979c44b02b14fecb74c6bd7ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675272fb40d4847819f83ec04afecef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129322) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:38:27.014243 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.policy [None req-bbf05049-1f6e-4b81-8ca7-46b478baf168 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e811736979c44b02b14fecb74c6bd7ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675272fb40d4847819f83ec04afecef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129322) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:38:27.015838 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.policy [None req-bbf05049-1f6e-4b81-8ca7-46b478baf168 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e811736979c44b02b14fecb74c6bd7ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675272fb40d4847819f83ec04afecef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129322) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:38:27.016942 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: INFO nova.api.openstack.requestlog [None req-bbf05049-1f6e-4b81-8ca7-46b478baf168 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] 10.222.0.75 "GET /compute/v2.1/servers/bf2f6303-22b9-4cfa-8d4d-61d2503bc554" status: 200 len: 1278 microversion: 2.20 time: 0.097867 May 26 12:38:27.017657 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: [pid: 129322|app: 0|req: 45/83] 10.222.0.75 () {60 vars in 1276 bytes} [Thu May 26 12:38:26 2022] GET /compute/v2.1/servers/bf2f6303-22b9-4cfa-8d4d-61d2503bc554 => generated 1278 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 12:38:27.201129 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi [None req-7d394d0c-e538-463e-9892-2faa1edd6479 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Calling method '>' {{(pid=129321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:38:27.201935 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.compute.api [None req-7d394d0c-e538-463e-9892-2faa1edd6479 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] [instance: 605b9171-aa87-432a-b179-c552640e73dd] Fetching instance by UUID {{(pid=129321) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:38:27.208427 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-7d394d0c-e538-463e-9892-2faa1edd6479 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:38:27.208904 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-7d394d0c-e538-463e-9892-2faa1edd6479 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:38:27.209919 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-7d394d0c-e538-463e-9892-2faa1edd6479 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:38:27.210144 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-7d394d0c-e538-463e-9892-2faa1edd6479 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:38:27.275435 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.policy [None req-7d394d0c-e538-463e-9892-2faa1edd6479 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0431b1f25497443ba483b3c440669080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e36ab03283d4ce6a2fed5e111e03d34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129321) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:38:27.285710 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: INFO nova.api.openstack.requestlog [None req-7d394d0c-e538-463e-9892-2faa1edd6479 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] 10.222.0.75 "GET /compute/v2.1/servers/605b9171-aa87-432a-b179-c552640e73dd" status: 200 len: 1226 microversion: 2.1 time: 0.088008 May 26 12:38:27.287470 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: [pid: 129321|app: 0|req: 39/84] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 26 12:38:27 2022] GET /compute/v2.1/servers/605b9171-aa87-432a-b179-c552640e73dd => generated 1226 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:38:28.002283 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi [None req-b0675635-48c0-4e05-b2db-57de66c9abe8 tempest-DeleteServersTestJSON-342872481 tempest-DeleteServersTestJSON-342872481-project] Calling method '>' {{(pid=129322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:38:28.002895 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.compute.api [None req-b0675635-48c0-4e05-b2db-57de66c9abe8 tempest-DeleteServersTestJSON-342872481 tempest-DeleteServersTestJSON-342872481-project] [instance: 10054724-aefc-4a9f-a212-14e5fc5a1672] Fetching instance by UUID {{(pid=129322) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:38:28.009453 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-b0675635-48c0-4e05-b2db-57de66c9abe8 tempest-DeleteServersTestJSON-342872481 tempest-DeleteServersTestJSON-342872481-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:38:28.009549 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-b0675635-48c0-4e05-b2db-57de66c9abe8 tempest-DeleteServersTestJSON-342872481 tempest-DeleteServersTestJSON-342872481-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:38:28.010404 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-b0675635-48c0-4e05-b2db-57de66c9abe8 tempest-DeleteServersTestJSON-342872481 tempest-DeleteServersTestJSON-342872481-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:38:28.010989 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-b0675635-48c0-4e05-b2db-57de66c9abe8 tempest-DeleteServersTestJSON-342872481 tempest-DeleteServersTestJSON-342872481-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:38:28.036397 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi [None req-45674b5c-0b0c-4ede-80e5-a29ecdd56258 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Calling method '>' {{(pid=129321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:38:28.037418 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.compute.api [None req-45674b5c-0b0c-4ede-80e5-a29ecdd56258 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] [instance: bf2f6303-22b9-4cfa-8d4d-61d2503bc554] Fetching instance by UUID {{(pid=129321) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:38:28.044687 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-45674b5c-0b0c-4ede-80e5-a29ecdd56258 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:38:28.045252 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-45674b5c-0b0c-4ede-80e5-a29ecdd56258 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:38:28.046104 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-45674b5c-0b0c-4ede-80e5-a29ecdd56258 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:38:28.046647 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-45674b5c-0b0c-4ede-80e5-a29ecdd56258 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:38:28.119705 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.policy [None req-45674b5c-0b0c-4ede-80e5-a29ecdd56258 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e811736979c44b02b14fecb74c6bd7ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675272fb40d4847819f83ec04afecef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129321) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:38:28.128655 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.policy [None req-45674b5c-0b0c-4ede-80e5-a29ecdd56258 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e811736979c44b02b14fecb74c6bd7ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675272fb40d4847819f83ec04afecef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129321) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:38:28.130187 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.policy [None req-45674b5c-0b0c-4ede-80e5-a29ecdd56258 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e811736979c44b02b14fecb74c6bd7ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675272fb40d4847819f83ec04afecef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129321) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:38:28.131297 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: INFO nova.api.openstack.requestlog [None req-45674b5c-0b0c-4ede-80e5-a29ecdd56258 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] 10.222.0.75 "GET /compute/v2.1/servers/bf2f6303-22b9-4cfa-8d4d-61d2503bc554" status: 200 len: 1278 microversion: 2.20 time: 0.099111 May 26 12:38:28.142455 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: [pid: 129321|app: 0|req: 40/85] 10.222.0.75 () {60 vars in 1276 bytes} [Thu May 26 12:38:28 2022] GET /compute/v2.1/servers/bf2f6303-22b9-4cfa-8d4d-61d2503bc554 => generated 1278 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 12:38:28.146409 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.policy [None req-b0675635-48c0-4e05-b2db-57de66c9abe8 tempest-DeleteServersTestJSON-342872481 tempest-DeleteServersTestJSON-342872481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d19942e971b4d7fac3ab8f9a5ad6086', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0f340fa7ff24ca899b0f1036d0e6a3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129322) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:38:28.153963 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: INFO nova.api.openstack.requestlog [None req-b0675635-48c0-4e05-b2db-57de66c9abe8 tempest-DeleteServersTestJSON-342872481 tempest-DeleteServersTestJSON-342872481-project] 10.222.0.75 "GET /compute/v2.1/servers/10054724-aefc-4a9f-a212-14e5fc5a1672" status: 200 len: 1315 microversion: 2.1 time: 0.155488 May 26 12:38:28.154800 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: [pid: 129322|app: 0|req: 46/86] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 26 12:38:27 2022] GET /compute/v2.1/servers/10054724-aefc-4a9f-a212-14e5fc5a1672 => generated 1315 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:38:28.302805 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi [None req-e1fe2a61-0bb5-4959-829c-a68ad743611a tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Calling method '>' {{(pid=129321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:38:28.303568 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.compute.api [None req-e1fe2a61-0bb5-4959-829c-a68ad743611a tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] [instance: 605b9171-aa87-432a-b179-c552640e73dd] Fetching instance by UUID {{(pid=129321) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:38:28.309838 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-e1fe2a61-0bb5-4959-829c-a68ad743611a tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:38:28.310290 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-e1fe2a61-0bb5-4959-829c-a68ad743611a tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:38:28.311043 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-e1fe2a61-0bb5-4959-829c-a68ad743611a tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:38:28.311503 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-e1fe2a61-0bb5-4959-829c-a68ad743611a tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:38:28.371916 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.policy [None req-e1fe2a61-0bb5-4959-829c-a68ad743611a tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0431b1f25497443ba483b3c440669080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e36ab03283d4ce6a2fed5e111e03d34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129321) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:38:28.379315 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: INFO nova.api.openstack.requestlog [None req-e1fe2a61-0bb5-4959-829c-a68ad743611a tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] 10.222.0.75 "GET /compute/v2.1/servers/605b9171-aa87-432a-b179-c552640e73dd" status: 200 len: 1226 microversion: 2.1 time: 0.080655 May 26 12:38:28.382677 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: [pid: 129321|app: 0|req: 41/87] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 26 12:38:28 2022] GET /compute/v2.1/servers/605b9171-aa87-432a-b179-c552640e73dd => generated 1226 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:38:29.151150 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi [None req-8feeb388-abad-453f-8a93-ad2ac81c3d4f tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Calling method '>' {{(pid=129322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:38:29.151841 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.compute.api [None req-8feeb388-abad-453f-8a93-ad2ac81c3d4f tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] [instance: bf2f6303-22b9-4cfa-8d4d-61d2503bc554] Fetching instance by UUID {{(pid=129322) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:38:29.158288 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-8feeb388-abad-453f-8a93-ad2ac81c3d4f tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:38:29.158738 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-8feeb388-abad-453f-8a93-ad2ac81c3d4f tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:38:29.159563 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-8feeb388-abad-453f-8a93-ad2ac81c3d4f tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:38:29.160020 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-8feeb388-abad-453f-8a93-ad2ac81c3d4f tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:38:29.170960 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi [None req-c534c730-9d97-41b8-b1e0-f62286923b79 tempest-DeleteServersTestJSON-342872481 tempest-DeleteServersTestJSON-342872481-project] Calling method '>' {{(pid=129321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:38:29.171564 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.compute.api [None req-c534c730-9d97-41b8-b1e0-f62286923b79 tempest-DeleteServersTestJSON-342872481 tempest-DeleteServersTestJSON-342872481-project] [instance: 10054724-aefc-4a9f-a212-14e5fc5a1672] Fetching instance by UUID {{(pid=129321) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:38:29.173543 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG dbcounter [-] [129321] Writing DB stats nova_cell0:SELECT=4 {{(pid=129321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:38:29.174216 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG dbcounter [-] [129321] Writing DB stats nova_cell0:SELECT=18 {{(pid=129321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:38:29.180397 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-c534c730-9d97-41b8-b1e0-f62286923b79 tempest-DeleteServersTestJSON-342872481 tempest-DeleteServersTestJSON-342872481-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:38:29.180838 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-c534c730-9d97-41b8-b1e0-f62286923b79 tempest-DeleteServersTestJSON-342872481 tempest-DeleteServersTestJSON-342872481-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:38:29.181626 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-c534c730-9d97-41b8-b1e0-f62286923b79 tempest-DeleteServersTestJSON-342872481 tempest-DeleteServersTestJSON-342872481-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:38:29.182029 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-c534c730-9d97-41b8-b1e0-f62286923b79 tempest-DeleteServersTestJSON-342872481 tempest-DeleteServersTestJSON-342872481-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:38:29.227563 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.policy [None req-8feeb388-abad-453f-8a93-ad2ac81c3d4f tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e811736979c44b02b14fecb74c6bd7ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675272fb40d4847819f83ec04afecef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129322) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:38:29.231003 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG dbcounter [-] [129322] Writing DB stats nova_cell1:SELECT=100 {{(pid=129322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:38:29.236243 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.policy [None req-8feeb388-abad-453f-8a93-ad2ac81c3d4f tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e811736979c44b02b14fecb74c6bd7ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675272fb40d4847819f83ec04afecef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129322) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:38:29.237674 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.policy [None req-8feeb388-abad-453f-8a93-ad2ac81c3d4f tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e811736979c44b02b14fecb74c6bd7ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675272fb40d4847819f83ec04afecef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129322) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:38:29.238778 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: INFO nova.api.openstack.requestlog [None req-8feeb388-abad-453f-8a93-ad2ac81c3d4f tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] 10.222.0.75 "GET /compute/v2.1/servers/bf2f6303-22b9-4cfa-8d4d-61d2503bc554" status: 200 len: 1278 microversion: 2.20 time: 0.092002 May 26 12:38:29.239340 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: [pid: 129322|app: 0|req: 47/88] 10.222.0.75 () {60 vars in 1276 bytes} [Thu May 26 12:38:29 2022] GET /compute/v2.1/servers/bf2f6303-22b9-4cfa-8d4d-61d2503bc554 => generated 1278 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 12:38:29.310167 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.policy [None req-c534c730-9d97-41b8-b1e0-f62286923b79 tempest-DeleteServersTestJSON-342872481 tempest-DeleteServersTestJSON-342872481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d19942e971b4d7fac3ab8f9a5ad6086', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0f340fa7ff24ca899b0f1036d0e6a3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129321) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:38:29.313692 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG dbcounter [-] [129321] Writing DB stats nova_cell1:SELECT=100 {{(pid=129321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:38:29.318245 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: INFO nova.api.openstack.requestlog [None req-c534c730-9d97-41b8-b1e0-f62286923b79 tempest-DeleteServersTestJSON-342872481 tempest-DeleteServersTestJSON-342872481-project] 10.222.0.75 "GET /compute/v2.1/servers/10054724-aefc-4a9f-a212-14e5fc5a1672" status: 200 len: 1315 microversion: 2.1 time: 0.151151 May 26 12:38:29.318822 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: [pid: 129321|app: 0|req: 42/89] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 26 12:38:29 2022] GET /compute/v2.1/servers/10054724-aefc-4a9f-a212-14e5fc5a1672 => generated 1315 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:38:29.397340 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi [None req-ab53253a-4412-4a54-8dab-671c788e0f97 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Calling method '>' {{(pid=129322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:38:29.398324 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.compute.api [None req-ab53253a-4412-4a54-8dab-671c788e0f97 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] [instance: 605b9171-aa87-432a-b179-c552640e73dd] Fetching instance by UUID {{(pid=129322) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:38:29.404870 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-ab53253a-4412-4a54-8dab-671c788e0f97 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:38:29.405317 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-ab53253a-4412-4a54-8dab-671c788e0f97 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:38:29.406081 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-ab53253a-4412-4a54-8dab-671c788e0f97 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:38:29.406511 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-ab53253a-4412-4a54-8dab-671c788e0f97 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:38:29.466419 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.policy [None req-ab53253a-4412-4a54-8dab-671c788e0f97 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0431b1f25497443ba483b3c440669080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e36ab03283d4ce6a2fed5e111e03d34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129322) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:38:29.474148 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: INFO nova.api.openstack.requestlog [None req-ab53253a-4412-4a54-8dab-671c788e0f97 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] 10.222.0.75 "GET /compute/v2.1/servers/605b9171-aa87-432a-b179-c552640e73dd" status: 200 len: 1226 microversion: 2.1 time: 0.081564 May 26 12:38:29.474765 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: [pid: 129322|app: 0|req: 48/90] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 26 12:38:29 2022] GET /compute/v2.1/servers/605b9171-aa87-432a-b179-c552640e73dd => generated 1226 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:38:30.260119 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi [None req-67dad79a-39e6-4d2c-9adc-3a408364f921 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Calling method '>' {{(pid=129321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:38:30.260681 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.compute.api [None req-67dad79a-39e6-4d2c-9adc-3a408364f921 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] [instance: bf2f6303-22b9-4cfa-8d4d-61d2503bc554] Fetching instance by UUID {{(pid=129321) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:38:30.270417 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-67dad79a-39e6-4d2c-9adc-3a408364f921 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:38:30.271005 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-67dad79a-39e6-4d2c-9adc-3a408364f921 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:38:30.272367 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-67dad79a-39e6-4d2c-9adc-3a408364f921 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:38:30.273162 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-67dad79a-39e6-4d2c-9adc-3a408364f921 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:38:30.336120 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi [None req-ac9e865e-ebe2-4b0e-93a5-282296a37038 tempest-DeleteServersTestJSON-342872481 tempest-DeleteServersTestJSON-342872481-project] Calling method '>' {{(pid=129322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:38:30.336778 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.compute.api [None req-ac9e865e-ebe2-4b0e-93a5-282296a37038 tempest-DeleteServersTestJSON-342872481 tempest-DeleteServersTestJSON-342872481-project] [instance: 10054724-aefc-4a9f-a212-14e5fc5a1672] Fetching instance by UUID {{(pid=129322) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:38:30.337319 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.policy [None req-67dad79a-39e6-4d2c-9adc-3a408364f921 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e811736979c44b02b14fecb74c6bd7ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675272fb40d4847819f83ec04afecef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129321) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:38:30.343495 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-ac9e865e-ebe2-4b0e-93a5-282296a37038 tempest-DeleteServersTestJSON-342872481 tempest-DeleteServersTestJSON-342872481-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:38:30.344049 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-ac9e865e-ebe2-4b0e-93a5-282296a37038 tempest-DeleteServersTestJSON-342872481 tempest-DeleteServersTestJSON-342872481-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:38:30.344909 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-ac9e865e-ebe2-4b0e-93a5-282296a37038 tempest-DeleteServersTestJSON-342872481 tempest-DeleteServersTestJSON-342872481-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:38:30.345358 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-ac9e865e-ebe2-4b0e-93a5-282296a37038 tempest-DeleteServersTestJSON-342872481 tempest-DeleteServersTestJSON-342872481-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:38:30.345499 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.policy [None req-67dad79a-39e6-4d2c-9adc-3a408364f921 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e811736979c44b02b14fecb74c6bd7ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675272fb40d4847819f83ec04afecef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129321) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:38:30.346959 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.policy [None req-67dad79a-39e6-4d2c-9adc-3a408364f921 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e811736979c44b02b14fecb74c6bd7ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675272fb40d4847819f83ec04afecef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129321) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:38:30.348220 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: INFO nova.api.openstack.requestlog [None req-67dad79a-39e6-4d2c-9adc-3a408364f921 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] 10.222.0.75 "GET /compute/v2.1/servers/bf2f6303-22b9-4cfa-8d4d-61d2503bc554" status: 200 len: 1278 microversion: 2.20 time: 0.094965 May 26 12:38:30.348808 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: [pid: 129321|app: 0|req: 43/91] 10.222.0.75 () {60 vars in 1276 bytes} [Thu May 26 12:38:30 2022] GET /compute/v2.1/servers/bf2f6303-22b9-4cfa-8d4d-61d2503bc554 => generated 1278 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 12:38:30.481195 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.policy [None req-ac9e865e-ebe2-4b0e-93a5-282296a37038 tempest-DeleteServersTestJSON-342872481 tempest-DeleteServersTestJSON-342872481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d19942e971b4d7fac3ab8f9a5ad6086', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0f340fa7ff24ca899b0f1036d0e6a3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129322) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:38:30.489064 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: INFO nova.api.openstack.requestlog [None req-ac9e865e-ebe2-4b0e-93a5-282296a37038 tempest-DeleteServersTestJSON-342872481 tempest-DeleteServersTestJSON-342872481-project] 10.222.0.75 "GET /compute/v2.1/servers/10054724-aefc-4a9f-a212-14e5fc5a1672" status: 200 len: 1315 microversion: 2.1 time: 0.157564 May 26 12:38:30.489635 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: [pid: 129322|app: 0|req: 49/92] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 26 12:38:30 2022] GET /compute/v2.1/servers/10054724-aefc-4a9f-a212-14e5fc5a1672 => generated 1315 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:38:30.490296 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi [None req-ccfba3ae-7eae-4155-8f6b-962b5d3bc5c7 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Calling method '>' {{(pid=129321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:38:30.491021 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.compute.api [None req-ccfba3ae-7eae-4155-8f6b-962b5d3bc5c7 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] [instance: 605b9171-aa87-432a-b179-c552640e73dd] Fetching instance by UUID {{(pid=129321) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:38:30.497369 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-ccfba3ae-7eae-4155-8f6b-962b5d3bc5c7 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:38:30.497807 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-ccfba3ae-7eae-4155-8f6b-962b5d3bc5c7 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:38:30.498555 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-ccfba3ae-7eae-4155-8f6b-962b5d3bc5c7 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:38:30.498978 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-ccfba3ae-7eae-4155-8f6b-962b5d3bc5c7 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:38:30.560999 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.policy [None req-ccfba3ae-7eae-4155-8f6b-962b5d3bc5c7 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0431b1f25497443ba483b3c440669080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e36ab03283d4ce6a2fed5e111e03d34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129321) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:38:30.568514 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: INFO nova.api.openstack.requestlog [None req-ccfba3ae-7eae-4155-8f6b-962b5d3bc5c7 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] 10.222.0.75 "GET /compute/v2.1/servers/605b9171-aa87-432a-b179-c552640e73dd" status: 200 len: 1226 microversion: 2.1 time: 0.082076 May 26 12:38:30.569132 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: [pid: 129321|app: 0|req: 44/93] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 26 12:38:30 2022] GET /compute/v2.1/servers/605b9171-aa87-432a-b179-c552640e73dd => generated 1226 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:38:31.366680 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi [None req-a2dfd841-6e9a-4885-b034-9551372f8670 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Calling method '>' {{(pid=129322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:38:31.367230 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.compute.api [None req-a2dfd841-6e9a-4885-b034-9551372f8670 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] [instance: bf2f6303-22b9-4cfa-8d4d-61d2503bc554] Fetching instance by UUID {{(pid=129322) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:38:31.373641 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-a2dfd841-6e9a-4885-b034-9551372f8670 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:38:31.374096 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-a2dfd841-6e9a-4885-b034-9551372f8670 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:38:31.374859 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-a2dfd841-6e9a-4885-b034-9551372f8670 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:38:31.375405 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-a2dfd841-6e9a-4885-b034-9551372f8670 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:38:31.438042 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.policy [None req-a2dfd841-6e9a-4885-b034-9551372f8670 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e811736979c44b02b14fecb74c6bd7ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675272fb40d4847819f83ec04afecef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129322) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:38:31.446519 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.policy [None req-a2dfd841-6e9a-4885-b034-9551372f8670 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e811736979c44b02b14fecb74c6bd7ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675272fb40d4847819f83ec04afecef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129322) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:38:31.448118 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.policy [None req-a2dfd841-6e9a-4885-b034-9551372f8670 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e811736979c44b02b14fecb74c6bd7ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675272fb40d4847819f83ec04afecef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129322) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:38:31.449345 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: INFO nova.api.openstack.requestlog [None req-a2dfd841-6e9a-4885-b034-9551372f8670 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] 10.222.0.75 "GET /compute/v2.1/servers/bf2f6303-22b9-4cfa-8d4d-61d2503bc554" status: 200 len: 1334 microversion: 2.20 time: 0.086855 May 26 12:38:31.449950 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: [pid: 129322|app: 0|req: 50/94] 10.222.0.75 () {60 vars in 1276 bytes} [Thu May 26 12:38:31 2022] GET /compute/v2.1/servers/bf2f6303-22b9-4cfa-8d4d-61d2503bc554 => generated 1334 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 12:38:31.505755 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi [None req-d333ebb7-8bf8-4ee1-a29e-25170de33901 tempest-DeleteServersTestJSON-342872481 tempest-DeleteServersTestJSON-342872481-project] Calling method '>' {{(pid=129321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:38:31.506615 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.compute.api [None req-d333ebb7-8bf8-4ee1-a29e-25170de33901 tempest-DeleteServersTestJSON-342872481 tempest-DeleteServersTestJSON-342872481-project] [instance: 10054724-aefc-4a9f-a212-14e5fc5a1672] Fetching instance by UUID {{(pid=129321) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:38:31.513428 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-d333ebb7-8bf8-4ee1-a29e-25170de33901 tempest-DeleteServersTestJSON-342872481 tempest-DeleteServersTestJSON-342872481-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:38:31.513993 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-d333ebb7-8bf8-4ee1-a29e-25170de33901 tempest-DeleteServersTestJSON-342872481 tempest-DeleteServersTestJSON-342872481-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:38:31.514866 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-d333ebb7-8bf8-4ee1-a29e-25170de33901 tempest-DeleteServersTestJSON-342872481 tempest-DeleteServersTestJSON-342872481-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:38:31.515388 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-d333ebb7-8bf8-4ee1-a29e-25170de33901 tempest-DeleteServersTestJSON-342872481 tempest-DeleteServersTestJSON-342872481-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:38:31.585670 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi [None req-30071064-17e0-4727-a11e-b76f876062ee tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Calling method '>' {{(pid=129322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:38:31.586593 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.compute.api [None req-30071064-17e0-4727-a11e-b76f876062ee tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] [instance: 605b9171-aa87-432a-b179-c552640e73dd] Fetching instance by UUID {{(pid=129322) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:38:31.589095 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG dbcounter [-] [129322] Writing DB stats nova_api:SELECT=86,nova_api:INSERT=7 {{(pid=129322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:38:31.596514 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-30071064-17e0-4727-a11e-b76f876062ee tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:38:31.597121 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-30071064-17e0-4727-a11e-b76f876062ee tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:38:31.598325 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-30071064-17e0-4727-a11e-b76f876062ee tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:38:31.599145 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-30071064-17e0-4727-a11e-b76f876062ee tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:38:31.676325 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.policy [None req-30071064-17e0-4727-a11e-b76f876062ee tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0431b1f25497443ba483b3c440669080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e36ab03283d4ce6a2fed5e111e03d34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129322) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:38:31.684558 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: INFO nova.api.openstack.requestlog [None req-30071064-17e0-4727-a11e-b76f876062ee tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] 10.222.0.75 "GET /compute/v2.1/servers/605b9171-aa87-432a-b179-c552640e73dd" status: 200 len: 1274 microversion: 2.1 time: 0.102958 May 26 12:38:31.685917 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: [pid: 129322|app: 0|req: 51/95] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 26 12:38:31 2022] GET /compute/v2.1/servers/605b9171-aa87-432a-b179-c552640e73dd => generated 1274 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 12:38:31.839230 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.policy [None req-d333ebb7-8bf8-4ee1-a29e-25170de33901 tempest-DeleteServersTestJSON-342872481 tempest-DeleteServersTestJSON-342872481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d19942e971b4d7fac3ab8f9a5ad6086', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0f340fa7ff24ca899b0f1036d0e6a3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129321) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:38:31.846856 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: INFO nova.api.openstack.requestlog [None req-d333ebb7-8bf8-4ee1-a29e-25170de33901 tempest-DeleteServersTestJSON-342872481 tempest-DeleteServersTestJSON-342872481-project] 10.222.0.75 "GET /compute/v2.1/servers/10054724-aefc-4a9f-a212-14e5fc5a1672" status: 200 len: 1315 microversion: 2.1 time: 0.344990 May 26 12:38:31.847595 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: [pid: 129321|app: 0|req: 45/96] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 26 12:38:31 2022] GET /compute/v2.1/servers/10054724-aefc-4a9f-a212-14e5fc5a1672 => generated 1315 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:38:32.468085 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi [None req-2c38c453-5373-48b2-be0b-d2cd05b4619a tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Calling method '>' {{(pid=129321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:38:32.468719 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.compute.api [None req-2c38c453-5373-48b2-be0b-d2cd05b4619a tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] [instance: bf2f6303-22b9-4cfa-8d4d-61d2503bc554] Fetching instance by UUID {{(pid=129321) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:38:32.470895 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG dbcounter [-] [129321] Writing DB stats nova_api:SELECT=77,nova_api:INSERT=6 {{(pid=129321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:38:32.479464 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-2c38c453-5373-48b2-be0b-d2cd05b4619a tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:38:32.481206 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-2c38c453-5373-48b2-be0b-d2cd05b4619a tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:38:32.482189 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-2c38c453-5373-48b2-be0b-d2cd05b4619a tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:38:32.482798 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-2c38c453-5373-48b2-be0b-d2cd05b4619a tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:38:32.484111 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi [req-29c616b9-a87d-492a-955c-3c42f5e36075 req-cd149465-1390-4bd7-baae-58a0ad7907b2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "10054724-aefc-4a9f-a212-14e5fc5a1672", "tag": "d58039df-b2ef-4fd4-b2be-5a00ba363704"}]} {{(pid=129322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 12:38:32.497321 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [req-29c616b9-a87d-492a-955c-3c42f5e36075 req-cd149465-1390-4bd7-baae-58a0ad7907b2 service nova] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:38:32.497868 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [req-29c616b9-a87d-492a-955c-3c42f5e36075 req-cd149465-1390-4bd7-baae-58a0ad7907b2 service nova] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:38:32.524201 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: INFO nova.api.openstack.compute.server_external_events [req-29c616b9-a87d-492a-955c-3c42f5e36075 req-cd149465-1390-4bd7-baae-58a0ad7907b2 service nova] Creating event network-changed:d58039df-b2ef-4fd4-b2be-5a00ba363704 for instance 10054724-aefc-4a9f-a212-14e5fc5a1672 on hv-cinder-81966 May 26 12:38:32.524898 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [req-29c616b9-a87d-492a-955c-3c42f5e36075 req-cd149465-1390-4bd7-baae-58a0ad7907b2 service nova] Acquired lock "compute-rpcapi-router" {{(pid=129322) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} May 26 12:38:32.526157 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-0fee68b4-c4a6-4721-a4ac-b1f796cdfa0e None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:38:32.526728 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-0fee68b4-c4a6-4721-a4ac-b1f796cdfa0e None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:38:32.527666 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-0fee68b4-c4a6-4721-a4ac-b1f796cdfa0e None None] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:38:32.528243 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-0fee68b4-c4a6-4721-a4ac-b1f796cdfa0e None None] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:38:32.557068 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: INFO nova.compute.rpcapi [None req-0fee68b4-c4a6-4721-a4ac-b1f796cdfa0e None None] Automatically selected compute RPC version 6.0 from minimum service version 61 May 26 12:38:32.558441 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.policy [None req-2c38c453-5373-48b2-be0b-d2cd05b4619a tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e811736979c44b02b14fecb74c6bd7ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675272fb40d4847819f83ec04afecef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129321) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:38:32.562139 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-0fee68b4-c4a6-4721-a4ac-b1f796cdfa0e None None] Releasing lock "compute-rpcapi-router" {{(pid=129322) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} May 26 12:38:32.572464 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.policy [None req-2c38c453-5373-48b2-be0b-d2cd05b4619a tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e811736979c44b02b14fecb74c6bd7ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675272fb40d4847819f83ec04afecef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129321) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:38:32.578680 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.policy [None req-2c38c453-5373-48b2-be0b-d2cd05b4619a tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e811736979c44b02b14fecb74c6bd7ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675272fb40d4847819f83ec04afecef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129321) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:38:32.580575 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: INFO nova.api.openstack.requestlog [None req-2c38c453-5373-48b2-be0b-d2cd05b4619a tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] 10.222.0.75 "GET /compute/v2.1/servers/bf2f6303-22b9-4cfa-8d4d-61d2503bc554" status: 200 len: 1352 microversion: 2.20 time: 0.116684 May 26 12:38:32.584584 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: [pid: 129321|app: 0|req: 46/97] 10.222.0.75 () {60 vars in 1276 bytes} [Thu May 26 12:38:32 2022] GET /compute/v2.1/servers/bf2f6303-22b9-4cfa-8d4d-61d2503bc554 => generated 1352 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 12:38:32.614570 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: INFO nova.api.openstack.requestlog [None req-0fee68b4-c4a6-4721-a4ac-b1f796cdfa0e None None] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.208795 May 26 12:38:32.615512 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: [pid: 129322|app: 0|req: 52/98] 10.222.0.75 () {64 vars in 1317 bytes} [Thu May 26 12:38:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 12:38:32.703068 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi [None req-cee0fd43-0541-4fe7-b42c-bc7cdd8140ff tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Calling method '>' {{(pid=129321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:38:32.703879 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.compute.api [None req-cee0fd43-0541-4fe7-b42c-bc7cdd8140ff tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] [instance: 605b9171-aa87-432a-b179-c552640e73dd] Fetching instance by UUID {{(pid=129321) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:38:32.712500 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-cee0fd43-0541-4fe7-b42c-bc7cdd8140ff tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:38:32.716329 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-cee0fd43-0541-4fe7-b42c-bc7cdd8140ff tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:38:32.727132 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-cee0fd43-0541-4fe7-b42c-bc7cdd8140ff tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:38:32.728335 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-cee0fd43-0541-4fe7-b42c-bc7cdd8140ff tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:38:32.867734 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi [None req-4f9a6365-042e-48eb-8e99-3d27e1c598cd tempest-DeleteServersTestJSON-342872481 tempest-DeleteServersTestJSON-342872481-project] Calling method '>' {{(pid=129322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:38:32.868734 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.compute.api [None req-4f9a6365-042e-48eb-8e99-3d27e1c598cd tempest-DeleteServersTestJSON-342872481 tempest-DeleteServersTestJSON-342872481-project] [instance: 10054724-aefc-4a9f-a212-14e5fc5a1672] Fetching instance by UUID {{(pid=129322) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:38:32.885735 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-4f9a6365-042e-48eb-8e99-3d27e1c598cd tempest-DeleteServersTestJSON-342872481 tempest-DeleteServersTestJSON-342872481-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:38:32.886586 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-4f9a6365-042e-48eb-8e99-3d27e1c598cd tempest-DeleteServersTestJSON-342872481 tempest-DeleteServersTestJSON-342872481-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:38:32.888926 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-4f9a6365-042e-48eb-8e99-3d27e1c598cd tempest-DeleteServersTestJSON-342872481 tempest-DeleteServersTestJSON-342872481-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:38:32.889583 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-4f9a6365-042e-48eb-8e99-3d27e1c598cd tempest-DeleteServersTestJSON-342872481 tempest-DeleteServersTestJSON-342872481-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:38:33.006409 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.policy [None req-cee0fd43-0541-4fe7-b42c-bc7cdd8140ff tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0431b1f25497443ba483b3c440669080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e36ab03283d4ce6a2fed5e111e03d34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129321) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:38:33.017944 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: INFO nova.api.openstack.requestlog [None req-cee0fd43-0541-4fe7-b42c-bc7cdd8140ff tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] 10.222.0.75 "GET /compute/v2.1/servers/605b9171-aa87-432a-b179-c552640e73dd" status: 200 len: 1282 microversion: 2.1 time: 0.319166 May 26 12:38:33.024206 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: [pid: 129321|app: 0|req: 47/99] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 26 12:38:32 2022] GET /compute/v2.1/servers/605b9171-aa87-432a-b179-c552640e73dd => generated 1282 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:38:33.107761 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.policy [None req-4f9a6365-042e-48eb-8e99-3d27e1c598cd tempest-DeleteServersTestJSON-342872481 tempest-DeleteServersTestJSON-342872481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d19942e971b4d7fac3ab8f9a5ad6086', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0f340fa7ff24ca899b0f1036d0e6a3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129322) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:38:33.115727 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: INFO nova.api.openstack.requestlog [None req-4f9a6365-042e-48eb-8e99-3d27e1c598cd tempest-DeleteServersTestJSON-342872481 tempest-DeleteServersTestJSON-342872481-project] 10.222.0.75 "GET /compute/v2.1/servers/10054724-aefc-4a9f-a212-14e5fc5a1672" status: 200 len: 1315 microversion: 2.1 time: 0.255095 May 26 12:38:33.116460 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: [pid: 129322|app: 0|req: 53/100] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 26 12:38:32 2022] GET /compute/v2.1/servers/10054724-aefc-4a9f-a212-14e5fc5a1672 => generated 1315 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:38:33.604095 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi [None req-ac010629-e7f7-4885-9175-3d64090f5dd8 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Calling method '>' {{(pid=129321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:38:33.605032 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.compute.api [None req-ac010629-e7f7-4885-9175-3d64090f5dd8 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] [instance: bf2f6303-22b9-4cfa-8d4d-61d2503bc554] Fetching instance by UUID {{(pid=129321) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:38:33.615292 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-ac010629-e7f7-4885-9175-3d64090f5dd8 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:38:33.616593 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-ac010629-e7f7-4885-9175-3d64090f5dd8 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:38:33.617602 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-ac010629-e7f7-4885-9175-3d64090f5dd8 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:38:33.618141 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-ac010629-e7f7-4885-9175-3d64090f5dd8 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:38:34.038982 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi [None req-4288665a-4afb-4abf-8ac2-ade45f5dc7b0 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Calling method '>' {{(pid=129322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:38:34.040318 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.compute.api [None req-4288665a-4afb-4abf-8ac2-ade45f5dc7b0 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] [instance: 605b9171-aa87-432a-b179-c552640e73dd] Fetching instance by UUID {{(pid=129322) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:38:34.048331 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-4288665a-4afb-4abf-8ac2-ade45f5dc7b0 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:38:34.049258 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-4288665a-4afb-4abf-8ac2-ade45f5dc7b0 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:38:34.050377 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-4288665a-4afb-4abf-8ac2-ade45f5dc7b0 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:38:34.051279 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-4288665a-4afb-4abf-8ac2-ade45f5dc7b0 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:38:34.156651 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.policy [None req-4288665a-4afb-4abf-8ac2-ade45f5dc7b0 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0431b1f25497443ba483b3c440669080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e36ab03283d4ce6a2fed5e111e03d34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129322) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:38:34.168528 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: INFO nova.api.openstack.requestlog [None req-4288665a-4afb-4abf-8ac2-ade45f5dc7b0 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] 10.222.0.75 "GET /compute/v2.1/servers/605b9171-aa87-432a-b179-c552640e73dd" status: 200 len: 1280 microversion: 2.1 time: 0.134947 May 26 12:38:34.170027 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: [pid: 129322|app: 0|req: 54/101] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 26 12:38:34 2022] GET /compute/v2.1/servers/605b9171-aa87-432a-b179-c552640e73dd => generated 1280 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:38:34.179080 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi [None req-e95dbb49-b620-4f99-bf0d-970f9875115d tempest-DeleteServersTestJSON-342872481 tempest-DeleteServersTestJSON-342872481-project] Calling method '>' {{(pid=129322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:38:34.180198 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.compute.api [None req-e95dbb49-b620-4f99-bf0d-970f9875115d tempest-DeleteServersTestJSON-342872481 tempest-DeleteServersTestJSON-342872481-project] [instance: 10054724-aefc-4a9f-a212-14e5fc5a1672] Fetching instance by UUID {{(pid=129322) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:38:34.187188 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-e95dbb49-b620-4f99-bf0d-970f9875115d tempest-DeleteServersTestJSON-342872481 tempest-DeleteServersTestJSON-342872481-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:38:34.187951 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-e95dbb49-b620-4f99-bf0d-970f9875115d tempest-DeleteServersTestJSON-342872481 tempest-DeleteServersTestJSON-342872481-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:38:34.189086 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-e95dbb49-b620-4f99-bf0d-970f9875115d tempest-DeleteServersTestJSON-342872481 tempest-DeleteServersTestJSON-342872481-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:38:34.189505 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-e95dbb49-b620-4f99-bf0d-970f9875115d tempest-DeleteServersTestJSON-342872481 tempest-DeleteServersTestJSON-342872481-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:38:34.209850 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.policy [None req-ac010629-e7f7-4885-9175-3d64090f5dd8 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e811736979c44b02b14fecb74c6bd7ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675272fb40d4847819f83ec04afecef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129321) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:38:34.222731 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.policy [None req-ac010629-e7f7-4885-9175-3d64090f5dd8 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e811736979c44b02b14fecb74c6bd7ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675272fb40d4847819f83ec04afecef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129321) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:38:34.225090 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.policy [None req-ac010629-e7f7-4885-9175-3d64090f5dd8 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e811736979c44b02b14fecb74c6bd7ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675272fb40d4847819f83ec04afecef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129321) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:38:34.226675 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: INFO nova.api.openstack.requestlog [None req-ac010629-e7f7-4885-9175-3d64090f5dd8 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] 10.222.0.75 "GET /compute/v2.1/servers/bf2f6303-22b9-4cfa-8d4d-61d2503bc554" status: 200 len: 1407 microversion: 2.20 time: 0.628285 May 26 12:38:34.227421 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: [pid: 129321|app: 0|req: 48/102] 10.222.0.75 () {60 vars in 1276 bytes} [Thu May 26 12:38:33 2022] GET /compute/v2.1/servers/bf2f6303-22b9-4cfa-8d4d-61d2503bc554 => generated 1407 bytes in 630 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 26 12:38:34.423678 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.policy [None req-e95dbb49-b620-4f99-bf0d-970f9875115d tempest-DeleteServersTestJSON-342872481 tempest-DeleteServersTestJSON-342872481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d19942e971b4d7fac3ab8f9a5ad6086', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0f340fa7ff24ca899b0f1036d0e6a3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129322) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:38:34.432030 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: INFO nova.api.openstack.requestlog [None req-e95dbb49-b620-4f99-bf0d-970f9875115d tempest-DeleteServersTestJSON-342872481 tempest-DeleteServersTestJSON-342872481-project] 10.222.0.75 "GET /compute/v2.1/servers/10054724-aefc-4a9f-a212-14e5fc5a1672" status: 200 len: 1315 microversion: 2.1 time: 0.260200 May 26 12:38:34.435878 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: [pid: 129322|app: 0|req: 55/103] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 26 12:38:34 2022] GET /compute/v2.1/servers/10054724-aefc-4a9f-a212-14e5fc5a1672 => generated 1315 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:38:35.169106 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi [req-bfaff518-675d-4cdc-9dd6-b5cb480043b6 req-41a41100-738d-46e6-bbae-39abb9bcf353 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bf2f6303-22b9-4cfa-8d4d-61d2503bc554", "tag": "fe40ed8f-f450-48f7-876a-abe2fea7abe5"}]} {{(pid=129321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 12:38:35.191120 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi [None req-c8b4d4a4-92c2-4b24-ba07-0e7fabb03008 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Calling method '>' {{(pid=129322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:38:35.193513 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.compute.api [None req-c8b4d4a4-92c2-4b24-ba07-0e7fabb03008 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] [instance: 605b9171-aa87-432a-b179-c552640e73dd] Fetching instance by UUID {{(pid=129322) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:38:35.197683 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [req-bfaff518-675d-4cdc-9dd6-b5cb480043b6 req-41a41100-738d-46e6-bbae-39abb9bcf353 service nova] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:38:35.205436 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [req-bfaff518-675d-4cdc-9dd6-b5cb480043b6 req-41a41100-738d-46e6-bbae-39abb9bcf353 service nova] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:38:35.207975 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-c8b4d4a4-92c2-4b24-ba07-0e7fabb03008 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:38:35.208751 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-c8b4d4a4-92c2-4b24-ba07-0e7fabb03008 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:38:35.210170 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-c8b4d4a4-92c2-4b24-ba07-0e7fabb03008 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:38:35.210799 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-c8b4d4a4-92c2-4b24-ba07-0e7fabb03008 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:38:35.270480 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: INFO nova.api.openstack.compute.server_external_events [req-bfaff518-675d-4cdc-9dd6-b5cb480043b6 req-41a41100-738d-46e6-bbae-39abb9bcf353 service nova] Creating event network-changed:fe40ed8f-f450-48f7-876a-abe2fea7abe5 for instance bf2f6303-22b9-4cfa-8d4d-61d2503bc554 on hv-cinder-81966 May 26 12:38:35.277238 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [req-bfaff518-675d-4cdc-9dd6-b5cb480043b6 req-41a41100-738d-46e6-bbae-39abb9bcf353 service nova] Acquired lock "compute-rpcapi-router" {{(pid=129321) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} May 26 12:38:35.280801 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-23bfbe3f-2d33-4ee0-aefe-f4653585b040 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:38:35.282976 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-23bfbe3f-2d33-4ee0-aefe-f4653585b040 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:38:35.284055 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-23bfbe3f-2d33-4ee0-aefe-f4653585b040 None None] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:38:35.287574 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-23bfbe3f-2d33-4ee0-aefe-f4653585b040 None None] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:38:35.309767 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: INFO nova.compute.rpcapi [None req-23bfbe3f-2d33-4ee0-aefe-f4653585b040 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 May 26 12:38:35.311335 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-23bfbe3f-2d33-4ee0-aefe-f4653585b040 None None] Releasing lock "compute-rpcapi-router" {{(pid=129321) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} May 26 12:38:35.352938 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: INFO nova.api.openstack.requestlog [None req-23bfbe3f-2d33-4ee0-aefe-f4653585b040 None None] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.313696 May 26 12:38:35.355972 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: [pid: 129321|app: 0|req: 49/104] 10.222.0.75 () {64 vars in 1317 bytes} [Thu May 26 12:38:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 12:38:35.365304 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi [None req-aa7d0a79-5f16-46fa-957e-7a7932b4dee0 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Calling method '>' {{(pid=129321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:38:35.368518 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.compute.api [None req-aa7d0a79-5f16-46fa-957e-7a7932b4dee0 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] [instance: bf2f6303-22b9-4cfa-8d4d-61d2503bc554] Fetching instance by UUID {{(pid=129321) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:38:35.387167 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-aa7d0a79-5f16-46fa-957e-7a7932b4dee0 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:38:35.387825 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-aa7d0a79-5f16-46fa-957e-7a7932b4dee0 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:38:35.389466 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-aa7d0a79-5f16-46fa-957e-7a7932b4dee0 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:38:35.390647 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-aa7d0a79-5f16-46fa-957e-7a7932b4dee0 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:38:35.462154 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.policy [None req-c8b4d4a4-92c2-4b24-ba07-0e7fabb03008 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0431b1f25497443ba483b3c440669080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e36ab03283d4ce6a2fed5e111e03d34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129322) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:38:35.475890 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: INFO nova.api.openstack.requestlog [None req-c8b4d4a4-92c2-4b24-ba07-0e7fabb03008 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] 10.222.0.75 "GET /compute/v2.1/servers/605b9171-aa87-432a-b179-c552640e73dd" status: 200 len: 1322 microversion: 2.1 time: 0.292032 May 26 12:38:35.477575 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: [pid: 129322|app: 0|req: 56/105] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 26 12:38:35 2022] GET /compute/v2.1/servers/605b9171-aa87-432a-b179-c552640e73dd => generated 1322 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 12:38:35.483413 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi [None req-11225431-9bbc-4c45-8340-92438581995b tempest-DeleteServersTestJSON-342872481 tempest-DeleteServersTestJSON-342872481-project] Calling method '>' {{(pid=129322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:38:35.484295 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.compute.api [None req-11225431-9bbc-4c45-8340-92438581995b tempest-DeleteServersTestJSON-342872481 tempest-DeleteServersTestJSON-342872481-project] [instance: 10054724-aefc-4a9f-a212-14e5fc5a1672] Fetching instance by UUID {{(pid=129322) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:38:35.492928 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-11225431-9bbc-4c45-8340-92438581995b tempest-DeleteServersTestJSON-342872481 tempest-DeleteServersTestJSON-342872481-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:38:35.493616 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-11225431-9bbc-4c45-8340-92438581995b tempest-DeleteServersTestJSON-342872481 tempest-DeleteServersTestJSON-342872481-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:38:35.494638 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-11225431-9bbc-4c45-8340-92438581995b tempest-DeleteServersTestJSON-342872481 tempest-DeleteServersTestJSON-342872481-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:38:35.495332 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-11225431-9bbc-4c45-8340-92438581995b tempest-DeleteServersTestJSON-342872481 tempest-DeleteServersTestJSON-342872481-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:38:35.694429 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.policy [None req-aa7d0a79-5f16-46fa-957e-7a7932b4dee0 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e811736979c44b02b14fecb74c6bd7ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675272fb40d4847819f83ec04afecef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129321) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:38:35.703517 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.policy [None req-aa7d0a79-5f16-46fa-957e-7a7932b4dee0 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e811736979c44b02b14fecb74c6bd7ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675272fb40d4847819f83ec04afecef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129321) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:38:35.706180 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.policy [None req-aa7d0a79-5f16-46fa-957e-7a7932b4dee0 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e811736979c44b02b14fecb74c6bd7ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675272fb40d4847819f83ec04afecef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129321) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:38:35.707703 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: INFO nova.api.openstack.requestlog [None req-aa7d0a79-5f16-46fa-957e-7a7932b4dee0 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] 10.222.0.75 "GET /compute/v2.1/servers/bf2f6303-22b9-4cfa-8d4d-61d2503bc554" status: 200 len: 1407 microversion: 2.20 time: 0.349349 May 26 12:38:35.709481 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: [pid: 129321|app: 0|req: 50/106] 10.222.0.75 () {60 vars in 1276 bytes} [Thu May 26 12:38:35 2022] GET /compute/v2.1/servers/bf2f6303-22b9-4cfa-8d4d-61d2503bc554 => generated 1407 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 12:38:35.762763 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.policy [None req-11225431-9bbc-4c45-8340-92438581995b tempest-DeleteServersTestJSON-342872481 tempest-DeleteServersTestJSON-342872481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d19942e971b4d7fac3ab8f9a5ad6086', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0f340fa7ff24ca899b0f1036d0e6a3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129322) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:38:35.770669 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: INFO nova.api.openstack.requestlog [None req-11225431-9bbc-4c45-8340-92438581995b tempest-DeleteServersTestJSON-342872481 tempest-DeleteServersTestJSON-342872481-project] 10.222.0.75 "GET /compute/v2.1/servers/10054724-aefc-4a9f-a212-14e5fc5a1672" status: 200 len: 1315 microversion: 2.1 time: 0.290943 May 26 12:38:35.781067 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: [pid: 129322|app: 0|req: 57/107] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 26 12:38:35 2022] GET /compute/v2.1/servers/10054724-aefc-4a9f-a212-14e5fc5a1672 => generated 1315 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:38:36.495827 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi [None req-73022be8-6e6e-4e3e-a28f-1028693dadbe tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Calling method '>' {{(pid=129321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:38:36.499965 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.compute.api [None req-73022be8-6e6e-4e3e-a28f-1028693dadbe tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] [instance: 605b9171-aa87-432a-b179-c552640e73dd] Fetching instance by UUID {{(pid=129321) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:38:36.523381 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-73022be8-6e6e-4e3e-a28f-1028693dadbe tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:38:36.528274 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-73022be8-6e6e-4e3e-a28f-1028693dadbe tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:38:36.530638 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-73022be8-6e6e-4e3e-a28f-1028693dadbe tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:38:36.533787 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-73022be8-6e6e-4e3e-a28f-1028693dadbe tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:38:36.727764 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi [None req-b6247565-301a-4e97-9a6b-e346353d906c tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Calling method '>' {{(pid=129322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:38:36.729830 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.compute.api [None req-b6247565-301a-4e97-9a6b-e346353d906c tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] [instance: bf2f6303-22b9-4cfa-8d4d-61d2503bc554] Fetching instance by UUID {{(pid=129322) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:38:36.746532 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-b6247565-301a-4e97-9a6b-e346353d906c tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:38:36.748733 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-b6247565-301a-4e97-9a6b-e346353d906c tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:38:36.749941 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-b6247565-301a-4e97-9a6b-e346353d906c tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:38:36.750997 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-b6247565-301a-4e97-9a6b-e346353d906c tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:38:37.156100 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.policy [None req-b6247565-301a-4e97-9a6b-e346353d906c tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e811736979c44b02b14fecb74c6bd7ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675272fb40d4847819f83ec04afecef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129322) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:38:37.165387 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.policy [None req-b6247565-301a-4e97-9a6b-e346353d906c tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e811736979c44b02b14fecb74c6bd7ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675272fb40d4847819f83ec04afecef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129322) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:38:37.173667 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.policy [None req-b6247565-301a-4e97-9a6b-e346353d906c tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e811736979c44b02b14fecb74c6bd7ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675272fb40d4847819f83ec04afecef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129322) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:38:37.175012 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: INFO nova.api.openstack.requestlog [None req-b6247565-301a-4e97-9a6b-e346353d906c tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] 10.222.0.75 "GET /compute/v2.1/servers/bf2f6303-22b9-4cfa-8d4d-61d2503bc554" status: 200 len: 1407 microversion: 2.20 time: 0.452294 May 26 12:38:37.175793 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: [pid: 129322|app: 0|req: 58/108] 10.222.0.75 () {60 vars in 1276 bytes} [Thu May 26 12:38:36 2022] GET /compute/v2.1/servers/bf2f6303-22b9-4cfa-8d4d-61d2503bc554 => generated 1407 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 12:38:37.185715 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi [None req-21ae9693-d13b-48a4-90a7-6a1dcf8a3ea3 tempest-DeleteServersTestJSON-342872481 tempest-DeleteServersTestJSON-342872481-project] Calling method '>' {{(pid=129322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:38:37.186896 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.compute.api [None req-21ae9693-d13b-48a4-90a7-6a1dcf8a3ea3 tempest-DeleteServersTestJSON-342872481 tempest-DeleteServersTestJSON-342872481-project] [instance: 10054724-aefc-4a9f-a212-14e5fc5a1672] Fetching instance by UUID {{(pid=129322) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:38:37.203736 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-21ae9693-d13b-48a4-90a7-6a1dcf8a3ea3 tempest-DeleteServersTestJSON-342872481 tempest-DeleteServersTestJSON-342872481-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:38:37.204511 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-21ae9693-d13b-48a4-90a7-6a1dcf8a3ea3 tempest-DeleteServersTestJSON-342872481 tempest-DeleteServersTestJSON-342872481-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:38:37.205615 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-21ae9693-d13b-48a4-90a7-6a1dcf8a3ea3 tempest-DeleteServersTestJSON-342872481 tempest-DeleteServersTestJSON-342872481-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:38:37.208500 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-21ae9693-d13b-48a4-90a7-6a1dcf8a3ea3 tempest-DeleteServersTestJSON-342872481 tempest-DeleteServersTestJSON-342872481-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:38:37.444941 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.policy [None req-73022be8-6e6e-4e3e-a28f-1028693dadbe tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0431b1f25497443ba483b3c440669080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e36ab03283d4ce6a2fed5e111e03d34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129321) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:38:37.465169 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: INFO nova.api.openstack.requestlog [None req-73022be8-6e6e-4e3e-a28f-1028693dadbe tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] 10.222.0.75 "GET /compute/v2.1/servers/605b9171-aa87-432a-b179-c552640e73dd" status: 200 len: 1322 microversion: 2.1 time: 0.974445 May 26 12:38:37.479473 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: [pid: 129321|app: 0|req: 51/109] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 26 12:38:36 2022] GET /compute/v2.1/servers/605b9171-aa87-432a-b179-c552640e73dd => generated 1322 bytes in 990 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:38:37.676416 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.policy [None req-21ae9693-d13b-48a4-90a7-6a1dcf8a3ea3 tempest-DeleteServersTestJSON-342872481 tempest-DeleteServersTestJSON-342872481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d19942e971b4d7fac3ab8f9a5ad6086', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0f340fa7ff24ca899b0f1036d0e6a3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129322) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:38:37.686825 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: INFO nova.api.openstack.requestlog [None req-21ae9693-d13b-48a4-90a7-6a1dcf8a3ea3 tempest-DeleteServersTestJSON-342872481 tempest-DeleteServersTestJSON-342872481-project] 10.222.0.75 "GET /compute/v2.1/servers/10054724-aefc-4a9f-a212-14e5fc5a1672" status: 200 len: 1315 microversion: 2.1 time: 0.507515 May 26 12:38:37.696531 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: [pid: 129322|app: 0|req: 59/110] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 26 12:38:37 2022] GET /compute/v2.1/servers/10054724-aefc-4a9f-a212-14e5fc5a1672 => generated 1315 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:38:38.197136 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi [None req-47ee6f99-dae8-4fd9-919b-fff6dfaf1792 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Calling method '>' {{(pid=129321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:38:38.197734 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.compute.api [None req-47ee6f99-dae8-4fd9-919b-fff6dfaf1792 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] [instance: bf2f6303-22b9-4cfa-8d4d-61d2503bc554] Fetching instance by UUID {{(pid=129321) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:38:38.207455 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-47ee6f99-dae8-4fd9-919b-fff6dfaf1792 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:38:38.210425 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-47ee6f99-dae8-4fd9-919b-fff6dfaf1792 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:38:38.211634 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-47ee6f99-dae8-4fd9-919b-fff6dfaf1792 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:38:38.214216 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-47ee6f99-dae8-4fd9-919b-fff6dfaf1792 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:38:38.483129 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi [None req-e79b6afc-23cf-40e8-a4f1-1bd8aff30a59 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Calling method '>' {{(pid=129322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:38:38.483902 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.compute.api [None req-e79b6afc-23cf-40e8-a4f1-1bd8aff30a59 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] [instance: 605b9171-aa87-432a-b179-c552640e73dd] Fetching instance by UUID {{(pid=129322) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:38:38.491075 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-e79b6afc-23cf-40e8-a4f1-1bd8aff30a59 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:38:38.491586 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-e79b6afc-23cf-40e8-a4f1-1bd8aff30a59 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:38:38.492373 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-e79b6afc-23cf-40e8-a4f1-1bd8aff30a59 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:38:38.492858 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-e79b6afc-23cf-40e8-a4f1-1bd8aff30a59 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:38:38.533526 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.policy [None req-47ee6f99-dae8-4fd9-919b-fff6dfaf1792 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e811736979c44b02b14fecb74c6bd7ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675272fb40d4847819f83ec04afecef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129321) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:38:38.545712 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.policy [None req-47ee6f99-dae8-4fd9-919b-fff6dfaf1792 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e811736979c44b02b14fecb74c6bd7ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675272fb40d4847819f83ec04afecef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129321) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:38:38.550270 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.policy [None req-47ee6f99-dae8-4fd9-919b-fff6dfaf1792 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e811736979c44b02b14fecb74c6bd7ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675272fb40d4847819f83ec04afecef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129321) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:38:38.552361 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: INFO nova.api.openstack.requestlog [None req-47ee6f99-dae8-4fd9-919b-fff6dfaf1792 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] 10.222.0.75 "GET /compute/v2.1/servers/bf2f6303-22b9-4cfa-8d4d-61d2503bc554" status: 200 len: 1407 microversion: 2.20 time: 0.359522 May 26 12:38:38.556209 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: [pid: 129321|app: 0|req: 52/111] 10.222.0.75 () {60 vars in 1276 bytes} [Thu May 26 12:38:38 2022] GET /compute/v2.1/servers/bf2f6303-22b9-4cfa-8d4d-61d2503bc554 => generated 1407 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 12:38:38.706711 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi [None req-ffb08880-5d3f-412d-a9ee-3ddfaeca4633 tempest-DeleteServersTestJSON-342872481 tempest-DeleteServersTestJSON-342872481-project] Calling method '>' {{(pid=129321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:38:38.707671 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.compute.api [None req-ffb08880-5d3f-412d-a9ee-3ddfaeca4633 tempest-DeleteServersTestJSON-342872481 tempest-DeleteServersTestJSON-342872481-project] [instance: 10054724-aefc-4a9f-a212-14e5fc5a1672] Fetching instance by UUID {{(pid=129321) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:38:38.719728 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-ffb08880-5d3f-412d-a9ee-3ddfaeca4633 tempest-DeleteServersTestJSON-342872481 tempest-DeleteServersTestJSON-342872481-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:38:38.720419 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-ffb08880-5d3f-412d-a9ee-3ddfaeca4633 tempest-DeleteServersTestJSON-342872481 tempest-DeleteServersTestJSON-342872481-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:38:38.723181 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-ffb08880-5d3f-412d-a9ee-3ddfaeca4633 tempest-DeleteServersTestJSON-342872481 tempest-DeleteServersTestJSON-342872481-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:38:38.725498 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-ffb08880-5d3f-412d-a9ee-3ddfaeca4633 tempest-DeleteServersTestJSON-342872481 tempest-DeleteServersTestJSON-342872481-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:38:38.804054 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.policy [None req-e79b6afc-23cf-40e8-a4f1-1bd8aff30a59 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0431b1f25497443ba483b3c440669080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e36ab03283d4ce6a2fed5e111e03d34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129322) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:38:38.818985 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: INFO nova.api.openstack.requestlog [None req-e79b6afc-23cf-40e8-a4f1-1bd8aff30a59 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] 10.222.0.75 "GET /compute/v2.1/servers/605b9171-aa87-432a-b179-c552640e73dd" status: 200 len: 1322 microversion: 2.1 time: 0.339168 May 26 12:38:38.821430 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: [pid: 129322|app: 0|req: 60/112] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 26 12:38:38 2022] GET /compute/v2.1/servers/605b9171-aa87-432a-b179-c552640e73dd => generated 1322 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:38:39.444971 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.policy [None req-ffb08880-5d3f-412d-a9ee-3ddfaeca4633 tempest-DeleteServersTestJSON-342872481 tempest-DeleteServersTestJSON-342872481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d19942e971b4d7fac3ab8f9a5ad6086', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0f340fa7ff24ca899b0f1036d0e6a3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129321) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:38:39.460392 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: INFO nova.api.openstack.requestlog [None req-ffb08880-5d3f-412d-a9ee-3ddfaeca4633 tempest-DeleteServersTestJSON-342872481 tempest-DeleteServersTestJSON-342872481-project] 10.222.0.75 "GET /compute/v2.1/servers/10054724-aefc-4a9f-a212-14e5fc5a1672" status: 200 len: 1315 microversion: 2.1 time: 0.758639 May 26 12:38:39.461618 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: [pid: 129321|app: 0|req: 53/113] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 26 12:38:38 2022] GET /compute/v2.1/servers/10054724-aefc-4a9f-a212-14e5fc5a1672 => generated 1315 bytes in 762 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:38:39.585073 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi [None req-e4569cfd-1f36-432f-af47-e3344f8c9a77 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Calling method '>' {{(pid=129322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:38:39.586330 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.compute.api [None req-e4569cfd-1f36-432f-af47-e3344f8c9a77 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] [instance: bf2f6303-22b9-4cfa-8d4d-61d2503bc554] Fetching instance by UUID {{(pid=129322) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:38:39.593173 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-e4569cfd-1f36-432f-af47-e3344f8c9a77 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:38:39.593892 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-e4569cfd-1f36-432f-af47-e3344f8c9a77 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:38:39.594936 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-e4569cfd-1f36-432f-af47-e3344f8c9a77 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:38:39.595482 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-e4569cfd-1f36-432f-af47-e3344f8c9a77 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:38:39.713388 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi [req-a66ac346-aea4-4d78-bc18-0742122ae61c req-2a37e9ce-b4b9-48e9-ae30-13c16ce96542 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "605b9171-aa87-432a-b179-c552640e73dd", "tag": "58cde015-97f9-4885-b302-d0f8a82a584c"}]} {{(pid=129321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 12:38:39.761830 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [req-a66ac346-aea4-4d78-bc18-0742122ae61c req-2a37e9ce-b4b9-48e9-ae30-13c16ce96542 service nova] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:38:39.763313 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [req-a66ac346-aea4-4d78-bc18-0742122ae61c req-2a37e9ce-b4b9-48e9-ae30-13c16ce96542 service nova] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:38:39.798546 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: INFO nova.api.openstack.compute.server_external_events [req-a66ac346-aea4-4d78-bc18-0742122ae61c req-2a37e9ce-b4b9-48e9-ae30-13c16ce96542 service nova] Creating event network-changed:58cde015-97f9-4885-b302-d0f8a82a584c for instance 605b9171-aa87-432a-b179-c552640e73dd on hv-cinder-81966 May 26 12:38:39.813975 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: INFO nova.api.openstack.requestlog [req-a66ac346-aea4-4d78-bc18-0742122ae61c req-2a37e9ce-b4b9-48e9-ae30-13c16ce96542 service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.103510 May 26 12:38:39.816456 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: [pid: 129321|app: 0|req: 54/114] 10.222.0.75 () {64 vars in 1317 bytes} [Thu May 26 12:38:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 26 12:38:39.844010 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi [None req-10d605ea-bb6a-45b4-bc43-190b9d5b2557 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Calling method '>' {{(pid=129321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:38:39.844911 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.compute.api [None req-10d605ea-bb6a-45b4-bc43-190b9d5b2557 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] [instance: 605b9171-aa87-432a-b179-c552640e73dd] Fetching instance by UUID {{(pid=129321) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:38:39.859439 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-10d605ea-bb6a-45b4-bc43-190b9d5b2557 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:38:39.860076 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-10d605ea-bb6a-45b4-bc43-190b9d5b2557 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:38:39.861278 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-10d605ea-bb6a-45b4-bc43-190b9d5b2557 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:38:39.862116 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-10d605ea-bb6a-45b4-bc43-190b9d5b2557 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:38:39.869200 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.policy [None req-e4569cfd-1f36-432f-af47-e3344f8c9a77 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e811736979c44b02b14fecb74c6bd7ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675272fb40d4847819f83ec04afecef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129322) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:38:39.882765 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.policy [None req-e4569cfd-1f36-432f-af47-e3344f8c9a77 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e811736979c44b02b14fecb74c6bd7ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675272fb40d4847819f83ec04afecef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129322) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:38:39.888785 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.policy [None req-e4569cfd-1f36-432f-af47-e3344f8c9a77 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e811736979c44b02b14fecb74c6bd7ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675272fb40d4847819f83ec04afecef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129322) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:38:39.892582 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: INFO nova.api.openstack.requestlog [None req-e4569cfd-1f36-432f-af47-e3344f8c9a77 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] 10.222.0.75 "GET /compute/v2.1/servers/bf2f6303-22b9-4cfa-8d4d-61d2503bc554" status: 200 len: 1407 microversion: 2.20 time: 0.319188 May 26 12:38:39.895261 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: [pid: 129322|app: 0|req: 61/115] 10.222.0.75 () {60 vars in 1276 bytes} [Thu May 26 12:38:39 2022] GET /compute/v2.1/servers/bf2f6303-22b9-4cfa-8d4d-61d2503bc554 => generated 1407 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 12:38:40.195349 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.policy [None req-10d605ea-bb6a-45b4-bc43-190b9d5b2557 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0431b1f25497443ba483b3c440669080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e36ab03283d4ce6a2fed5e111e03d34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129321) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:38:40.204930 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: INFO nova.api.openstack.requestlog [None req-10d605ea-bb6a-45b4-bc43-190b9d5b2557 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] 10.222.0.75 "GET /compute/v2.1/servers/605b9171-aa87-432a-b179-c552640e73dd" status: 200 len: 1322 microversion: 2.1 time: 0.366137 May 26 12:38:40.212706 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: [pid: 129321|app: 0|req: 55/116] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 26 12:38:39 2022] GET /compute/v2.1/servers/605b9171-aa87-432a-b179-c552640e73dd => generated 1322 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:38:40.483793 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi [None req-0bdf3c5c-02dd-4ea8-a3d2-278fd9299ce6 tempest-DeleteServersTestJSON-342872481 tempest-DeleteServersTestJSON-342872481-project] Calling method '>' {{(pid=129322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:38:40.485441 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.compute.api [None req-0bdf3c5c-02dd-4ea8-a3d2-278fd9299ce6 tempest-DeleteServersTestJSON-342872481 tempest-DeleteServersTestJSON-342872481-project] [instance: 10054724-aefc-4a9f-a212-14e5fc5a1672] Fetching instance by UUID {{(pid=129322) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:38:40.504171 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-0bdf3c5c-02dd-4ea8-a3d2-278fd9299ce6 tempest-DeleteServersTestJSON-342872481 tempest-DeleteServersTestJSON-342872481-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:38:40.505046 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-0bdf3c5c-02dd-4ea8-a3d2-278fd9299ce6 tempest-DeleteServersTestJSON-342872481 tempest-DeleteServersTestJSON-342872481-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:38:40.508525 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-0bdf3c5c-02dd-4ea8-a3d2-278fd9299ce6 tempest-DeleteServersTestJSON-342872481 tempest-DeleteServersTestJSON-342872481-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:38:40.509446 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-0bdf3c5c-02dd-4ea8-a3d2-278fd9299ce6 tempest-DeleteServersTestJSON-342872481 tempest-DeleteServersTestJSON-342872481-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:38:40.770736 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.policy [None req-0bdf3c5c-02dd-4ea8-a3d2-278fd9299ce6 tempest-DeleteServersTestJSON-342872481 tempest-DeleteServersTestJSON-342872481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d19942e971b4d7fac3ab8f9a5ad6086', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0f340fa7ff24ca899b0f1036d0e6a3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129322) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:38:40.779904 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: INFO nova.api.openstack.requestlog [None req-0bdf3c5c-02dd-4ea8-a3d2-278fd9299ce6 tempest-DeleteServersTestJSON-342872481 tempest-DeleteServersTestJSON-342872481-project] 10.222.0.75 "GET /compute/v2.1/servers/10054724-aefc-4a9f-a212-14e5fc5a1672" status: 200 len: 1315 microversion: 2.1 time: 0.301705 May 26 12:38:40.781024 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: [pid: 129322|app: 0|req: 62/117] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 26 12:38:40 2022] GET /compute/v2.1/servers/10054724-aefc-4a9f-a212-14e5fc5a1672 => generated 1315 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:38:40.914415 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi [None req-27d35713-c787-4995-bbfc-dcf30868868f tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Calling method '>' {{(pid=129321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:38:40.916182 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.compute.api [None req-27d35713-c787-4995-bbfc-dcf30868868f tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] [instance: bf2f6303-22b9-4cfa-8d4d-61d2503bc554] Fetching instance by UUID {{(pid=129321) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:38:40.926415 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-27d35713-c787-4995-bbfc-dcf30868868f tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:38:40.927475 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-27d35713-c787-4995-bbfc-dcf30868868f tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:38:40.929494 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-27d35713-c787-4995-bbfc-dcf30868868f tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:38:40.930413 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-27d35713-c787-4995-bbfc-dcf30868868f tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:38:41.114169 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.policy [None req-27d35713-c787-4995-bbfc-dcf30868868f tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e811736979c44b02b14fecb74c6bd7ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675272fb40d4847819f83ec04afecef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129321) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:38:41.124012 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.policy [None req-27d35713-c787-4995-bbfc-dcf30868868f tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e811736979c44b02b14fecb74c6bd7ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675272fb40d4847819f83ec04afecef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129321) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:38:41.126198 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.policy [None req-27d35713-c787-4995-bbfc-dcf30868868f tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e811736979c44b02b14fecb74c6bd7ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675272fb40d4847819f83ec04afecef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129321) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:38:41.127899 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: INFO nova.api.openstack.requestlog [None req-27d35713-c787-4995-bbfc-dcf30868868f tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] 10.222.0.75 "GET /compute/v2.1/servers/bf2f6303-22b9-4cfa-8d4d-61d2503bc554" status: 200 len: 1407 microversion: 2.20 time: 0.220420 May 26 12:38:41.128564 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: [pid: 129321|app: 0|req: 56/118] 10.222.0.75 () {60 vars in 1276 bytes} [Thu May 26 12:38:40 2022] GET /compute/v2.1/servers/bf2f6303-22b9-4cfa-8d4d-61d2503bc554 => generated 1407 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 12:38:41.229516 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi [None req-3ef7776e-2a37-42be-8cd0-d2952cebd86e tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Calling method '>' {{(pid=129322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:38:41.230368 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.compute.api [None req-3ef7776e-2a37-42be-8cd0-d2952cebd86e tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] [instance: 605b9171-aa87-432a-b179-c552640e73dd] Fetching instance by UUID {{(pid=129322) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:38:41.238218 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-3ef7776e-2a37-42be-8cd0-d2952cebd86e tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:38:41.238908 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-3ef7776e-2a37-42be-8cd0-d2952cebd86e tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:38:41.239953 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-3ef7776e-2a37-42be-8cd0-d2952cebd86e tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:38:41.241204 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-3ef7776e-2a37-42be-8cd0-d2952cebd86e tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:38:41.471807 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.policy [None req-3ef7776e-2a37-42be-8cd0-d2952cebd86e tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0431b1f25497443ba483b3c440669080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e36ab03283d4ce6a2fed5e111e03d34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129322) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:38:41.480121 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: INFO nova.api.openstack.requestlog [None req-3ef7776e-2a37-42be-8cd0-d2952cebd86e tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] 10.222.0.75 "GET /compute/v2.1/servers/605b9171-aa87-432a-b179-c552640e73dd" status: 200 len: 1322 microversion: 2.1 time: 0.255457 May 26 12:38:41.481097 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: [pid: 129322|app: 0|req: 63/119] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 26 12:38:41 2022] GET /compute/v2.1/servers/605b9171-aa87-432a-b179-c552640e73dd => generated 1322 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:38:41.798566 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi [None req-ae28cb63-ece6-4b19-ae88-3ecb9448024b tempest-DeleteServersTestJSON-342872481 tempest-DeleteServersTestJSON-342872481-project] Calling method '>' {{(pid=129321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:38:41.799139 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.compute.api [None req-ae28cb63-ece6-4b19-ae88-3ecb9448024b tempest-DeleteServersTestJSON-342872481 tempest-DeleteServersTestJSON-342872481-project] [instance: 10054724-aefc-4a9f-a212-14e5fc5a1672] Fetching instance by UUID {{(pid=129321) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:38:41.806263 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-ae28cb63-ece6-4b19-ae88-3ecb9448024b tempest-DeleteServersTestJSON-342872481 tempest-DeleteServersTestJSON-342872481-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:38:41.806715 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-ae28cb63-ece6-4b19-ae88-3ecb9448024b tempest-DeleteServersTestJSON-342872481 tempest-DeleteServersTestJSON-342872481-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:38:41.807485 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-ae28cb63-ece6-4b19-ae88-3ecb9448024b tempest-DeleteServersTestJSON-342872481 tempest-DeleteServersTestJSON-342872481-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:38:41.809195 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-ae28cb63-ece6-4b19-ae88-3ecb9448024b tempest-DeleteServersTestJSON-342872481 tempest-DeleteServersTestJSON-342872481-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:38:41.911306 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi [req-3f0ec670-c14a-4773-a6d9-ef30c001ec99 req-75e11085-469b-47ca-b36a-480d64bda519 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "10054724-aefc-4a9f-a212-14e5fc5a1672", "name": "network-vif-plugged", "status": "completed", "tag": "d58039df-b2ef-4fd4-b2be-5a00ba363704"}]} {{(pid=129322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 12:38:41.920410 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [req-3f0ec670-c14a-4773-a6d9-ef30c001ec99 req-75e11085-469b-47ca-b36a-480d64bda519 service nova] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:38:41.920857 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [req-3f0ec670-c14a-4773-a6d9-ef30c001ec99 req-75e11085-469b-47ca-b36a-480d64bda519 service nova] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:38:41.946154 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: INFO nova.api.openstack.compute.server_external_events [req-3f0ec670-c14a-4773-a6d9-ef30c001ec99 req-75e11085-469b-47ca-b36a-480d64bda519 service nova] Creating event network-vif-plugged:d58039df-b2ef-4fd4-b2be-5a00ba363704 for instance 10054724-aefc-4a9f-a212-14e5fc5a1672 on hv-cinder-81966 May 26 12:38:41.960251 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: INFO nova.api.openstack.requestlog [req-3f0ec670-c14a-4773-a6d9-ef30c001ec99 req-75e11085-469b-47ca-b36a-480d64bda519 service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.117740 May 26 12:38:41.960924 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: [pid: 129322|app: 0|req: 64/120] 10.222.0.75 () {64 vars in 1317 bytes} [Thu May 26 12:38:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 26 12:38:41.984265 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi [req-9be55ba8-25ed-4f68-9b8a-c3f44a848a3b req-cd03d872-33b8-42e6-b5aa-0bfd358f7524 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f9200aab-6f49-4e6f-812b-93b2f3e1edd9", "tag": "246aaf0a-ebde-48cf-83fe-af3c152e1f14"}]} {{(pid=129322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 12:38:41.993484 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [req-9be55ba8-25ed-4f68-9b8a-c3f44a848a3b req-cd03d872-33b8-42e6-b5aa-0bfd358f7524 service nova] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:38:41.993958 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [req-9be55ba8-25ed-4f68-9b8a-c3f44a848a3b req-cd03d872-33b8-42e6-b5aa-0bfd358f7524 service nova] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:38:42.033429 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: INFO nova.api.openstack.compute.server_external_events [req-9be55ba8-25ed-4f68-9b8a-c3f44a848a3b req-cd03d872-33b8-42e6-b5aa-0bfd358f7524 service nova] Creating event network-changed:246aaf0a-ebde-48cf-83fe-af3c152e1f14 for instance f9200aab-6f49-4e6f-812b-93b2f3e1edd9 on hv-cinder-81966 May 26 12:38:42.050328 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: INFO nova.api.openstack.requestlog [req-9be55ba8-25ed-4f68-9b8a-c3f44a848a3b req-cd03d872-33b8-42e6-b5aa-0bfd358f7524 service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.085273 May 26 12:38:42.055156 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: [pid: 129322|app: 0|req: 65/121] 10.222.0.75 () {64 vars in 1317 bytes} [Thu May 26 12:38:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 12:38:42.156005 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi [None req-286e7a44-f0ba-4225-b7e3-f1b28e3aca92 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Calling method '>' {{(pid=129322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:38:42.156707 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.compute.api [None req-286e7a44-f0ba-4225-b7e3-f1b28e3aca92 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] [instance: bf2f6303-22b9-4cfa-8d4d-61d2503bc554] Fetching instance by UUID {{(pid=129322) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:38:42.166593 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-286e7a44-f0ba-4225-b7e3-f1b28e3aca92 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:38:42.167039 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-286e7a44-f0ba-4225-b7e3-f1b28e3aca92 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:38:42.171305 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-286e7a44-f0ba-4225-b7e3-f1b28e3aca92 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:38:42.171787 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-286e7a44-f0ba-4225-b7e3-f1b28e3aca92 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:38:42.181858 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG dbcounter [-] [129322] Writing DB stats nova_cell1:SELECT=100 {{(pid=129322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:38:42.361293 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.policy [None req-286e7a44-f0ba-4225-b7e3-f1b28e3aca92 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e811736979c44b02b14fecb74c6bd7ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675272fb40d4847819f83ec04afecef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129322) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:38:42.373313 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.policy [None req-286e7a44-f0ba-4225-b7e3-f1b28e3aca92 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e811736979c44b02b14fecb74c6bd7ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675272fb40d4847819f83ec04afecef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129322) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:38:42.377844 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.policy [None req-286e7a44-f0ba-4225-b7e3-f1b28e3aca92 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e811736979c44b02b14fecb74c6bd7ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675272fb40d4847819f83ec04afecef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129322) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:38:42.396920 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: INFO nova.api.openstack.requestlog [None req-286e7a44-f0ba-4225-b7e3-f1b28e3aca92 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] 10.222.0.75 "GET /compute/v2.1/servers/bf2f6303-22b9-4cfa-8d4d-61d2503bc554" status: 200 len: 1407 microversion: 2.20 time: 0.251568 May 26 12:38:42.398819 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: [pid: 129322|app: 0|req: 66/122] 10.222.0.75 () {60 vars in 1276 bytes} [Thu May 26 12:38:42 2022] GET /compute/v2.1/servers/bf2f6303-22b9-4cfa-8d4d-61d2503bc554 => generated 1407 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 12:38:42.401026 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.policy [None req-ae28cb63-ece6-4b19-ae88-3ecb9448024b tempest-DeleteServersTestJSON-342872481 tempest-DeleteServersTestJSON-342872481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d19942e971b4d7fac3ab8f9a5ad6086', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0f340fa7ff24ca899b0f1036d0e6a3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129321) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:38:42.413527 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: INFO nova.api.openstack.requestlog [None req-ae28cb63-ece6-4b19-ae88-3ecb9448024b tempest-DeleteServersTestJSON-342872481 tempest-DeleteServersTestJSON-342872481-project] 10.222.0.75 "GET /compute/v2.1/servers/10054724-aefc-4a9f-a212-14e5fc5a1672" status: 200 len: 1315 microversion: 2.1 time: 0.618712 May 26 12:38:42.415969 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: [pid: 129321|app: 0|req: 57/123] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 26 12:38:41 2022] GET /compute/v2.1/servers/10054724-aefc-4a9f-a212-14e5fc5a1672 => generated 1315 bytes in 622 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:38:42.497245 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi [None req-4d0b4033-4834-4e93-a8dc-5c6baa7f64b1 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Calling method '>' {{(pid=129322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:38:42.498423 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.compute.api [None req-4d0b4033-4834-4e93-a8dc-5c6baa7f64b1 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] [instance: 605b9171-aa87-432a-b179-c552640e73dd] Fetching instance by UUID {{(pid=129322) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:38:42.509760 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-4d0b4033-4834-4e93-a8dc-5c6baa7f64b1 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:38:42.511924 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-4d0b4033-4834-4e93-a8dc-5c6baa7f64b1 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:38:42.512920 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-4d0b4033-4834-4e93-a8dc-5c6baa7f64b1 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:38:42.517287 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-4d0b4033-4834-4e93-a8dc-5c6baa7f64b1 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:38:42.563408 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG dbcounter [-] [129322] Writing DB stats nova_cell0:SELECT=2 {{(pid=129322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:38:42.777148 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.policy [None req-4d0b4033-4834-4e93-a8dc-5c6baa7f64b1 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0431b1f25497443ba483b3c440669080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e36ab03283d4ce6a2fed5e111e03d34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129322) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:38:42.791287 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: INFO nova.api.openstack.requestlog [None req-4d0b4033-4834-4e93-a8dc-5c6baa7f64b1 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] 10.222.0.75 "GET /compute/v2.1/servers/605b9171-aa87-432a-b179-c552640e73dd" status: 200 len: 1322 microversion: 2.1 time: 0.298262 May 26 12:38:42.796551 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: [pid: 129322|app: 0|req: 67/124] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 26 12:38:42 2022] GET /compute/v2.1/servers/605b9171-aa87-432a-b179-c552640e73dd => generated 1322 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:38:43.421817 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi [None req-2feaaa52-2d6d-40f5-b9c6-3dd30299730c tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Calling method '>' {{(pid=129321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:38:43.423689 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.compute.api [None req-2feaaa52-2d6d-40f5-b9c6-3dd30299730c tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] [instance: bf2f6303-22b9-4cfa-8d4d-61d2503bc554] Fetching instance by UUID {{(pid=129321) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:38:43.432807 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi [None req-d786615e-9846-4dde-b66d-64b60ae29a91 tempest-DeleteServersTestJSON-342872481 tempest-DeleteServersTestJSON-342872481-project] Calling method '>' {{(pid=129322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:38:43.433471 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-2feaaa52-2d6d-40f5-b9c6-3dd30299730c tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:38:43.433835 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-2feaaa52-2d6d-40f5-b9c6-3dd30299730c tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:38:43.434407 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.compute.api [None req-d786615e-9846-4dde-b66d-64b60ae29a91 tempest-DeleteServersTestJSON-342872481 tempest-DeleteServersTestJSON-342872481-project] [instance: 10054724-aefc-4a9f-a212-14e5fc5a1672] Fetching instance by UUID {{(pid=129322) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:38:43.436678 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-2feaaa52-2d6d-40f5-b9c6-3dd30299730c tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:38:43.437331 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-2feaaa52-2d6d-40f5-b9c6-3dd30299730c tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:38:43.449703 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-d786615e-9846-4dde-b66d-64b60ae29a91 tempest-DeleteServersTestJSON-342872481 tempest-DeleteServersTestJSON-342872481-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:38:43.450401 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-d786615e-9846-4dde-b66d-64b60ae29a91 tempest-DeleteServersTestJSON-342872481 tempest-DeleteServersTestJSON-342872481-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:38:43.451809 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-d786615e-9846-4dde-b66d-64b60ae29a91 tempest-DeleteServersTestJSON-342872481 tempest-DeleteServersTestJSON-342872481-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:38:43.453462 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-d786615e-9846-4dde-b66d-64b60ae29a91 tempest-DeleteServersTestJSON-342872481 tempest-DeleteServersTestJSON-342872481-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:38:43.653846 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.policy [None req-d786615e-9846-4dde-b66d-64b60ae29a91 tempest-DeleteServersTestJSON-342872481 tempest-DeleteServersTestJSON-342872481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d19942e971b4d7fac3ab8f9a5ad6086', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0f340fa7ff24ca899b0f1036d0e6a3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129322) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:38:43.666717 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: INFO nova.api.openstack.requestlog [None req-d786615e-9846-4dde-b66d-64b60ae29a91 tempest-DeleteServersTestJSON-342872481 tempest-DeleteServersTestJSON-342872481-project] 10.222.0.75 "GET /compute/v2.1/servers/10054724-aefc-4a9f-a212-14e5fc5a1672" status: 200 len: 1315 microversion: 2.1 time: 0.238349 May 26 12:38:43.671745 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: [pid: 129322|app: 0|req: 68/125] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 26 12:38:43 2022] GET /compute/v2.1/servers/10054724-aefc-4a9f-a212-14e5fc5a1672 => generated 1315 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:38:43.753740 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.policy [None req-2feaaa52-2d6d-40f5-b9c6-3dd30299730c tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e811736979c44b02b14fecb74c6bd7ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675272fb40d4847819f83ec04afecef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129321) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:38:43.766156 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.policy [None req-2feaaa52-2d6d-40f5-b9c6-3dd30299730c tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e811736979c44b02b14fecb74c6bd7ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675272fb40d4847819f83ec04afecef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129321) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:38:43.767984 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.policy [None req-2feaaa52-2d6d-40f5-b9c6-3dd30299730c tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e811736979c44b02b14fecb74c6bd7ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675272fb40d4847819f83ec04afecef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129321) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:38:43.769661 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: INFO nova.api.openstack.requestlog [None req-2feaaa52-2d6d-40f5-b9c6-3dd30299730c tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] 10.222.0.75 "GET /compute/v2.1/servers/bf2f6303-22b9-4cfa-8d4d-61d2503bc554" status: 200 len: 1407 microversion: 2.20 time: 0.354766 May 26 12:38:43.777324 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: [pid: 129321|app: 0|req: 58/126] 10.222.0.75 () {60 vars in 1276 bytes} [Thu May 26 12:38:43 2022] GET /compute/v2.1/servers/bf2f6303-22b9-4cfa-8d4d-61d2503bc554 => generated 1407 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 12:38:43.812985 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi [None req-f91f4778-187f-4fd5-a5d3-fdfd520a997b tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Calling method '>' {{(pid=129322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:38:43.814878 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.compute.api [None req-f91f4778-187f-4fd5-a5d3-fdfd520a997b tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] [instance: 605b9171-aa87-432a-b179-c552640e73dd] Fetching instance by UUID {{(pid=129322) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:38:43.828739 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-f91f4778-187f-4fd5-a5d3-fdfd520a997b tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:38:43.829794 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-f91f4778-187f-4fd5-a5d3-fdfd520a997b tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:38:43.834642 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-f91f4778-187f-4fd5-a5d3-fdfd520a997b tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:38:43.835267 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-f91f4778-187f-4fd5-a5d3-fdfd520a997b tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:38:44.008232 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.policy [None req-f91f4778-187f-4fd5-a5d3-fdfd520a997b tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0431b1f25497443ba483b3c440669080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e36ab03283d4ce6a2fed5e111e03d34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129322) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:38:44.017065 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: INFO nova.api.openstack.requestlog [None req-f91f4778-187f-4fd5-a5d3-fdfd520a997b tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] 10.222.0.75 "GET /compute/v2.1/servers/605b9171-aa87-432a-b179-c552640e73dd" status: 200 len: 1322 microversion: 2.1 time: 0.209035 May 26 12:38:44.017697 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: [pid: 129322|app: 0|req: 69/127] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 26 12:38:43 2022] GET /compute/v2.1/servers/605b9171-aa87-432a-b179-c552640e73dd => generated 1322 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:38:44.683656 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi [None req-d3e3bc19-f5db-4650-ac37-e6294cefb84d tempest-DeleteServersTestJSON-342872481 tempest-DeleteServersTestJSON-342872481-project] Calling method '>' {{(pid=129321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:38:44.684968 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.compute.api [None req-d3e3bc19-f5db-4650-ac37-e6294cefb84d tempest-DeleteServersTestJSON-342872481 tempest-DeleteServersTestJSON-342872481-project] [instance: 10054724-aefc-4a9f-a212-14e5fc5a1672] Fetching instance by UUID {{(pid=129321) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:38:44.692292 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-d3e3bc19-f5db-4650-ac37-e6294cefb84d tempest-DeleteServersTestJSON-342872481 tempest-DeleteServersTestJSON-342872481-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:38:44.692866 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-d3e3bc19-f5db-4650-ac37-e6294cefb84d tempest-DeleteServersTestJSON-342872481 tempest-DeleteServersTestJSON-342872481-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:38:44.693862 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-d3e3bc19-f5db-4650-ac37-e6294cefb84d tempest-DeleteServersTestJSON-342872481 tempest-DeleteServersTestJSON-342872481-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:38:44.694289 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-d3e3bc19-f5db-4650-ac37-e6294cefb84d tempest-DeleteServersTestJSON-342872481 tempest-DeleteServersTestJSON-342872481-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:38:44.795289 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi [None req-b68d7436-c2d9-4d19-af70-e009b2f009a2 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Calling method '>' {{(pid=129322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:38:44.795920 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.compute.api [None req-b68d7436-c2d9-4d19-af70-e009b2f009a2 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] [instance: bf2f6303-22b9-4cfa-8d4d-61d2503bc554] Fetching instance by UUID {{(pid=129322) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:38:44.802916 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-b68d7436-c2d9-4d19-af70-e009b2f009a2 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:38:44.803430 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-b68d7436-c2d9-4d19-af70-e009b2f009a2 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:38:44.804447 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-b68d7436-c2d9-4d19-af70-e009b2f009a2 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:38:44.805257 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-b68d7436-c2d9-4d19-af70-e009b2f009a2 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:38:44.859226 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.policy [None req-d3e3bc19-f5db-4650-ac37-e6294cefb84d tempest-DeleteServersTestJSON-342872481 tempest-DeleteServersTestJSON-342872481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d19942e971b4d7fac3ab8f9a5ad6086', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0f340fa7ff24ca899b0f1036d0e6a3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129321) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:38:44.870380 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: INFO nova.api.openstack.requestlog [None req-d3e3bc19-f5db-4650-ac37-e6294cefb84d tempest-DeleteServersTestJSON-342872481 tempest-DeleteServersTestJSON-342872481-project] 10.222.0.75 "GET /compute/v2.1/servers/10054724-aefc-4a9f-a212-14e5fc5a1672" status: 200 len: 1315 microversion: 2.1 time: 0.189871 May 26 12:38:44.872539 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: [pid: 129321|app: 0|req: 59/128] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 26 12:38:44 2022] GET /compute/v2.1/servers/10054724-aefc-4a9f-a212-14e5fc5a1672 => generated 1315 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:38:45.014421 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.policy [None req-b68d7436-c2d9-4d19-af70-e009b2f009a2 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e811736979c44b02b14fecb74c6bd7ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675272fb40d4847819f83ec04afecef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129322) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:38:45.033896 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.policy [None req-b68d7436-c2d9-4d19-af70-e009b2f009a2 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e811736979c44b02b14fecb74c6bd7ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675272fb40d4847819f83ec04afecef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129322) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:38:45.036168 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.policy [None req-b68d7436-c2d9-4d19-af70-e009b2f009a2 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e811736979c44b02b14fecb74c6bd7ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675272fb40d4847819f83ec04afecef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129322) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:38:45.037537 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: INFO nova.api.openstack.requestlog [None req-b68d7436-c2d9-4d19-af70-e009b2f009a2 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] 10.222.0.75 "GET /compute/v2.1/servers/bf2f6303-22b9-4cfa-8d4d-61d2503bc554" status: 200 len: 1407 microversion: 2.20 time: 0.247279 May 26 12:38:45.039294 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi [None req-219bfc3c-dd15-48fd-9887-58d60b941691 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Calling method '>' {{(pid=129321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:38:45.040647 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.compute.api [None req-219bfc3c-dd15-48fd-9887-58d60b941691 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] [instance: 605b9171-aa87-432a-b179-c552640e73dd] Fetching instance by UUID {{(pid=129321) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:38:45.048987 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: [pid: 129322|app: 0|req: 70/129] 10.222.0.75 () {60 vars in 1276 bytes} [Thu May 26 12:38:44 2022] GET /compute/v2.1/servers/bf2f6303-22b9-4cfa-8d4d-61d2503bc554 => generated 1407 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 26 12:38:45.052096 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-219bfc3c-dd15-48fd-9887-58d60b941691 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:38:45.054276 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-219bfc3c-dd15-48fd-9887-58d60b941691 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:38:45.056744 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-219bfc3c-dd15-48fd-9887-58d60b941691 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:38:45.057194 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-219bfc3c-dd15-48fd-9887-58d60b941691 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:38:45.082444 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG dbcounter [-] [129321] Writing DB stats nova_cell1:SELECT=100 {{(pid=129321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:38:45.258084 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.policy [None req-219bfc3c-dd15-48fd-9887-58d60b941691 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0431b1f25497443ba483b3c440669080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e36ab03283d4ce6a2fed5e111e03d34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129321) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:38:45.271591 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: INFO nova.api.openstack.requestlog [None req-219bfc3c-dd15-48fd-9887-58d60b941691 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] 10.222.0.75 "GET /compute/v2.1/servers/605b9171-aa87-432a-b179-c552640e73dd" status: 200 len: 1322 microversion: 2.1 time: 0.238593 May 26 12:38:45.276894 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: [pid: 129321|app: 0|req: 60/130] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 26 12:38:45 2022] GET /compute/v2.1/servers/605b9171-aa87-432a-b179-c552640e73dd => generated 1322 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:38:45.378471 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi [req-5172a318-d7e2-4fb6-bf68-2f57fe165d97 req-03559953-dc4d-4298-89ac-4feff0a0ac8d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bf2f6303-22b9-4cfa-8d4d-61d2503bc554", "name": "network-vif-plugged", "status": "completed", "tag": "fe40ed8f-f450-48f7-876a-abe2fea7abe5"}]} {{(pid=129322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 12:38:45.392013 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [req-5172a318-d7e2-4fb6-bf68-2f57fe165d97 req-03559953-dc4d-4298-89ac-4feff0a0ac8d service nova] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:38:45.392853 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [req-5172a318-d7e2-4fb6-bf68-2f57fe165d97 req-03559953-dc4d-4298-89ac-4feff0a0ac8d service nova] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:38:45.410034 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: INFO nova.api.openstack.compute.server_external_events [req-5172a318-d7e2-4fb6-bf68-2f57fe165d97 req-03559953-dc4d-4298-89ac-4feff0a0ac8d service nova] Creating event network-vif-plugged:fe40ed8f-f450-48f7-876a-abe2fea7abe5 for instance bf2f6303-22b9-4cfa-8d4d-61d2503bc554 on hv-cinder-81966 May 26 12:38:45.416991 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: INFO nova.api.openstack.requestlog [req-5172a318-d7e2-4fb6-bf68-2f57fe165d97 req-03559953-dc4d-4298-89ac-4feff0a0ac8d service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042425 May 26 12:38:45.418339 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: [pid: 129322|app: 0|req: 71/131] 10.222.0.75 () {64 vars in 1317 bytes} [Thu May 26 12:38:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 26 12:38:45.889559 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi [None req-b8722878-4c60-4670-81fd-12f783c9a4c7 tempest-DeleteServersTestJSON-342872481 tempest-DeleteServersTestJSON-342872481-project] Calling method '>' {{(pid=129321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:38:45.890870 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.compute.api [None req-b8722878-4c60-4670-81fd-12f783c9a4c7 tempest-DeleteServersTestJSON-342872481 tempest-DeleteServersTestJSON-342872481-project] [instance: 10054724-aefc-4a9f-a212-14e5fc5a1672] Fetching instance by UUID {{(pid=129321) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:38:45.894116 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG dbcounter [-] [129321] Writing DB stats nova_cell0:SELECT=2 {{(pid=129321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:38:45.899636 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-b8722878-4c60-4670-81fd-12f783c9a4c7 tempest-DeleteServersTestJSON-342872481 tempest-DeleteServersTestJSON-342872481-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:38:45.903432 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-b8722878-4c60-4670-81fd-12f783c9a4c7 tempest-DeleteServersTestJSON-342872481 tempest-DeleteServersTestJSON-342872481-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:38:45.904463 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-b8722878-4c60-4670-81fd-12f783c9a4c7 tempest-DeleteServersTestJSON-342872481 tempest-DeleteServersTestJSON-342872481-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:38:45.906938 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-b8722878-4c60-4670-81fd-12f783c9a4c7 tempest-DeleteServersTestJSON-342872481 tempest-DeleteServersTestJSON-342872481-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:38:46.056805 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi [None req-f99fba81-5805-45bb-be32-ea060554eb9b tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Calling method '>' {{(pid=129322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:38:46.057501 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.compute.api [None req-f99fba81-5805-45bb-be32-ea060554eb9b tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] [instance: bf2f6303-22b9-4cfa-8d4d-61d2503bc554] Fetching instance by UUID {{(pid=129322) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:38:46.065533 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-f99fba81-5805-45bb-be32-ea060554eb9b tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:38:46.066913 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-f99fba81-5805-45bb-be32-ea060554eb9b tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:38:46.068143 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-f99fba81-5805-45bb-be32-ea060554eb9b tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:38:46.072202 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-f99fba81-5805-45bb-be32-ea060554eb9b tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:38:46.085870 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.policy [None req-b8722878-4c60-4670-81fd-12f783c9a4c7 tempest-DeleteServersTestJSON-342872481 tempest-DeleteServersTestJSON-342872481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d19942e971b4d7fac3ab8f9a5ad6086', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0f340fa7ff24ca899b0f1036d0e6a3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129321) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:38:46.097707 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: INFO nova.api.openstack.requestlog [None req-b8722878-4c60-4670-81fd-12f783c9a4c7 tempest-DeleteServersTestJSON-342872481 tempest-DeleteServersTestJSON-342872481-project] 10.222.0.75 "GET /compute/v2.1/servers/10054724-aefc-4a9f-a212-14e5fc5a1672" status: 200 len: 1315 microversion: 2.1 time: 0.210664 May 26 12:38:46.098475 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: [pid: 129321|app: 0|req: 61/132] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 26 12:38:45 2022] GET /compute/v2.1/servers/10054724-aefc-4a9f-a212-14e5fc5a1672 => generated 1315 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:38:46.250578 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.policy [None req-f99fba81-5805-45bb-be32-ea060554eb9b tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e811736979c44b02b14fecb74c6bd7ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675272fb40d4847819f83ec04afecef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129322) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:38:46.259383 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.policy [None req-f99fba81-5805-45bb-be32-ea060554eb9b tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e811736979c44b02b14fecb74c6bd7ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675272fb40d4847819f83ec04afecef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129322) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:38:46.260927 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.policy [None req-f99fba81-5805-45bb-be32-ea060554eb9b tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e811736979c44b02b14fecb74c6bd7ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675272fb40d4847819f83ec04afecef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129322) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:38:46.262031 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: INFO nova.api.openstack.requestlog [None req-f99fba81-5805-45bb-be32-ea060554eb9b tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] 10.222.0.75 "GET /compute/v2.1/servers/bf2f6303-22b9-4cfa-8d4d-61d2503bc554" status: 200 len: 1407 microversion: 2.20 time: 0.210088 May 26 12:38:46.262685 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: [pid: 129322|app: 0|req: 72/133] 10.222.0.75 () {60 vars in 1276 bytes} [Thu May 26 12:38:46 2022] GET /compute/v2.1/servers/bf2f6303-22b9-4cfa-8d4d-61d2503bc554 => generated 1407 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 26 12:38:46.292818 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi [None req-114edaee-0265-4a54-9f4d-23f9f6d9e458 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Calling method '>' {{(pid=129321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:38:46.293476 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.compute.api [None req-114edaee-0265-4a54-9f4d-23f9f6d9e458 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] [instance: 605b9171-aa87-432a-b179-c552640e73dd] Fetching instance by UUID {{(pid=129321) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:38:46.299643 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-114edaee-0265-4a54-9f4d-23f9f6d9e458 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:38:46.300302 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-114edaee-0265-4a54-9f4d-23f9f6d9e458 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:38:46.301255 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-114edaee-0265-4a54-9f4d-23f9f6d9e458 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:38:46.301850 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-114edaee-0265-4a54-9f4d-23f9f6d9e458 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:38:46.517546 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.policy [None req-114edaee-0265-4a54-9f4d-23f9f6d9e458 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0431b1f25497443ba483b3c440669080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e36ab03283d4ce6a2fed5e111e03d34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129321) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:38:46.527353 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: INFO nova.api.openstack.requestlog [None req-114edaee-0265-4a54-9f4d-23f9f6d9e458 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] 10.222.0.75 "GET /compute/v2.1/servers/605b9171-aa87-432a-b179-c552640e73dd" status: 200 len: 1322 microversion: 2.1 time: 0.238329 May 26 12:38:46.528209 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: [pid: 129321|app: 0|req: 62/134] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 26 12:38:46 2022] GET /compute/v2.1/servers/605b9171-aa87-432a-b179-c552640e73dd => generated 1322 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:38:47.114591 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi [None req-2337ea0d-23b4-4fd4-8d6d-56906b7b3791 tempest-DeleteServersTestJSON-342872481 tempest-DeleteServersTestJSON-342872481-project] Calling method '>' {{(pid=129322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:38:47.115263 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.compute.api [None req-2337ea0d-23b4-4fd4-8d6d-56906b7b3791 tempest-DeleteServersTestJSON-342872481 tempest-DeleteServersTestJSON-342872481-project] [instance: 10054724-aefc-4a9f-a212-14e5fc5a1672] Fetching instance by UUID {{(pid=129322) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:38:47.121499 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-2337ea0d-23b4-4fd4-8d6d-56906b7b3791 tempest-DeleteServersTestJSON-342872481 tempest-DeleteServersTestJSON-342872481-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:38:47.121934 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-2337ea0d-23b4-4fd4-8d6d-56906b7b3791 tempest-DeleteServersTestJSON-342872481 tempest-DeleteServersTestJSON-342872481-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:38:47.122694 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-2337ea0d-23b4-4fd4-8d6d-56906b7b3791 tempest-DeleteServersTestJSON-342872481 tempest-DeleteServersTestJSON-342872481-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:38:47.123119 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-2337ea0d-23b4-4fd4-8d6d-56906b7b3791 tempest-DeleteServersTestJSON-342872481 tempest-DeleteServersTestJSON-342872481-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:38:47.281638 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi [None req-f2d61e0c-e7d3-4cdd-93e1-30b5587c0649 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Calling method '>' {{(pid=129321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:38:47.282251 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.compute.api [None req-f2d61e0c-e7d3-4cdd-93e1-30b5587c0649 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] [instance: bf2f6303-22b9-4cfa-8d4d-61d2503bc554] Fetching instance by UUID {{(pid=129321) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:38:47.286782 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.policy [None req-2337ea0d-23b4-4fd4-8d6d-56906b7b3791 tempest-DeleteServersTestJSON-342872481 tempest-DeleteServersTestJSON-342872481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d19942e971b4d7fac3ab8f9a5ad6086', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0f340fa7ff24ca899b0f1036d0e6a3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129322) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:38:47.289390 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-f2d61e0c-e7d3-4cdd-93e1-30b5587c0649 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:38:47.289857 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-f2d61e0c-e7d3-4cdd-93e1-30b5587c0649 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:38:47.291054 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-f2d61e0c-e7d3-4cdd-93e1-30b5587c0649 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:38:47.291488 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-f2d61e0c-e7d3-4cdd-93e1-30b5587c0649 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:38:47.301542 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: INFO nova.api.openstack.requestlog [None req-2337ea0d-23b4-4fd4-8d6d-56906b7b3791 tempest-DeleteServersTestJSON-342872481 tempest-DeleteServersTestJSON-342872481-project] 10.222.0.75 "GET /compute/v2.1/servers/10054724-aefc-4a9f-a212-14e5fc5a1672" status: 200 len: 1315 microversion: 2.1 time: 0.190703 May 26 12:38:47.302394 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: [pid: 129322|app: 0|req: 73/135] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 26 12:38:47 2022] GET /compute/v2.1/servers/10054724-aefc-4a9f-a212-14e5fc5a1672 => generated 1315 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 12:38:47.434142 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.policy [None req-f2d61e0c-e7d3-4cdd-93e1-30b5587c0649 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e811736979c44b02b14fecb74c6bd7ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675272fb40d4847819f83ec04afecef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129321) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:38:47.442224 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.policy [None req-f2d61e0c-e7d3-4cdd-93e1-30b5587c0649 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e811736979c44b02b14fecb74c6bd7ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675272fb40d4847819f83ec04afecef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129321) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:38:47.443872 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.policy [None req-f2d61e0c-e7d3-4cdd-93e1-30b5587c0649 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e811736979c44b02b14fecb74c6bd7ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675272fb40d4847819f83ec04afecef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129321) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:38:47.444964 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: INFO nova.api.openstack.requestlog [None req-f2d61e0c-e7d3-4cdd-93e1-30b5587c0649 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] 10.222.0.75 "GET /compute/v2.1/servers/bf2f6303-22b9-4cfa-8d4d-61d2503bc554" status: 200 len: 1407 microversion: 2.20 time: 0.168958 May 26 12:38:47.445534 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: [pid: 129321|app: 0|req: 63/136] 10.222.0.75 () {60 vars in 1276 bytes} [Thu May 26 12:38:47 2022] GET /compute/v2.1/servers/bf2f6303-22b9-4cfa-8d4d-61d2503bc554 => generated 1407 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 26 12:38:47.549333 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi [None req-6620d397-d682-4676-9ee2-16d027a64d54 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Calling method '>' {{(pid=129322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:38:47.550328 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.compute.api [None req-6620d397-d682-4676-9ee2-16d027a64d54 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] [instance: 605b9171-aa87-432a-b179-c552640e73dd] Fetching instance by UUID {{(pid=129322) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:38:47.557753 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-6620d397-d682-4676-9ee2-16d027a64d54 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:38:47.558207 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-6620d397-d682-4676-9ee2-16d027a64d54 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:38:47.558970 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-6620d397-d682-4676-9ee2-16d027a64d54 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:38:47.559408 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-6620d397-d682-4676-9ee2-16d027a64d54 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:38:47.700159 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.policy [None req-6620d397-d682-4676-9ee2-16d027a64d54 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0431b1f25497443ba483b3c440669080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e36ab03283d4ce6a2fed5e111e03d34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129322) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:38:47.708160 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: INFO nova.api.openstack.requestlog [None req-6620d397-d682-4676-9ee2-16d027a64d54 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] 10.222.0.75 "GET /compute/v2.1/servers/605b9171-aa87-432a-b179-c552640e73dd" status: 200 len: 1322 microversion: 2.1 time: 0.165404 May 26 12:38:47.708750 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: [pid: 129322|app: 0|req: 74/137] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 26 12:38:47 2022] GET /compute/v2.1/servers/605b9171-aa87-432a-b179-c552640e73dd => generated 1322 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:38:48.318874 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi [None req-58b5faf1-7701-45e2-bb83-c856d6ab39f0 tempest-DeleteServersTestJSON-342872481 tempest-DeleteServersTestJSON-342872481-project] Calling method '>' {{(pid=129321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:38:48.319384 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.compute.api [None req-58b5faf1-7701-45e2-bb83-c856d6ab39f0 tempest-DeleteServersTestJSON-342872481 tempest-DeleteServersTestJSON-342872481-project] [instance: 10054724-aefc-4a9f-a212-14e5fc5a1672] Fetching instance by UUID {{(pid=129321) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:38:48.325762 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-58b5faf1-7701-45e2-bb83-c856d6ab39f0 tempest-DeleteServersTestJSON-342872481 tempest-DeleteServersTestJSON-342872481-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:38:48.326210 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-58b5faf1-7701-45e2-bb83-c856d6ab39f0 tempest-DeleteServersTestJSON-342872481 tempest-DeleteServersTestJSON-342872481-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:38:48.326978 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-58b5faf1-7701-45e2-bb83-c856d6ab39f0 tempest-DeleteServersTestJSON-342872481 tempest-DeleteServersTestJSON-342872481-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:38:48.327408 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-58b5faf1-7701-45e2-bb83-c856d6ab39f0 tempest-DeleteServersTestJSON-342872481 tempest-DeleteServersTestJSON-342872481-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:38:48.462090 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi [None req-99f04a0b-e096-41e2-ae03-27a13a9a96dc tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Calling method '>' {{(pid=129322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:38:48.462698 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.compute.api [None req-99f04a0b-e096-41e2-ae03-27a13a9a96dc tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] [instance: bf2f6303-22b9-4cfa-8d4d-61d2503bc554] Fetching instance by UUID {{(pid=129322) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:38:48.473564 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-99f04a0b-e096-41e2-ae03-27a13a9a96dc tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:38:48.475470 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-99f04a0b-e096-41e2-ae03-27a13a9a96dc tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:38:48.476781 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-99f04a0b-e096-41e2-ae03-27a13a9a96dc tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:38:48.477335 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-99f04a0b-e096-41e2-ae03-27a13a9a96dc tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:38:48.498635 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.policy [None req-58b5faf1-7701-45e2-bb83-c856d6ab39f0 tempest-DeleteServersTestJSON-342872481 tempest-DeleteServersTestJSON-342872481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d19942e971b4d7fac3ab8f9a5ad6086', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0f340fa7ff24ca899b0f1036d0e6a3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129321) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:38:48.508750 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: INFO nova.api.openstack.requestlog [None req-58b5faf1-7701-45e2-bb83-c856d6ab39f0 tempest-DeleteServersTestJSON-342872481 tempest-DeleteServersTestJSON-342872481-project] 10.222.0.75 "GET /compute/v2.1/servers/10054724-aefc-4a9f-a212-14e5fc5a1672" status: 200 len: 1315 microversion: 2.1 time: 0.193943 May 26 12:38:48.510384 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: [pid: 129321|app: 0|req: 64/138] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 26 12:38:48 2022] GET /compute/v2.1/servers/10054724-aefc-4a9f-a212-14e5fc5a1672 => generated 1315 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:38:48.617130 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.policy [None req-99f04a0b-e096-41e2-ae03-27a13a9a96dc tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e811736979c44b02b14fecb74c6bd7ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675272fb40d4847819f83ec04afecef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129322) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:38:48.625651 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.policy [None req-99f04a0b-e096-41e2-ae03-27a13a9a96dc tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e811736979c44b02b14fecb74c6bd7ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675272fb40d4847819f83ec04afecef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129322) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:38:48.627486 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.policy [None req-99f04a0b-e096-41e2-ae03-27a13a9a96dc tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e811736979c44b02b14fecb74c6bd7ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675272fb40d4847819f83ec04afecef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129322) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:38:48.628847 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: INFO nova.api.openstack.requestlog [None req-99f04a0b-e096-41e2-ae03-27a13a9a96dc tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] 10.222.0.75 "GET /compute/v2.1/servers/bf2f6303-22b9-4cfa-8d4d-61d2503bc554" status: 200 len: 1407 microversion: 2.20 time: 0.170664 May 26 12:38:48.629565 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: [pid: 129322|app: 0|req: 75/139] 10.222.0.75 () {60 vars in 1276 bytes} [Thu May 26 12:38:48 2022] GET /compute/v2.1/servers/bf2f6303-22b9-4cfa-8d4d-61d2503bc554 => generated 1407 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 12:38:48.726254 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi [None req-77c337e4-97c9-47b6-ad12-9f1d6e8634bf tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Calling method '>' {{(pid=129321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:38:48.726855 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.compute.api [None req-77c337e4-97c9-47b6-ad12-9f1d6e8634bf tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] [instance: 605b9171-aa87-432a-b179-c552640e73dd] Fetching instance by UUID {{(pid=129321) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:38:48.733027 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-77c337e4-97c9-47b6-ad12-9f1d6e8634bf tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:38:48.733653 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-77c337e4-97c9-47b6-ad12-9f1d6e8634bf tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:38:48.734408 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-77c337e4-97c9-47b6-ad12-9f1d6e8634bf tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:38:48.734829 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-77c337e4-97c9-47b6-ad12-9f1d6e8634bf tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:38:48.898722 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.policy [None req-77c337e4-97c9-47b6-ad12-9f1d6e8634bf tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0431b1f25497443ba483b3c440669080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e36ab03283d4ce6a2fed5e111e03d34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129321) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:38:48.907253 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: INFO nova.api.openstack.requestlog [None req-77c337e4-97c9-47b6-ad12-9f1d6e8634bf tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] 10.222.0.75 "GET /compute/v2.1/servers/605b9171-aa87-432a-b179-c552640e73dd" status: 200 len: 1322 microversion: 2.1 time: 0.185272 May 26 12:38:48.907950 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: [pid: 129321|app: 0|req: 65/140] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 26 12:38:48 2022] GET /compute/v2.1/servers/605b9171-aa87-432a-b179-c552640e73dd => generated 1322 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:38:49.526938 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi [None req-de388f9c-1b90-413e-b54c-df67eefde489 tempest-DeleteServersTestJSON-342872481 tempest-DeleteServersTestJSON-342872481-project] Calling method '>' {{(pid=129322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:38:49.527596 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.compute.api [None req-de388f9c-1b90-413e-b54c-df67eefde489 tempest-DeleteServersTestJSON-342872481 tempest-DeleteServersTestJSON-342872481-project] [instance: 10054724-aefc-4a9f-a212-14e5fc5a1672] Fetching instance by UUID {{(pid=129322) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:38:49.534085 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-de388f9c-1b90-413e-b54c-df67eefde489 tempest-DeleteServersTestJSON-342872481 tempest-DeleteServersTestJSON-342872481-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:38:49.534520 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-de388f9c-1b90-413e-b54c-df67eefde489 tempest-DeleteServersTestJSON-342872481 tempest-DeleteServersTestJSON-342872481-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:38:49.535273 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-de388f9c-1b90-413e-b54c-df67eefde489 tempest-DeleteServersTestJSON-342872481 tempest-DeleteServersTestJSON-342872481-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:38:49.535731 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-de388f9c-1b90-413e-b54c-df67eefde489 tempest-DeleteServersTestJSON-342872481 tempest-DeleteServersTestJSON-342872481-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:38:49.648468 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi [None req-e8536a0a-45a7-4f06-973a-343eec25d64b tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Calling method '>' {{(pid=129321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:38:49.649048 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.compute.api [None req-e8536a0a-45a7-4f06-973a-343eec25d64b tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] [instance: bf2f6303-22b9-4cfa-8d4d-61d2503bc554] Fetching instance by UUID {{(pid=129321) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:38:49.655368 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-e8536a0a-45a7-4f06-973a-343eec25d64b tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:38:49.655816 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-e8536a0a-45a7-4f06-973a-343eec25d64b tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:38:49.656571 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-e8536a0a-45a7-4f06-973a-343eec25d64b tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:38:49.656997 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-e8536a0a-45a7-4f06-973a-343eec25d64b tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:38:49.677103 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.policy [None req-de388f9c-1b90-413e-b54c-df67eefde489 tempest-DeleteServersTestJSON-342872481 tempest-DeleteServersTestJSON-342872481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d19942e971b4d7fac3ab8f9a5ad6086', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0f340fa7ff24ca899b0f1036d0e6a3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129322) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:38:49.684879 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: INFO nova.api.openstack.requestlog [None req-de388f9c-1b90-413e-b54c-df67eefde489 tempest-DeleteServersTestJSON-342872481 tempest-DeleteServersTestJSON-342872481-project] 10.222.0.75 "GET /compute/v2.1/servers/10054724-aefc-4a9f-a212-14e5fc5a1672" status: 200 len: 1315 microversion: 2.1 time: 0.161937 May 26 12:38:49.685587 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: [pid: 129322|app: 0|req: 76/141] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 26 12:38:49 2022] GET /compute/v2.1/servers/10054724-aefc-4a9f-a212-14e5fc5a1672 => generated 1315 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:38:49.928446 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi [None req-4a648810-6dd6-4359-a221-ac5feea322b9 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Calling method '>' {{(pid=129322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:38:49.929139 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.compute.api [None req-4a648810-6dd6-4359-a221-ac5feea322b9 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] [instance: 605b9171-aa87-432a-b179-c552640e73dd] Fetching instance by UUID {{(pid=129322) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:38:49.936120 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-4a648810-6dd6-4359-a221-ac5feea322b9 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:38:49.936732 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-4a648810-6dd6-4359-a221-ac5feea322b9 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:38:49.938428 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-4a648810-6dd6-4359-a221-ac5feea322b9 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:38:49.939075 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-4a648810-6dd6-4359-a221-ac5feea322b9 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:38:50.034444 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.policy [None req-e8536a0a-45a7-4f06-973a-343eec25d64b tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e811736979c44b02b14fecb74c6bd7ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675272fb40d4847819f83ec04afecef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129321) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:38:50.045777 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.policy [None req-e8536a0a-45a7-4f06-973a-343eec25d64b tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e811736979c44b02b14fecb74c6bd7ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675272fb40d4847819f83ec04afecef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129321) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:38:50.059565 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.policy [None req-e8536a0a-45a7-4f06-973a-343eec25d64b tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e811736979c44b02b14fecb74c6bd7ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675272fb40d4847819f83ec04afecef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129321) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:38:50.059565 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: INFO nova.api.openstack.requestlog [None req-e8536a0a-45a7-4f06-973a-343eec25d64b tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] 10.222.0.75 "GET /compute/v2.1/servers/bf2f6303-22b9-4cfa-8d4d-61d2503bc554" status: 200 len: 1407 microversion: 2.20 time: 0.409750 May 26 12:38:50.059565 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: [pid: 129321|app: 0|req: 66/142] 10.222.0.75 () {60 vars in 1276 bytes} [Thu May 26 12:38:49 2022] GET /compute/v2.1/servers/bf2f6303-22b9-4cfa-8d4d-61d2503bc554 => generated 1407 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 26 12:38:50.111089 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.policy [None req-4a648810-6dd6-4359-a221-ac5feea322b9 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0431b1f25497443ba483b3c440669080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e36ab03283d4ce6a2fed5e111e03d34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129322) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:38:50.119072 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: INFO nova.api.openstack.requestlog [None req-4a648810-6dd6-4359-a221-ac5feea322b9 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] 10.222.0.75 "GET /compute/v2.1/servers/605b9171-aa87-432a-b179-c552640e73dd" status: 200 len: 1322 microversion: 2.1 time: 0.194617 May 26 12:38:50.119676 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: [pid: 129322|app: 0|req: 77/143] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 26 12:38:49 2022] GET /compute/v2.1/servers/605b9171-aa87-432a-b179-c552640e73dd => generated 1322 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:38:50.701941 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi [None req-9f17f20d-f46f-4a2d-ae04-6fd553247f03 tempest-DeleteServersTestJSON-342872481 tempest-DeleteServersTestJSON-342872481-project] Calling method '>' {{(pid=129321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:38:50.702499 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.compute.api [None req-9f17f20d-f46f-4a2d-ae04-6fd553247f03 tempest-DeleteServersTestJSON-342872481 tempest-DeleteServersTestJSON-342872481-project] [instance: 10054724-aefc-4a9f-a212-14e5fc5a1672] Fetching instance by UUID {{(pid=129321) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:38:50.708809 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-9f17f20d-f46f-4a2d-ae04-6fd553247f03 tempest-DeleteServersTestJSON-342872481 tempest-DeleteServersTestJSON-342872481-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:38:50.709251 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-9f17f20d-f46f-4a2d-ae04-6fd553247f03 tempest-DeleteServersTestJSON-342872481 tempest-DeleteServersTestJSON-342872481-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:38:50.710143 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-9f17f20d-f46f-4a2d-ae04-6fd553247f03 tempest-DeleteServersTestJSON-342872481 tempest-DeleteServersTestJSON-342872481-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:38:50.710573 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-9f17f20d-f46f-4a2d-ae04-6fd553247f03 tempest-DeleteServersTestJSON-342872481 tempest-DeleteServersTestJSON-342872481-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:38:50.866769 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.policy [None req-9f17f20d-f46f-4a2d-ae04-6fd553247f03 tempest-DeleteServersTestJSON-342872481 tempest-DeleteServersTestJSON-342872481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d19942e971b4d7fac3ab8f9a5ad6086', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0f340fa7ff24ca899b0f1036d0e6a3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129321) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:38:50.874559 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: INFO nova.api.openstack.requestlog [None req-9f17f20d-f46f-4a2d-ae04-6fd553247f03 tempest-DeleteServersTestJSON-342872481 tempest-DeleteServersTestJSON-342872481-project] 10.222.0.75 "GET /compute/v2.1/servers/10054724-aefc-4a9f-a212-14e5fc5a1672" status: 200 len: 1315 microversion: 2.1 time: 0.176523 May 26 12:38:50.875236 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: [pid: 129321|app: 0|req: 67/144] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 26 12:38:50 2022] GET /compute/v2.1/servers/10054724-aefc-4a9f-a212-14e5fc5a1672 => generated 1315 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:38:51.075717 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi [None req-68c87bf1-02d8-4413-b94d-59d54ad75a6f tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Calling method '>' {{(pid=129322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:38:51.076389 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.compute.api [None req-68c87bf1-02d8-4413-b94d-59d54ad75a6f tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] [instance: bf2f6303-22b9-4cfa-8d4d-61d2503bc554] Fetching instance by UUID {{(pid=129322) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:38:51.083346 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-68c87bf1-02d8-4413-b94d-59d54ad75a6f tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:38:51.084385 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-68c87bf1-02d8-4413-b94d-59d54ad75a6f tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:38:51.085343 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-68c87bf1-02d8-4413-b94d-59d54ad75a6f tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:38:51.085901 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-68c87bf1-02d8-4413-b94d-59d54ad75a6f tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:38:51.137464 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi [None req-d2d0b630-d257-4b45-99e1-81a1b643820a tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Calling method '>' {{(pid=129321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:38:51.138076 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.compute.api [None req-d2d0b630-d257-4b45-99e1-81a1b643820a tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] [instance: 605b9171-aa87-432a-b179-c552640e73dd] Fetching instance by UUID {{(pid=129321) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:38:51.145431 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-d2d0b630-d257-4b45-99e1-81a1b643820a tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:38:51.145988 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-d2d0b630-d257-4b45-99e1-81a1b643820a tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:38:51.147643 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-d2d0b630-d257-4b45-99e1-81a1b643820a tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:38:51.148241 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-d2d0b630-d257-4b45-99e1-81a1b643820a tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:38:51.237311 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.policy [None req-68c87bf1-02d8-4413-b94d-59d54ad75a6f tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e811736979c44b02b14fecb74c6bd7ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675272fb40d4847819f83ec04afecef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129322) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:38:51.248960 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.policy [None req-68c87bf1-02d8-4413-b94d-59d54ad75a6f tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e811736979c44b02b14fecb74c6bd7ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675272fb40d4847819f83ec04afecef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129322) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:38:51.251462 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.policy [None req-68c87bf1-02d8-4413-b94d-59d54ad75a6f tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e811736979c44b02b14fecb74c6bd7ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675272fb40d4847819f83ec04afecef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129322) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:38:51.252938 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: INFO nova.api.openstack.requestlog [None req-68c87bf1-02d8-4413-b94d-59d54ad75a6f tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] 10.222.0.75 "GET /compute/v2.1/servers/bf2f6303-22b9-4cfa-8d4d-61d2503bc554" status: 200 len: 1407 microversion: 2.20 time: 0.181578 May 26 12:38:51.253646 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: [pid: 129322|app: 0|req: 78/145] 10.222.0.75 () {60 vars in 1276 bytes} [Thu May 26 12:38:51 2022] GET /compute/v2.1/servers/bf2f6303-22b9-4cfa-8d4d-61d2503bc554 => generated 1407 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 12:38:51.297792 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.policy [None req-d2d0b630-d257-4b45-99e1-81a1b643820a tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0431b1f25497443ba483b3c440669080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e36ab03283d4ce6a2fed5e111e03d34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129321) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:38:51.306881 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: INFO nova.api.openstack.requestlog [None req-d2d0b630-d257-4b45-99e1-81a1b643820a tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] 10.222.0.75 "GET /compute/v2.1/servers/605b9171-aa87-432a-b179-c552640e73dd" status: 200 len: 1322 microversion: 2.1 time: 0.174822 May 26 12:38:51.307499 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: [pid: 129321|app: 0|req: 68/146] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 26 12:38:51 2022] GET /compute/v2.1/servers/605b9171-aa87-432a-b179-c552640e73dd => generated 1322 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:38:51.891723 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi [None req-59f2a702-f67a-4fe7-88e6-4bea5796c17e tempest-DeleteServersTestJSON-342872481 tempest-DeleteServersTestJSON-342872481-project] Calling method '>' {{(pid=129322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:38:51.892326 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.compute.api [None req-59f2a702-f67a-4fe7-88e6-4bea5796c17e tempest-DeleteServersTestJSON-342872481 tempest-DeleteServersTestJSON-342872481-project] [instance: 10054724-aefc-4a9f-a212-14e5fc5a1672] Fetching instance by UUID {{(pid=129322) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:38:51.899113 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-59f2a702-f67a-4fe7-88e6-4bea5796c17e tempest-DeleteServersTestJSON-342872481 tempest-DeleteServersTestJSON-342872481-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:38:51.899724 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-59f2a702-f67a-4fe7-88e6-4bea5796c17e tempest-DeleteServersTestJSON-342872481 tempest-DeleteServersTestJSON-342872481-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:38:51.900523 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-59f2a702-f67a-4fe7-88e6-4bea5796c17e tempest-DeleteServersTestJSON-342872481 tempest-DeleteServersTestJSON-342872481-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:38:51.900953 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-59f2a702-f67a-4fe7-88e6-4bea5796c17e tempest-DeleteServersTestJSON-342872481 tempest-DeleteServersTestJSON-342872481-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:38:52.030035 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.policy [None req-59f2a702-f67a-4fe7-88e6-4bea5796c17e tempest-DeleteServersTestJSON-342872481 tempest-DeleteServersTestJSON-342872481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d19942e971b4d7fac3ab8f9a5ad6086', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0f340fa7ff24ca899b0f1036d0e6a3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129322) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:38:52.037928 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: INFO nova.api.openstack.requestlog [None req-59f2a702-f67a-4fe7-88e6-4bea5796c17e tempest-DeleteServersTestJSON-342872481 tempest-DeleteServersTestJSON-342872481-project] 10.222.0.75 "GET /compute/v2.1/servers/10054724-aefc-4a9f-a212-14e5fc5a1672" status: 200 len: 1315 microversion: 2.1 time: 0.150085 May 26 12:38:52.038465 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: [pid: 129322|app: 0|req: 79/147] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 26 12:38:51 2022] GET /compute/v2.1/servers/10054724-aefc-4a9f-a212-14e5fc5a1672 => generated 1315 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:38:52.270621 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi [None req-2b983584-f7e6-4329-bec5-1be6e98e9a34 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Calling method '>' {{(pid=129321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:38:52.271258 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.compute.api [None req-2b983584-f7e6-4329-bec5-1be6e98e9a34 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] [instance: bf2f6303-22b9-4cfa-8d4d-61d2503bc554] Fetching instance by UUID {{(pid=129321) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:38:52.277999 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-2b983584-f7e6-4329-bec5-1be6e98e9a34 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:38:52.278828 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-2b983584-f7e6-4329-bec5-1be6e98e9a34 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:38:52.279664 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-2b983584-f7e6-4329-bec5-1be6e98e9a34 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:38:52.280109 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-2b983584-f7e6-4329-bec5-1be6e98e9a34 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:38:52.323659 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi [None req-a0ed6d1f-2140-4e33-b0be-2f57d3e6bd3f tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Calling method '>' {{(pid=129322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:38:52.324917 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.compute.api [None req-a0ed6d1f-2140-4e33-b0be-2f57d3e6bd3f tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] [instance: 605b9171-aa87-432a-b179-c552640e73dd] Fetching instance by UUID {{(pid=129322) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:38:52.331494 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-a0ed6d1f-2140-4e33-b0be-2f57d3e6bd3f tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:38:52.332198 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-a0ed6d1f-2140-4e33-b0be-2f57d3e6bd3f tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:38:52.333063 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-a0ed6d1f-2140-4e33-b0be-2f57d3e6bd3f tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:38:52.333556 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-a0ed6d1f-2140-4e33-b0be-2f57d3e6bd3f tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:38:52.418576 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.policy [None req-2b983584-f7e6-4329-bec5-1be6e98e9a34 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e811736979c44b02b14fecb74c6bd7ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675272fb40d4847819f83ec04afecef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129321) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:38:52.426757 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.policy [None req-2b983584-f7e6-4329-bec5-1be6e98e9a34 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e811736979c44b02b14fecb74c6bd7ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675272fb40d4847819f83ec04afecef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129321) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:38:52.428321 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.policy [None req-2b983584-f7e6-4329-bec5-1be6e98e9a34 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e811736979c44b02b14fecb74c6bd7ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675272fb40d4847819f83ec04afecef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129321) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:38:52.429762 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: INFO nova.api.openstack.requestlog [None req-2b983584-f7e6-4329-bec5-1be6e98e9a34 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] 10.222.0.75 "GET /compute/v2.1/servers/bf2f6303-22b9-4cfa-8d4d-61d2503bc554" status: 200 len: 1407 microversion: 2.20 time: 0.163073 May 26 12:38:52.430644 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: [pid: 129321|app: 0|req: 69/148] 10.222.0.75 () {60 vars in 1276 bytes} [Thu May 26 12:38:52 2022] GET /compute/v2.1/servers/bf2f6303-22b9-4cfa-8d4d-61d2503bc554 => generated 1407 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 12:38:52.623287 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.policy [None req-a0ed6d1f-2140-4e33-b0be-2f57d3e6bd3f tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0431b1f25497443ba483b3c440669080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e36ab03283d4ce6a2fed5e111e03d34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129322) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:38:52.631943 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: INFO nova.api.openstack.requestlog [None req-a0ed6d1f-2140-4e33-b0be-2f57d3e6bd3f tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] 10.222.0.75 "GET /compute/v2.1/servers/605b9171-aa87-432a-b179-c552640e73dd" status: 200 len: 1322 microversion: 2.1 time: 0.311811 May 26 12:38:52.632533 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: [pid: 129322|app: 0|req: 80/149] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 26 12:38:52 2022] GET /compute/v2.1/servers/605b9171-aa87-432a-b179-c552640e73dd => generated 1322 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:38:53.054357 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi [None req-f20c3ab4-0d28-4907-b5b2-5540ff12cc15 tempest-DeleteServersTestJSON-342872481 tempest-DeleteServersTestJSON-342872481-project] Calling method '>' {{(pid=129321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:38:53.054991 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.compute.api [None req-f20c3ab4-0d28-4907-b5b2-5540ff12cc15 tempest-DeleteServersTestJSON-342872481 tempest-DeleteServersTestJSON-342872481-project] [instance: 10054724-aefc-4a9f-a212-14e5fc5a1672] Fetching instance by UUID {{(pid=129321) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:38:53.061209 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-f20c3ab4-0d28-4907-b5b2-5540ff12cc15 tempest-DeleteServersTestJSON-342872481 tempest-DeleteServersTestJSON-342872481-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:38:53.061658 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-f20c3ab4-0d28-4907-b5b2-5540ff12cc15 tempest-DeleteServersTestJSON-342872481 tempest-DeleteServersTestJSON-342872481-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:38:53.062372 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-f20c3ab4-0d28-4907-b5b2-5540ff12cc15 tempest-DeleteServersTestJSON-342872481 tempest-DeleteServersTestJSON-342872481-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:38:53.062821 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-f20c3ab4-0d28-4907-b5b2-5540ff12cc15 tempest-DeleteServersTestJSON-342872481 tempest-DeleteServersTestJSON-342872481-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:38:53.197163 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.policy [None req-f20c3ab4-0d28-4907-b5b2-5540ff12cc15 tempest-DeleteServersTestJSON-342872481 tempest-DeleteServersTestJSON-342872481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d19942e971b4d7fac3ab8f9a5ad6086', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0f340fa7ff24ca899b0f1036d0e6a3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129321) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:38:53.204796 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: INFO nova.api.openstack.requestlog [None req-f20c3ab4-0d28-4907-b5b2-5540ff12cc15 tempest-DeleteServersTestJSON-342872481 tempest-DeleteServersTestJSON-342872481-project] 10.222.0.75 "GET /compute/v2.1/servers/10054724-aefc-4a9f-a212-14e5fc5a1672" status: 200 len: 1315 microversion: 2.1 time: 0.154417 May 26 12:38:53.205363 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: [pid: 129321|app: 0|req: 70/150] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 26 12:38:53 2022] GET /compute/v2.1/servers/10054724-aefc-4a9f-a212-14e5fc5a1672 => generated 1315 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:38:53.448190 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi [None req-99149c30-8730-479b-96c4-5d142aba4854 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Calling method '>' {{(pid=129322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:38:53.448808 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.compute.api [None req-99149c30-8730-479b-96c4-5d142aba4854 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] [instance: bf2f6303-22b9-4cfa-8d4d-61d2503bc554] Fetching instance by UUID {{(pid=129322) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:38:53.454846 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-99149c30-8730-479b-96c4-5d142aba4854 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:38:53.455214 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-99149c30-8730-479b-96c4-5d142aba4854 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:38:53.456041 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-99149c30-8730-479b-96c4-5d142aba4854 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:38:53.456470 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-99149c30-8730-479b-96c4-5d142aba4854 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:38:53.612090 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.policy [None req-99149c30-8730-479b-96c4-5d142aba4854 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e811736979c44b02b14fecb74c6bd7ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675272fb40d4847819f83ec04afecef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129322) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:38:53.622875 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.policy [None req-99149c30-8730-479b-96c4-5d142aba4854 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e811736979c44b02b14fecb74c6bd7ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675272fb40d4847819f83ec04afecef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129322) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:38:53.624756 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.policy [None req-99149c30-8730-479b-96c4-5d142aba4854 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e811736979c44b02b14fecb74c6bd7ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675272fb40d4847819f83ec04afecef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129322) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:38:53.626076 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: INFO nova.api.openstack.requestlog [None req-99149c30-8730-479b-96c4-5d142aba4854 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] 10.222.0.75 "GET /compute/v2.1/servers/bf2f6303-22b9-4cfa-8d4d-61d2503bc554" status: 200 len: 1407 microversion: 2.20 time: 0.181880 May 26 12:38:53.626768 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: [pid: 129322|app: 0|req: 81/151] 10.222.0.75 () {60 vars in 1276 bytes} [Thu May 26 12:38:53 2022] GET /compute/v2.1/servers/bf2f6303-22b9-4cfa-8d4d-61d2503bc554 => generated 1407 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 12:38:53.650232 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi [None req-fef5fc87-745d-40bb-a780-601068d09d37 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Calling method '>' {{(pid=129321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:38:53.650881 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.compute.api [None req-fef5fc87-745d-40bb-a780-601068d09d37 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] [instance: 605b9171-aa87-432a-b179-c552640e73dd] Fetching instance by UUID {{(pid=129321) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:38:53.657391 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-fef5fc87-745d-40bb-a780-601068d09d37 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:38:53.658027 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-fef5fc87-745d-40bb-a780-601068d09d37 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:38:53.658834 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-fef5fc87-745d-40bb-a780-601068d09d37 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:38:53.659272 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-fef5fc87-745d-40bb-a780-601068d09d37 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:38:53.811335 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.policy [None req-fef5fc87-745d-40bb-a780-601068d09d37 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0431b1f25497443ba483b3c440669080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e36ab03283d4ce6a2fed5e111e03d34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129321) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:38:53.822036 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: INFO nova.api.openstack.requestlog [None req-fef5fc87-745d-40bb-a780-601068d09d37 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] 10.222.0.75 "GET /compute/v2.1/servers/605b9171-aa87-432a-b179-c552640e73dd" status: 200 len: 1322 microversion: 2.1 time: 0.176692 May 26 12:38:53.822707 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: [pid: 129321|app: 0|req: 71/152] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 26 12:38:53 2022] GET /compute/v2.1/servers/605b9171-aa87-432a-b179-c552640e73dd => generated 1322 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:38:54.226931 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi [None req-4a8f1574-2928-434c-ad30-c0dae83b9dd5 tempest-DeleteServersTestJSON-342872481 tempest-DeleteServersTestJSON-342872481-project] Calling method '>' {{(pid=129322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:38:54.228009 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.compute.api [None req-4a8f1574-2928-434c-ad30-c0dae83b9dd5 tempest-DeleteServersTestJSON-342872481 tempest-DeleteServersTestJSON-342872481-project] [instance: 10054724-aefc-4a9f-a212-14e5fc5a1672] Fetching instance by UUID {{(pid=129322) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:38:54.238463 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-4a8f1574-2928-434c-ad30-c0dae83b9dd5 tempest-DeleteServersTestJSON-342872481 tempest-DeleteServersTestJSON-342872481-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:38:54.239254 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-4a8f1574-2928-434c-ad30-c0dae83b9dd5 tempest-DeleteServersTestJSON-342872481 tempest-DeleteServersTestJSON-342872481-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:38:54.240683 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-4a8f1574-2928-434c-ad30-c0dae83b9dd5 tempest-DeleteServersTestJSON-342872481 tempest-DeleteServersTestJSON-342872481-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:38:54.241321 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-4a8f1574-2928-434c-ad30-c0dae83b9dd5 tempest-DeleteServersTestJSON-342872481 tempest-DeleteServersTestJSON-342872481-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:38:54.374117 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.policy [None req-4a8f1574-2928-434c-ad30-c0dae83b9dd5 tempest-DeleteServersTestJSON-342872481 tempest-DeleteServersTestJSON-342872481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d19942e971b4d7fac3ab8f9a5ad6086', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0f340fa7ff24ca899b0f1036d0e6a3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129322) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:38:54.381676 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: INFO nova.api.openstack.requestlog [None req-4a8f1574-2928-434c-ad30-c0dae83b9dd5 tempest-DeleteServersTestJSON-342872481 tempest-DeleteServersTestJSON-342872481-project] 10.222.0.75 "GET /compute/v2.1/servers/10054724-aefc-4a9f-a212-14e5fc5a1672" status: 200 len: 1315 microversion: 2.1 time: 0.161729 May 26 12:38:54.382244 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: [pid: 129322|app: 0|req: 82/153] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 26 12:38:54 2022] GET /compute/v2.1/servers/10054724-aefc-4a9f-a212-14e5fc5a1672 => generated 1315 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:38:54.644091 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi [None req-a6b12cdc-29ee-4094-9473-47344e09903d tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Calling method '>' {{(pid=129321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:38:54.644691 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.compute.api [None req-a6b12cdc-29ee-4094-9473-47344e09903d tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] [instance: bf2f6303-22b9-4cfa-8d4d-61d2503bc554] Fetching instance by UUID {{(pid=129321) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:38:54.651477 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-a6b12cdc-29ee-4094-9473-47344e09903d tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:38:54.652090 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-a6b12cdc-29ee-4094-9473-47344e09903d tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:38:54.652728 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-a6b12cdc-29ee-4094-9473-47344e09903d tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:38:54.653189 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-a6b12cdc-29ee-4094-9473-47344e09903d tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:38:54.796158 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.policy [None req-a6b12cdc-29ee-4094-9473-47344e09903d tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e811736979c44b02b14fecb74c6bd7ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675272fb40d4847819f83ec04afecef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129321) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:38:54.809346 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.policy [None req-a6b12cdc-29ee-4094-9473-47344e09903d tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e811736979c44b02b14fecb74c6bd7ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675272fb40d4847819f83ec04afecef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129321) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:38:54.811580 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.policy [None req-a6b12cdc-29ee-4094-9473-47344e09903d tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e811736979c44b02b14fecb74c6bd7ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675272fb40d4847819f83ec04afecef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129321) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:38:54.813345 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: INFO nova.api.openstack.requestlog [None req-a6b12cdc-29ee-4094-9473-47344e09903d tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] 10.222.0.75 "GET /compute/v2.1/servers/bf2f6303-22b9-4cfa-8d4d-61d2503bc554" status: 200 len: 1407 microversion: 2.20 time: 0.172881 May 26 12:38:54.814250 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: [pid: 129321|app: 0|req: 72/154] 10.222.0.75 () {60 vars in 1276 bytes} [Thu May 26 12:38:54 2022] GET /compute/v2.1/servers/bf2f6303-22b9-4cfa-8d4d-61d2503bc554 => generated 1407 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 12:38:54.838724 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi [None req-ab3e6eed-614e-4982-be35-2272ff0613d7 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Calling method '>' {{(pid=129322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:38:54.839361 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.compute.api [None req-ab3e6eed-614e-4982-be35-2272ff0613d7 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] [instance: 605b9171-aa87-432a-b179-c552640e73dd] Fetching instance by UUID {{(pid=129322) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:38:54.845686 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-ab3e6eed-614e-4982-be35-2272ff0613d7 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:38:54.846137 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-ab3e6eed-614e-4982-be35-2272ff0613d7 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:38:54.846875 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-ab3e6eed-614e-4982-be35-2272ff0613d7 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:38:54.847299 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-ab3e6eed-614e-4982-be35-2272ff0613d7 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:38:54.865155 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG dbcounter [-] [129322] Writing DB stats nova_cell1:SELECT=100 {{(pid=129322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:38:54.976949 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.policy [None req-ab3e6eed-614e-4982-be35-2272ff0613d7 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0431b1f25497443ba483b3c440669080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e36ab03283d4ce6a2fed5e111e03d34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129322) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:38:54.984767 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: INFO nova.api.openstack.requestlog [None req-ab3e6eed-614e-4982-be35-2272ff0613d7 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] 10.222.0.75 "GET /compute/v2.1/servers/605b9171-aa87-432a-b179-c552640e73dd" status: 200 len: 1322 microversion: 2.1 time: 0.150048 May 26 12:38:54.985336 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: [pid: 129322|app: 0|req: 83/155] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 26 12:38:54 2022] GET /compute/v2.1/servers/605b9171-aa87-432a-b179-c552640e73dd => generated 1322 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:38:55.399277 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi [None req-9eda85ad-a8da-408a-8aa2-03d6f812588b tempest-DeleteServersTestJSON-342872481 tempest-DeleteServersTestJSON-342872481-project] Calling method '>' {{(pid=129321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:38:55.399919 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.compute.api [None req-9eda85ad-a8da-408a-8aa2-03d6f812588b tempest-DeleteServersTestJSON-342872481 tempest-DeleteServersTestJSON-342872481-project] [instance: 10054724-aefc-4a9f-a212-14e5fc5a1672] Fetching instance by UUID {{(pid=129321) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:38:55.407031 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-9eda85ad-a8da-408a-8aa2-03d6f812588b tempest-DeleteServersTestJSON-342872481 tempest-DeleteServersTestJSON-342872481-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:38:55.407519 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-9eda85ad-a8da-408a-8aa2-03d6f812588b tempest-DeleteServersTestJSON-342872481 tempest-DeleteServersTestJSON-342872481-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:38:55.408536 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-9eda85ad-a8da-408a-8aa2-03d6f812588b tempest-DeleteServersTestJSON-342872481 tempest-DeleteServersTestJSON-342872481-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:38:55.408922 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-9eda85ad-a8da-408a-8aa2-03d6f812588b tempest-DeleteServersTestJSON-342872481 tempest-DeleteServersTestJSON-342872481-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:38:55.541629 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.policy [None req-9eda85ad-a8da-408a-8aa2-03d6f812588b tempest-DeleteServersTestJSON-342872481 tempest-DeleteServersTestJSON-342872481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d19942e971b4d7fac3ab8f9a5ad6086', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0f340fa7ff24ca899b0f1036d0e6a3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129321) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:38:55.549511 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: INFO nova.api.openstack.requestlog [None req-9eda85ad-a8da-408a-8aa2-03d6f812588b tempest-DeleteServersTestJSON-342872481 tempest-DeleteServersTestJSON-342872481-project] 10.222.0.75 "GET /compute/v2.1/servers/10054724-aefc-4a9f-a212-14e5fc5a1672" status: 200 len: 1502 microversion: 2.1 time: 0.154730 May 26 12:38:55.550082 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: [pid: 129321|app: 0|req: 73/156] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 26 12:38:55 2022] GET /compute/v2.1/servers/10054724-aefc-4a9f-a212-14e5fc5a1672 => generated 1502 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:38:55.832562 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi [None req-c5070600-da50-4264-9523-4c4b2afcf588 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Calling method '>' {{(pid=129322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:38:55.832562 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.compute.api [None req-c5070600-da50-4264-9523-4c4b2afcf588 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] [instance: bf2f6303-22b9-4cfa-8d4d-61d2503bc554] Fetching instance by UUID {{(pid=129322) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:38:55.844464 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-c5070600-da50-4264-9523-4c4b2afcf588 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:38:55.845051 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-c5070600-da50-4264-9523-4c4b2afcf588 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:38:55.848617 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-c5070600-da50-4264-9523-4c4b2afcf588 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:38:55.848957 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-c5070600-da50-4264-9523-4c4b2afcf588 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:38:56.003357 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi [None req-d5254bd3-522d-410e-9213-2641c66a87a4 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Calling method '>' {{(pid=129321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:38:56.004146 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.compute.api [None req-d5254bd3-522d-410e-9213-2641c66a87a4 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] [instance: 605b9171-aa87-432a-b179-c552640e73dd] Fetching instance by UUID {{(pid=129321) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:38:56.013779 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-d5254bd3-522d-410e-9213-2641c66a87a4 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:38:56.014267 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-d5254bd3-522d-410e-9213-2641c66a87a4 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:38:56.015089 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-d5254bd3-522d-410e-9213-2641c66a87a4 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:38:56.015576 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-d5254bd3-522d-410e-9213-2641c66a87a4 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:38:56.026132 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.policy [None req-c5070600-da50-4264-9523-4c4b2afcf588 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e811736979c44b02b14fecb74c6bd7ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675272fb40d4847819f83ec04afecef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129322) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:38:56.038290 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.policy [None req-c5070600-da50-4264-9523-4c4b2afcf588 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e811736979c44b02b14fecb74c6bd7ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675272fb40d4847819f83ec04afecef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129322) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:38:56.040584 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.policy [None req-c5070600-da50-4264-9523-4c4b2afcf588 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e811736979c44b02b14fecb74c6bd7ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675272fb40d4847819f83ec04afecef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129322) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:38:56.042079 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: INFO nova.api.openstack.requestlog [None req-c5070600-da50-4264-9523-4c4b2afcf588 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] 10.222.0.75 "GET /compute/v2.1/servers/bf2f6303-22b9-4cfa-8d4d-61d2503bc554" status: 200 len: 1407 microversion: 2.20 time: 0.214282 May 26 12:38:56.043231 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: [pid: 129322|app: 0|req: 84/157] 10.222.0.75 () {60 vars in 1276 bytes} [Thu May 26 12:38:55 2022] GET /compute/v2.1/servers/bf2f6303-22b9-4cfa-8d4d-61d2503bc554 => generated 1407 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 12:38:56.134145 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi [req-d0dfe0ce-7ef9-4709-b2a7-be80f88ef8f2 req-00f5fa7e-7265-40ff-a225-23bd04e6a813 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f9200aab-6f49-4e6f-812b-93b2f3e1edd9", "name": "network-vif-plugged", "status": "completed", "tag": "246aaf0a-ebde-48cf-83fe-af3c152e1f14"}]} {{(pid=129322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 12:38:56.146351 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [req-d0dfe0ce-7ef9-4709-b2a7-be80f88ef8f2 req-00f5fa7e-7265-40ff-a225-23bd04e6a813 service nova] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:38:56.147373 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [req-d0dfe0ce-7ef9-4709-b2a7-be80f88ef8f2 req-00f5fa7e-7265-40ff-a225-23bd04e6a813 service nova] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:38:56.160437 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: INFO nova.api.openstack.compute.server_external_events [req-d0dfe0ce-7ef9-4709-b2a7-be80f88ef8f2 req-00f5fa7e-7265-40ff-a225-23bd04e6a813 service nova] Creating event network-vif-plugged:246aaf0a-ebde-48cf-83fe-af3c152e1f14 for instance f9200aab-6f49-4e6f-812b-93b2f3e1edd9 on hv-cinder-81966 May 26 12:38:56.168491 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.policy [None req-d5254bd3-522d-410e-9213-2641c66a87a4 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0431b1f25497443ba483b3c440669080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e36ab03283d4ce6a2fed5e111e03d34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129321) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:38:56.169365 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: INFO nova.api.openstack.requestlog [req-d0dfe0ce-7ef9-4709-b2a7-be80f88ef8f2 req-00f5fa7e-7265-40ff-a225-23bd04e6a813 service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040812 May 26 12:38:56.170273 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: [pid: 129322|app: 0|req: 85/158] 10.222.0.75 () {64 vars in 1317 bytes} [Thu May 26 12:38:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 26 12:38:56.178104 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: INFO nova.api.openstack.requestlog [None req-d5254bd3-522d-410e-9213-2641c66a87a4 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] 10.222.0.75 "GET /compute/v2.1/servers/605b9171-aa87-432a-b179-c552640e73dd" status: 200 len: 1322 microversion: 2.1 time: 0.180418 May 26 12:38:56.179083 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: [pid: 129321|app: 0|req: 74/159] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 26 12:38:55 2022] GET /compute/v2.1/servers/605b9171-aa87-432a-b179-c552640e73dd => generated 1322 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:38:57.064311 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi [None req-cad17887-7cb8-488e-9fd3-050dd07ea958 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Calling method '>' {{(pid=129322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:38:57.065112 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.compute.api [None req-cad17887-7cb8-488e-9fd3-050dd07ea958 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] [instance: bf2f6303-22b9-4cfa-8d4d-61d2503bc554] Fetching instance by UUID {{(pid=129322) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:38:57.073575 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-cad17887-7cb8-488e-9fd3-050dd07ea958 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:38:57.074278 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-cad17887-7cb8-488e-9fd3-050dd07ea958 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:38:57.075121 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-cad17887-7cb8-488e-9fd3-050dd07ea958 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:38:57.075641 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-cad17887-7cb8-488e-9fd3-050dd07ea958 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:38:57.196691 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi [None req-4532c3dc-9e03-421a-ad9d-c1122b5295b8 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Calling method '>' {{(pid=129321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:38:57.197303 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.compute.api [None req-4532c3dc-9e03-421a-ad9d-c1122b5295b8 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] [instance: 605b9171-aa87-432a-b179-c552640e73dd] Fetching instance by UUID {{(pid=129321) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:38:57.204128 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-4532c3dc-9e03-421a-ad9d-c1122b5295b8 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:38:57.204638 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-4532c3dc-9e03-421a-ad9d-c1122b5295b8 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:38:57.205565 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-4532c3dc-9e03-421a-ad9d-c1122b5295b8 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:38:57.206054 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-4532c3dc-9e03-421a-ad9d-c1122b5295b8 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:38:57.253301 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.policy [None req-cad17887-7cb8-488e-9fd3-050dd07ea958 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e811736979c44b02b14fecb74c6bd7ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675272fb40d4847819f83ec04afecef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129322) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:38:57.263029 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.policy [None req-cad17887-7cb8-488e-9fd3-050dd07ea958 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e811736979c44b02b14fecb74c6bd7ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675272fb40d4847819f83ec04afecef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129322) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:38:57.264921 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.policy [None req-cad17887-7cb8-488e-9fd3-050dd07ea958 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e811736979c44b02b14fecb74c6bd7ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675272fb40d4847819f83ec04afecef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129322) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:38:57.266408 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: INFO nova.api.openstack.requestlog [None req-cad17887-7cb8-488e-9fd3-050dd07ea958 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] 10.222.0.75 "GET /compute/v2.1/servers/bf2f6303-22b9-4cfa-8d4d-61d2503bc554" status: 200 len: 1407 microversion: 2.20 time: 0.209700 May 26 12:38:57.267211 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: [pid: 129322|app: 0|req: 86/160] 10.222.0.75 () {60 vars in 1276 bytes} [Thu May 26 12:38:57 2022] GET /compute/v2.1/servers/bf2f6303-22b9-4cfa-8d4d-61d2503bc554 => generated 1407 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 12:38:57.365928 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.policy [None req-4532c3dc-9e03-421a-ad9d-c1122b5295b8 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0431b1f25497443ba483b3c440669080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e36ab03283d4ce6a2fed5e111e03d34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129321) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:38:57.373880 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: INFO nova.api.openstack.requestlog [None req-4532c3dc-9e03-421a-ad9d-c1122b5295b8 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] 10.222.0.75 "GET /compute/v2.1/servers/605b9171-aa87-432a-b179-c552640e73dd" status: 200 len: 1322 microversion: 2.1 time: 0.182791 May 26 12:38:57.374589 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: [pid: 129321|app: 0|req: 75/161] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 26 12:38:57 2022] GET /compute/v2.1/servers/605b9171-aa87-432a-b179-c552640e73dd => generated 1322 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:38:58.242784 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi [None req-f51524a6-2c98-475b-a7c2-691479555cd5 tempest-DeleteServersTestJSON-342872481 tempest-DeleteServersTestJSON-342872481-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e6ebfff2-0c20-4871-8472-5d3f57a3beb6"}} {{(pid=129322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 12:38:58.243968 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.compute.api [None req-f51524a6-2c98-475b-a7c2-691479555cd5 tempest-DeleteServersTestJSON-342872481 tempest-DeleteServersTestJSON-342872481-project] [instance: 10054724-aefc-4a9f-a212-14e5fc5a1672] Fetching instance by UUID {{(pid=129322) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:38:58.253381 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-f51524a6-2c98-475b-a7c2-691479555cd5 tempest-DeleteServersTestJSON-342872481 tempest-DeleteServersTestJSON-342872481-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:38:58.253827 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-f51524a6-2c98-475b-a7c2-691479555cd5 tempest-DeleteServersTestJSON-342872481 tempest-DeleteServersTestJSON-342872481-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:38:58.254595 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-f51524a6-2c98-475b-a7c2-691479555cd5 tempest-DeleteServersTestJSON-342872481 tempest-DeleteServersTestJSON-342872481-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:38:58.255029 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-f51524a6-2c98-475b-a7c2-691479555cd5 tempest-DeleteServersTestJSON-342872481 tempest-DeleteServersTestJSON-342872481-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:38:58.287781 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi [None req-1c8cf3e0-438b-4ba3-918d-6037f2d387dc tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Calling method '>' {{(pid=129321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:38:58.288763 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.compute.api [None req-1c8cf3e0-438b-4ba3-918d-6037f2d387dc tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] [instance: bf2f6303-22b9-4cfa-8d4d-61d2503bc554] Fetching instance by UUID {{(pid=129321) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:38:58.300392 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-1c8cf3e0-438b-4ba3-918d-6037f2d387dc tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:38:58.301840 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-1c8cf3e0-438b-4ba3-918d-6037f2d387dc tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:38:58.304280 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-1c8cf3e0-438b-4ba3-918d-6037f2d387dc tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:38:58.304772 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-1c8cf3e0-438b-4ba3-918d-6037f2d387dc tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:38:58.580358 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.policy [None req-1c8cf3e0-438b-4ba3-918d-6037f2d387dc tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e811736979c44b02b14fecb74c6bd7ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675272fb40d4847819f83ec04afecef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129321) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:38:58.590778 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.policy [None req-1c8cf3e0-438b-4ba3-918d-6037f2d387dc tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e811736979c44b02b14fecb74c6bd7ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675272fb40d4847819f83ec04afecef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129321) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:38:58.593157 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.policy [None req-1c8cf3e0-438b-4ba3-918d-6037f2d387dc tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e811736979c44b02b14fecb74c6bd7ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675272fb40d4847819f83ec04afecef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129321) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:38:58.596767 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: INFO nova.api.openstack.requestlog [None req-1c8cf3e0-438b-4ba3-918d-6037f2d387dc tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] 10.222.0.75 "GET /compute/v2.1/servers/bf2f6303-22b9-4cfa-8d4d-61d2503bc554" status: 200 len: 1407 microversion: 2.20 time: 0.312979 May 26 12:38:58.598439 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: [pid: 129321|app: 0|req: 76/162] 10.222.0.75 () {60 vars in 1276 bytes} [Thu May 26 12:38:58 2022] GET /compute/v2.1/servers/bf2f6303-22b9-4cfa-8d4d-61d2503bc554 => generated 1407 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 26 12:38:58.605829 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi [None req-f839fc92-690c-4a79-af90-ded5eb15493c tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Calling method '>' {{(pid=129321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:38:58.606686 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.compute.api [None req-f839fc92-690c-4a79-af90-ded5eb15493c tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] [instance: 605b9171-aa87-432a-b179-c552640e73dd] Fetching instance by UUID {{(pid=129321) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:38:58.617705 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-f839fc92-690c-4a79-af90-ded5eb15493c tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:38:58.618505 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-f839fc92-690c-4a79-af90-ded5eb15493c tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:38:58.622411 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-f839fc92-690c-4a79-af90-ded5eb15493c tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:38:58.622411 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-f839fc92-690c-4a79-af90-ded5eb15493c tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:38:58.626280 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG dbcounter [-] [129321] Writing DB stats nova_cell1:SELECT=100 {{(pid=129321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:38:58.819870 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.policy [None req-f839fc92-690c-4a79-af90-ded5eb15493c tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0431b1f25497443ba483b3c440669080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e36ab03283d4ce6a2fed5e111e03d34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129321) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:38:58.829037 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: INFO nova.api.openstack.requestlog [None req-f839fc92-690c-4a79-af90-ded5eb15493c tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] 10.222.0.75 "GET /compute/v2.1/servers/605b9171-aa87-432a-b179-c552640e73dd" status: 200 len: 1322 microversion: 2.1 time: 0.227934 May 26 12:38:58.830006 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: [pid: 129321|app: 0|req: 77/163] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 26 12:38:58 2022] GET /compute/v2.1/servers/605b9171-aa87-432a-b179-c552640e73dd => generated 1322 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:38:59.621137 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi [None req-6a443738-10ff-473e-9645-aa9a5a2dd078 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Calling method '>' {{(pid=129321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:38:59.623094 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.compute.api [None req-6a443738-10ff-473e-9645-aa9a5a2dd078 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] [instance: bf2f6303-22b9-4cfa-8d4d-61d2503bc554] Fetching instance by UUID {{(pid=129321) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:38:59.644974 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-6a443738-10ff-473e-9645-aa9a5a2dd078 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:38:59.645879 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-6a443738-10ff-473e-9645-aa9a5a2dd078 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:38:59.648466 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-6a443738-10ff-473e-9645-aa9a5a2dd078 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:38:59.648919 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-6a443738-10ff-473e-9645-aa9a5a2dd078 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:38:59.996999 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.policy [None req-6a443738-10ff-473e-9645-aa9a5a2dd078 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e811736979c44b02b14fecb74c6bd7ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675272fb40d4847819f83ec04afecef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129321) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:39:00.023386 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.policy [None req-6a443738-10ff-473e-9645-aa9a5a2dd078 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e811736979c44b02b14fecb74c6bd7ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675272fb40d4847819f83ec04afecef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129321) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:39:00.025293 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.policy [None req-6a443738-10ff-473e-9645-aa9a5a2dd078 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e811736979c44b02b14fecb74c6bd7ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675272fb40d4847819f83ec04afecef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129321) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:39:00.033002 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: INFO nova.api.openstack.requestlog [None req-6a443738-10ff-473e-9645-aa9a5a2dd078 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] 10.222.0.75 "GET /compute/v2.1/servers/bf2f6303-22b9-4cfa-8d4d-61d2503bc554" status: 200 len: 1600 microversion: 2.20 time: 0.422216 May 26 12:39:00.051632 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: [pid: 129321|app: 0|req: 78/164] 10.222.0.75 () {60 vars in 1276 bytes} [Thu May 26 12:38:59 2022] GET /compute/v2.1/servers/bf2f6303-22b9-4cfa-8d4d-61d2503bc554 => generated 1600 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 12:39:00.073313 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi [None req-bf3e3f32-7ce2-4d7f-8727-e9ef3ef41adf tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Calling method '>' {{(pid=129321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:39:00.082220 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.compute.api [None req-bf3e3f32-7ce2-4d7f-8727-e9ef3ef41adf tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] [instance: 605b9171-aa87-432a-b179-c552640e73dd] Fetching instance by UUID {{(pid=129321) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:39:00.106343 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-bf3e3f32-7ce2-4d7f-8727-e9ef3ef41adf tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:39:00.108232 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-bf3e3f32-7ce2-4d7f-8727-e9ef3ef41adf tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:39:00.109541 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-bf3e3f32-7ce2-4d7f-8727-e9ef3ef41adf tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:39:00.111116 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-bf3e3f32-7ce2-4d7f-8727-e9ef3ef41adf tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:39:00.478150 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: INFO nova.api.openstack.requestlog [None req-f51524a6-2c98-475b-a7c2-691479555cd5 tempest-DeleteServersTestJSON-342872481 tempest-DeleteServersTestJSON-342872481-project] 10.222.0.75 "POST /compute/v2.1/servers/10054724-aefc-4a9f-a212-14e5fc5a1672/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 2.240664 May 26 12:39:00.479634 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: [pid: 129322|app: 0|req: 87/165] 10.222.0.75 () {60 vars in 1322 bytes} [Thu May 26 12:38:58 2022] POST /compute/v2.1/servers/10054724-aefc-4a9f-a212-14e5fc5a1672/os-volume_attachments => generated 194 bytes in 2243 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 12:39:00.486603 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi [None req-63a55c6f-b05b-4fb1-aef4-a8e0032d9454 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Calling method '>' {{(pid=129322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:39:00.487373 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.compute.api [None req-63a55c6f-b05b-4fb1-aef4-a8e0032d9454 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] [instance: bf2f6303-22b9-4cfa-8d4d-61d2503bc554] Fetching instance by UUID {{(pid=129322) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:39:00.496455 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-63a55c6f-b05b-4fb1-aef4-a8e0032d9454 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:39:00.496652 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-63a55c6f-b05b-4fb1-aef4-a8e0032d9454 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:39:00.497439 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-63a55c6f-b05b-4fb1-aef4-a8e0032d9454 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:39:00.497870 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-63a55c6f-b05b-4fb1-aef4-a8e0032d9454 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:39:00.509625 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.policy [None req-bf3e3f32-7ce2-4d7f-8727-e9ef3ef41adf tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0431b1f25497443ba483b3c440669080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e36ab03283d4ce6a2fed5e111e03d34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129321) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:39:00.525521 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: INFO nova.api.openstack.requestlog [None req-bf3e3f32-7ce2-4d7f-8727-e9ef3ef41adf tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] 10.222.0.75 "GET /compute/v2.1/servers/605b9171-aa87-432a-b179-c552640e73dd" status: 200 len: 1322 microversion: 2.1 time: 0.472107 May 26 12:39:00.527022 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: [pid: 129321|app: 0|req: 79/166] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 26 12:39:00 2022] GET /compute/v2.1/servers/605b9171-aa87-432a-b179-c552640e73dd => generated 1322 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:39:00.619864 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: INFO nova.api.openstack.requestlog [None req-63a55c6f-b05b-4fb1-aef4-a8e0032d9454 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] 10.222.0.75 "GET /compute/v2.1/servers/bf2f6303-22b9-4cfa-8d4d-61d2503bc554/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.138386 May 26 12:39:00.620857 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: [pid: 129322|app: 0|req: 88/167] 10.222.0.75 () {60 vars in 1315 bytes} [Thu May 26 12:39:00 2022] GET /compute/v2.1/servers/bf2f6303-22b9-4cfa-8d4d-61d2503bc554/os-interface => generated 285 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 26 12:39:01.543775 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi [None req-264bdc96-b38a-4619-b6c8-0fc132b232cf tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Calling method '>' {{(pid=129321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:39:01.544393 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.compute.api [None req-264bdc96-b38a-4619-b6c8-0fc132b232cf tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] [instance: 605b9171-aa87-432a-b179-c552640e73dd] Fetching instance by UUID {{(pid=129321) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:39:01.555245 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-264bdc96-b38a-4619-b6c8-0fc132b232cf tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:39:01.555930 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-264bdc96-b38a-4619-b6c8-0fc132b232cf tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:39:01.556859 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-264bdc96-b38a-4619-b6c8-0fc132b232cf tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:39:01.558839 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-264bdc96-b38a-4619-b6c8-0fc132b232cf tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:39:01.791924 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.policy [None req-264bdc96-b38a-4619-b6c8-0fc132b232cf tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0431b1f25497443ba483b3c440669080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e36ab03283d4ce6a2fed5e111e03d34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129321) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:39:01.803841 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: INFO nova.api.openstack.requestlog [None req-264bdc96-b38a-4619-b6c8-0fc132b232cf tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] 10.222.0.75 "GET /compute/v2.1/servers/605b9171-aa87-432a-b179-c552640e73dd" status: 200 len: 1322 microversion: 2.1 time: 0.263180 May 26 12:39:01.813827 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: [pid: 129321|app: 0|req: 80/168] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 26 12:39:01 2022] GET /compute/v2.1/servers/605b9171-aa87-432a-b179-c552640e73dd => generated 1322 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:39:02.360747 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi [req-ef945378-805d-42fc-9a4f-5982d6dff6af req-7c2e7902-297e-45d5-b961-aa370941537f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "605b9171-aa87-432a-b179-c552640e73dd", "name": "network-vif-plugged", "status": "completed", "tag": "58cde015-97f9-4885-b302-d0f8a82a584c"}]} {{(pid=129322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 12:39:02.373575 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG dbcounter [-] [129322] Writing DB stats nova_api:SELECT=76 {{(pid=129322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:39:02.377678 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [req-ef945378-805d-42fc-9a4f-5982d6dff6af req-7c2e7902-297e-45d5-b961-aa370941537f service nova] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:39:02.380200 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [req-ef945378-805d-42fc-9a4f-5982d6dff6af req-7c2e7902-297e-45d5-b961-aa370941537f service nova] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:39:02.405743 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: INFO nova.api.openstack.compute.server_external_events [req-ef945378-805d-42fc-9a4f-5982d6dff6af req-7c2e7902-297e-45d5-b961-aa370941537f service nova] Creating event network-vif-plugged:58cde015-97f9-4885-b302-d0f8a82a584c for instance 605b9171-aa87-432a-b179-c552640e73dd on hv-cinder-81966 May 26 12:39:02.417304 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: INFO nova.api.openstack.requestlog [req-ef945378-805d-42fc-9a4f-5982d6dff6af req-7c2e7902-297e-45d5-b961-aa370941537f service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061719 May 26 12:39:02.421512 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: [pid: 129322|app: 0|req: 89/169] 10.222.0.75 () {64 vars in 1317 bytes} [Thu May 26 12:39:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 12:39:02.614896 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi [req-5fbad57a-84fe-485f-ba68-54fd02232a59 req-fb05f572-61a4-4d36-bea2-77e32754f172 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bf2f6303-22b9-4cfa-8d4d-61d2503bc554", "tag": "fe40ed8f-f450-48f7-876a-abe2fea7abe5"}]} {{(pid=129321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 12:39:02.621212 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG dbcounter [-] [129321] Writing DB stats nova_api:SELECT=70 {{(pid=129321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:39:02.657348 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [req-5fbad57a-84fe-485f-ba68-54fd02232a59 req-fb05f572-61a4-4d36-bea2-77e32754f172 service nova] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:39:02.658124 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [req-5fbad57a-84fe-485f-ba68-54fd02232a59 req-fb05f572-61a4-4d36-bea2-77e32754f172 service nova] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:39:02.704542 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: INFO nova.api.openstack.compute.server_external_events [req-5fbad57a-84fe-485f-ba68-54fd02232a59 req-fb05f572-61a4-4d36-bea2-77e32754f172 service nova] Creating event network-changed:fe40ed8f-f450-48f7-876a-abe2fea7abe5 for instance bf2f6303-22b9-4cfa-8d4d-61d2503bc554 on hv-cinder-81966 May 26 12:39:02.721801 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: INFO nova.api.openstack.requestlog [req-5fbad57a-84fe-485f-ba68-54fd02232a59 req-fb05f572-61a4-4d36-bea2-77e32754f172 service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.114579 May 26 12:39:02.722731 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: [pid: 129321|app: 0|req: 81/170] 10.222.0.75 () {64 vars in 1317 bytes} [Thu May 26 12:39:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 26 12:39:02.822147 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi [None req-cd210057-9331-439b-877d-efc620c52631 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Calling method '>' {{(pid=129322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:39:02.822945 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.compute.api [None req-cd210057-9331-439b-877d-efc620c52631 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] [instance: 605b9171-aa87-432a-b179-c552640e73dd] Fetching instance by UUID {{(pid=129322) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:39:02.839085 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-cd210057-9331-439b-877d-efc620c52631 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:39:02.841379 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-cd210057-9331-439b-877d-efc620c52631 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:39:02.843245 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-cd210057-9331-439b-877d-efc620c52631 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:39:02.845402 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-cd210057-9331-439b-877d-efc620c52631 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:39:03.418028 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.policy [None req-cd210057-9331-439b-877d-efc620c52631 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0431b1f25497443ba483b3c440669080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e36ab03283d4ce6a2fed5e111e03d34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129322) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:39:03.430953 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: INFO nova.api.openstack.requestlog [None req-cd210057-9331-439b-877d-efc620c52631 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] 10.222.0.75 "GET /compute/v2.1/servers/605b9171-aa87-432a-b179-c552640e73dd" status: 200 len: 1322 microversion: 2.1 time: 0.613678 May 26 12:39:03.457255 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: [pid: 129322|app: 0|req: 90/171] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 26 12:39:02 2022] GET /compute/v2.1/servers/605b9171-aa87-432a-b179-c552640e73dd => generated 1322 bytes in 641 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:39:04.472171 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi [None req-a7f26e44-8215-400d-a673-b92da48d3a45 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Calling method '>' {{(pid=129321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:39:04.472868 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.compute.api [None req-a7f26e44-8215-400d-a673-b92da48d3a45 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] [instance: 605b9171-aa87-432a-b179-c552640e73dd] Fetching instance by UUID {{(pid=129321) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:39:04.489287 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-a7f26e44-8215-400d-a673-b92da48d3a45 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:39:04.489747 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-a7f26e44-8215-400d-a673-b92da48d3a45 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:39:04.498998 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-a7f26e44-8215-400d-a673-b92da48d3a45 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:39:04.499773 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-a7f26e44-8215-400d-a673-b92da48d3a45 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:39:04.715324 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.policy [None req-a7f26e44-8215-400d-a673-b92da48d3a45 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0431b1f25497443ba483b3c440669080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e36ab03283d4ce6a2fed5e111e03d34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129321) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:39:04.723849 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: INFO nova.api.openstack.requestlog [None req-a7f26e44-8215-400d-a673-b92da48d3a45 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] 10.222.0.75 "GET /compute/v2.1/servers/605b9171-aa87-432a-b179-c552640e73dd" status: 200 len: 1322 microversion: 2.1 time: 0.256820 May 26 12:39:04.731851 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: [pid: 129321|app: 0|req: 82/172] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 26 12:39:04 2022] GET /compute/v2.1/servers/605b9171-aa87-432a-b179-c552640e73dd => generated 1322 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:39:05.743299 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi [None req-f771a96a-597a-47b2-ad11-1234b3397557 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Calling method '>' {{(pid=129322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:39:05.744215 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.compute.api [None req-f771a96a-597a-47b2-ad11-1234b3397557 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] [instance: 605b9171-aa87-432a-b179-c552640e73dd] Fetching instance by UUID {{(pid=129322) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:39:05.752785 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-f771a96a-597a-47b2-ad11-1234b3397557 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:39:05.753557 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-f771a96a-597a-47b2-ad11-1234b3397557 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:39:05.754425 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-f771a96a-597a-47b2-ad11-1234b3397557 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:39:05.754981 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-f771a96a-597a-47b2-ad11-1234b3397557 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:39:05.914804 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.policy [None req-f771a96a-597a-47b2-ad11-1234b3397557 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0431b1f25497443ba483b3c440669080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e36ab03283d4ce6a2fed5e111e03d34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129322) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:39:05.923651 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: INFO nova.api.openstack.requestlog [None req-f771a96a-597a-47b2-ad11-1234b3397557 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] 10.222.0.75 "GET /compute/v2.1/servers/605b9171-aa87-432a-b179-c552640e73dd" status: 200 len: 1322 microversion: 2.1 time: 0.186593 May 26 12:39:05.928909 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: [pid: 129322|app: 0|req: 91/173] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 26 12:39:05 2022] GET /compute/v2.1/servers/605b9171-aa87-432a-b179-c552640e73dd => generated 1322 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:39:06.940917 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi [None req-033b3771-f3e4-491f-978c-dbf7b7516726 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Calling method '>' {{(pid=129321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:39:06.941527 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.compute.api [None req-033b3771-f3e4-491f-978c-dbf7b7516726 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] [instance: 605b9171-aa87-432a-b179-c552640e73dd] Fetching instance by UUID {{(pid=129321) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:39:06.952960 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-033b3771-f3e4-491f-978c-dbf7b7516726 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:39:06.953403 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-033b3771-f3e4-491f-978c-dbf7b7516726 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:39:06.954542 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-033b3771-f3e4-491f-978c-dbf7b7516726 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:39:06.955133 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-033b3771-f3e4-491f-978c-dbf7b7516726 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:39:07.100295 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.policy [None req-033b3771-f3e4-491f-978c-dbf7b7516726 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0431b1f25497443ba483b3c440669080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e36ab03283d4ce6a2fed5e111e03d34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129321) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:39:07.108641 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: INFO nova.api.openstack.requestlog [None req-033b3771-f3e4-491f-978c-dbf7b7516726 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] 10.222.0.75 "GET /compute/v2.1/servers/605b9171-aa87-432a-b179-c552640e73dd" status: 200 len: 1322 microversion: 2.1 time: 0.172169 May 26 12:39:07.109290 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: [pid: 129321|app: 0|req: 83/174] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 26 12:39:06 2022] GET /compute/v2.1/servers/605b9171-aa87-432a-b179-c552640e73dd => generated 1322 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:39:08.126231 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi [None req-14fc84bb-d48f-431a-a759-433918785d2b tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Calling method '>' {{(pid=129322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:39:08.127398 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.compute.api [None req-14fc84bb-d48f-431a-a759-433918785d2b tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] [instance: 605b9171-aa87-432a-b179-c552640e73dd] Fetching instance by UUID {{(pid=129322) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:39:08.134503 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-14fc84bb-d48f-431a-a759-433918785d2b tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:39:08.134949 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-14fc84bb-d48f-431a-a759-433918785d2b tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:39:08.135755 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-14fc84bb-d48f-431a-a759-433918785d2b tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:39:08.136479 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-14fc84bb-d48f-431a-a759-433918785d2b tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:39:08.290842 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.policy [None req-14fc84bb-d48f-431a-a759-433918785d2b tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0431b1f25497443ba483b3c440669080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e36ab03283d4ce6a2fed5e111e03d34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129322) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:39:08.298920 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: INFO nova.api.openstack.requestlog [None req-14fc84bb-d48f-431a-a759-433918785d2b tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] 10.222.0.75 "GET /compute/v2.1/servers/605b9171-aa87-432a-b179-c552640e73dd" status: 200 len: 1322 microversion: 2.1 time: 0.176614 May 26 12:39:08.299500 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: [pid: 129322|app: 0|req: 92/175] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 26 12:39:08 2022] GET /compute/v2.1/servers/605b9171-aa87-432a-b179-c552640e73dd => generated 1322 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:39:09.314959 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi [None req-91a0e7cc-df12-4674-9086-52629375d0a0 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Calling method '>' {{(pid=129321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:39:09.315606 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.compute.api [None req-91a0e7cc-df12-4674-9086-52629375d0a0 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] [instance: 605b9171-aa87-432a-b179-c552640e73dd] Fetching instance by UUID {{(pid=129321) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:39:09.321886 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-91a0e7cc-df12-4674-9086-52629375d0a0 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:39:09.322380 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-91a0e7cc-df12-4674-9086-52629375d0a0 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:39:09.323173 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-91a0e7cc-df12-4674-9086-52629375d0a0 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:39:09.323640 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-91a0e7cc-df12-4674-9086-52629375d0a0 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:39:09.456747 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.policy [None req-91a0e7cc-df12-4674-9086-52629375d0a0 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0431b1f25497443ba483b3c440669080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e36ab03283d4ce6a2fed5e111e03d34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129321) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:39:09.464524 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: INFO nova.api.openstack.requestlog [None req-91a0e7cc-df12-4674-9086-52629375d0a0 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] 10.222.0.75 "GET /compute/v2.1/servers/605b9171-aa87-432a-b179-c552640e73dd" status: 200 len: 1322 microversion: 2.1 time: 0.153367 May 26 12:39:09.465105 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: [pid: 129321|app: 0|req: 84/176] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 26 12:39:09 2022] GET /compute/v2.1/servers/605b9171-aa87-432a-b179-c552640e73dd => generated 1322 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:39:10.481525 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi [None req-66c5b25f-cf93-4daa-b7ee-0e8126097ddc tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Calling method '>' {{(pid=129322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:39:10.482302 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.compute.api [None req-66c5b25f-cf93-4daa-b7ee-0e8126097ddc tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] [instance: 605b9171-aa87-432a-b179-c552640e73dd] Fetching instance by UUID {{(pid=129322) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:39:10.488891 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-66c5b25f-cf93-4daa-b7ee-0e8126097ddc tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:39:10.489332 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-66c5b25f-cf93-4daa-b7ee-0e8126097ddc tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:39:10.490116 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-66c5b25f-cf93-4daa-b7ee-0e8126097ddc tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:39:10.490540 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-66c5b25f-cf93-4daa-b7ee-0e8126097ddc tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:39:10.650964 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.policy [None req-66c5b25f-cf93-4daa-b7ee-0e8126097ddc tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0431b1f25497443ba483b3c440669080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e36ab03283d4ce6a2fed5e111e03d34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129322) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:39:10.659551 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: INFO nova.api.openstack.requestlog [None req-66c5b25f-cf93-4daa-b7ee-0e8126097ddc tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] 10.222.0.75 "GET /compute/v2.1/servers/605b9171-aa87-432a-b179-c552640e73dd" status: 200 len: 1516 microversion: 2.1 time: 0.181903 May 26 12:39:10.660350 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: [pid: 129322|app: 0|req: 93/177] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 26 12:39:10 2022] GET /compute/v2.1/servers/605b9171-aa87-432a-b179-c552640e73dd => generated 1516 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:39:10.677085 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi [None req-7dd44a78-e6e4-418c-83ca-6acbe0a79c6d tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=129321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 12:39:10.678097 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.compute.api [None req-7dd44a78-e6e4-418c-83ca-6acbe0a79c6d tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] [instance: 605b9171-aa87-432a-b179-c552640e73dd] Fetching instance by UUID {{(pid=129321) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:39:10.685098 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-7dd44a78-e6e4-418c-83ca-6acbe0a79c6d tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:39:10.685473 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-7dd44a78-e6e4-418c-83ca-6acbe0a79c6d tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:39:10.686323 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-7dd44a78-e6e4-418c-83ca-6acbe0a79c6d tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:39:10.686664 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-7dd44a78-e6e4-418c-83ca-6acbe0a79c6d tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:39:10.753699 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.objects.instance [None req-7dd44a78-e6e4-418c-83ca-6acbe0a79c6d tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lazy-loading 'flavor' on Instance uuid 605b9171-aa87-432a-b179-c552640e73dd {{(pid=129321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 26 12:39:11.054720 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: INFO nova.api.openstack.requestlog [None req-7dd44a78-e6e4-418c-83ca-6acbe0a79c6d tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] 10.222.0.75 "POST /compute/v2.1/servers/605b9171-aa87-432a-b179-c552640e73dd/action" status: 200 len: 32 microversion: 2.1 time: 0.381470 May 26 12:39:11.055235 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: [pid: 129321|app: 0|req: 85/178] 10.222.0.75 () {60 vars in 1277 bytes} [Thu May 26 12:39:10 2022] POST /compute/v2.1/servers/605b9171-aa87-432a-b179-c552640e73dd/action => generated 32 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 26 12:39:11.064686 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi [None req-2bdbb450-ee17-44ac-a631-e06c00ca27c2 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Calling method '>' {{(pid=129322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:39:11.066808 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.compute.api [None req-2bdbb450-ee17-44ac-a631-e06c00ca27c2 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] [instance: 605b9171-aa87-432a-b179-c552640e73dd] Fetching instance by UUID {{(pid=129322) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:39:11.079565 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-2bdbb450-ee17-44ac-a631-e06c00ca27c2 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:39:11.080307 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-2bdbb450-ee17-44ac-a631-e06c00ca27c2 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:39:11.081480 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-2bdbb450-ee17-44ac-a631-e06c00ca27c2 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:39:11.082452 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-2bdbb450-ee17-44ac-a631-e06c00ca27c2 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:39:11.229185 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.policy [None req-2bdbb450-ee17-44ac-a631-e06c00ca27c2 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0431b1f25497443ba483b3c440669080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e36ab03283d4ce6a2fed5e111e03d34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129322) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:39:11.237238 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: INFO nova.api.openstack.requestlog [None req-2bdbb450-ee17-44ac-a631-e06c00ca27c2 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] 10.222.0.75 "GET /compute/v2.1/servers/605b9171-aa87-432a-b179-c552640e73dd" status: 200 len: 1522 microversion: 2.1 time: 0.176743 May 26 12:39:11.237818 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: [pid: 129322|app: 0|req: 94/179] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 26 12:39:11 2022] GET /compute/v2.1/servers/605b9171-aa87-432a-b179-c552640e73dd => generated 1522 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:39:12.259493 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi [None req-bc949ae2-4a44-4e02-90ad-0e08799b8564 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Calling method '>' {{(pid=129321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:39:12.260670 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.compute.api [None req-bc949ae2-4a44-4e02-90ad-0e08799b8564 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] [instance: 605b9171-aa87-432a-b179-c552640e73dd] Fetching instance by UUID {{(pid=129321) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:39:12.271296 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-bc949ae2-4a44-4e02-90ad-0e08799b8564 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:39:12.272471 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-bc949ae2-4a44-4e02-90ad-0e08799b8564 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:39:12.273547 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-bc949ae2-4a44-4e02-90ad-0e08799b8564 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:39:12.273978 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-bc949ae2-4a44-4e02-90ad-0e08799b8564 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:39:12.425806 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.policy [None req-bc949ae2-4a44-4e02-90ad-0e08799b8564 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0431b1f25497443ba483b3c440669080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e36ab03283d4ce6a2fed5e111e03d34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129321) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:39:12.433596 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: INFO nova.api.openstack.requestlog [None req-bc949ae2-4a44-4e02-90ad-0e08799b8564 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] 10.222.0.75 "GET /compute/v2.1/servers/605b9171-aa87-432a-b179-c552640e73dd" status: 200 len: 1522 microversion: 2.1 time: 0.181967 May 26 12:39:12.434151 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: [pid: 129321|app: 0|req: 86/180] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 26 12:39:12 2022] GET /compute/v2.1/servers/605b9171-aa87-432a-b179-c552640e73dd => generated 1522 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:39:13.451121 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi [None req-52308420-6a9d-4aa6-87b5-10728d31f4a0 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Calling method '>' {{(pid=129322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:39:13.451753 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.compute.api [None req-52308420-6a9d-4aa6-87b5-10728d31f4a0 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] [instance: 605b9171-aa87-432a-b179-c552640e73dd] Fetching instance by UUID {{(pid=129322) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:39:13.458760 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-52308420-6a9d-4aa6-87b5-10728d31f4a0 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:39:13.459156 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-52308420-6a9d-4aa6-87b5-10728d31f4a0 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:39:13.459848 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-52308420-6a9d-4aa6-87b5-10728d31f4a0 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:39:13.460311 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-52308420-6a9d-4aa6-87b5-10728d31f4a0 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:39:13.591000 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.policy [None req-52308420-6a9d-4aa6-87b5-10728d31f4a0 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0431b1f25497443ba483b3c440669080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e36ab03283d4ce6a2fed5e111e03d34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129322) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:39:13.598750 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: INFO nova.api.openstack.requestlog [None req-52308420-6a9d-4aa6-87b5-10728d31f4a0 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] 10.222.0.75 "GET /compute/v2.1/servers/605b9171-aa87-432a-b179-c552640e73dd" status: 200 len: 1522 microversion: 2.1 time: 0.151552 May 26 12:39:13.599317 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: [pid: 129322|app: 0|req: 95/181] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 26 12:39:13 2022] GET /compute/v2.1/servers/605b9171-aa87-432a-b179-c552640e73dd => generated 1522 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:39:14.618088 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi [None req-402745ea-715d-48e2-b42b-5dc05ae956e8 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Calling method '>' {{(pid=129321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:39:14.618684 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.compute.api [None req-402745ea-715d-48e2-b42b-5dc05ae956e8 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] [instance: 605b9171-aa87-432a-b179-c552640e73dd] Fetching instance by UUID {{(pid=129321) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:39:14.625250 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-402745ea-715d-48e2-b42b-5dc05ae956e8 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:39:14.625732 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-402745ea-715d-48e2-b42b-5dc05ae956e8 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:39:14.626483 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-402745ea-715d-48e2-b42b-5dc05ae956e8 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:39:14.626916 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-402745ea-715d-48e2-b42b-5dc05ae956e8 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:39:14.758885 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.policy [None req-402745ea-715d-48e2-b42b-5dc05ae956e8 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0431b1f25497443ba483b3c440669080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e36ab03283d4ce6a2fed5e111e03d34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129321) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:39:14.766942 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: INFO nova.api.openstack.requestlog [None req-402745ea-715d-48e2-b42b-5dc05ae956e8 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] 10.222.0.75 "GET /compute/v2.1/servers/605b9171-aa87-432a-b179-c552640e73dd" status: 200 len: 1522 microversion: 2.1 time: 0.154792 May 26 12:39:14.767745 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: [pid: 129321|app: 0|req: 87/182] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 26 12:39:14 2022] GET /compute/v2.1/servers/605b9171-aa87-432a-b179-c552640e73dd => generated 1522 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:39:15.788207 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi [None req-0e6cc395-5cea-47b4-8164-0df25cbe85c1 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Calling method '>' {{(pid=129322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:39:15.789050 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.compute.api [None req-0e6cc395-5cea-47b4-8164-0df25cbe85c1 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] [instance: 605b9171-aa87-432a-b179-c552640e73dd] Fetching instance by UUID {{(pid=129322) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:39:15.796057 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-0e6cc395-5cea-47b4-8164-0df25cbe85c1 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:39:15.796501 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-0e6cc395-5cea-47b4-8164-0df25cbe85c1 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:39:15.797284 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-0e6cc395-5cea-47b4-8164-0df25cbe85c1 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:39:15.797709 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-0e6cc395-5cea-47b4-8164-0df25cbe85c1 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:39:15.929647 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.policy [None req-0e6cc395-5cea-47b4-8164-0df25cbe85c1 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0431b1f25497443ba483b3c440669080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e36ab03283d4ce6a2fed5e111e03d34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129322) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:39:15.937876 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: INFO nova.api.openstack.requestlog [None req-0e6cc395-5cea-47b4-8164-0df25cbe85c1 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] 10.222.0.75 "GET /compute/v2.1/servers/605b9171-aa87-432a-b179-c552640e73dd" status: 200 len: 1522 microversion: 2.1 time: 0.156245 May 26 12:39:15.938457 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: [pid: 129322|app: 0|req: 96/183] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 26 12:39:15 2022] GET /compute/v2.1/servers/605b9171-aa87-432a-b179-c552640e73dd => generated 1522 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:39:16.954505 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi [None req-891544c7-cffb-48ed-a4c4-dd204631711b tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Calling method '>' {{(pid=129321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:39:16.955106 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.compute.api [None req-891544c7-cffb-48ed-a4c4-dd204631711b tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] [instance: 605b9171-aa87-432a-b179-c552640e73dd] Fetching instance by UUID {{(pid=129321) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:39:16.961264 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-891544c7-cffb-48ed-a4c4-dd204631711b tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:39:16.961718 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-891544c7-cffb-48ed-a4c4-dd204631711b tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:39:16.962469 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-891544c7-cffb-48ed-a4c4-dd204631711b tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:39:16.962902 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-891544c7-cffb-48ed-a4c4-dd204631711b tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:39:17.103921 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.policy [None req-891544c7-cffb-48ed-a4c4-dd204631711b tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0431b1f25497443ba483b3c440669080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e36ab03283d4ce6a2fed5e111e03d34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129321) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:39:17.111428 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: INFO nova.api.openstack.requestlog [None req-891544c7-cffb-48ed-a4c4-dd204631711b tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] 10.222.0.75 "GET /compute/v2.1/servers/605b9171-aa87-432a-b179-c552640e73dd" status: 200 len: 1522 microversion: 2.1 time: 0.160963 May 26 12:39:17.112031 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: [pid: 129321|app: 0|req: 88/184] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 26 12:39:16 2022] GET /compute/v2.1/servers/605b9171-aa87-432a-b179-c552640e73dd => generated 1522 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:39:18.129560 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi [None req-6fa47bfb-f409-4add-b711-3867a81bbdf6 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Calling method '>' {{(pid=129322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:39:18.130250 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.compute.api [None req-6fa47bfb-f409-4add-b711-3867a81bbdf6 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] [instance: 605b9171-aa87-432a-b179-c552640e73dd] Fetching instance by UUID {{(pid=129322) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:39:18.144480 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-6fa47bfb-f409-4add-b711-3867a81bbdf6 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:39:18.144997 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-6fa47bfb-f409-4add-b711-3867a81bbdf6 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:39:18.145859 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-6fa47bfb-f409-4add-b711-3867a81bbdf6 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:39:18.146361 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-6fa47bfb-f409-4add-b711-3867a81bbdf6 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:39:18.199366 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi [None req-1ef47f6a-94a7-4a0b-9259-f9dbb79a97d9 tempest-DeleteServersTestJSON-342872481 tempest-DeleteServersTestJSON-342872481-project] Calling method '>' {{(pid=129321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:39:18.200051 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.compute.api [None req-1ef47f6a-94a7-4a0b-9259-f9dbb79a97d9 tempest-DeleteServersTestJSON-342872481 tempest-DeleteServersTestJSON-342872481-project] [instance: 10054724-aefc-4a9f-a212-14e5fc5a1672] Fetching instance by UUID {{(pid=129321) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:39:18.206071 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-1ef47f6a-94a7-4a0b-9259-f9dbb79a97d9 tempest-DeleteServersTestJSON-342872481 tempest-DeleteServersTestJSON-342872481-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:39:18.206513 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-1ef47f6a-94a7-4a0b-9259-f9dbb79a97d9 tempest-DeleteServersTestJSON-342872481 tempest-DeleteServersTestJSON-342872481-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:39:18.207267 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-1ef47f6a-94a7-4a0b-9259-f9dbb79a97d9 tempest-DeleteServersTestJSON-342872481 tempest-DeleteServersTestJSON-342872481-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:39:18.207730 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-1ef47f6a-94a7-4a0b-9259-f9dbb79a97d9 tempest-DeleteServersTestJSON-342872481 tempest-DeleteServersTestJSON-342872481-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:39:18.233773 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.compute.api [None req-1ef47f6a-94a7-4a0b-9259-f9dbb79a97d9 tempest-DeleteServersTestJSON-342872481 tempest-DeleteServersTestJSON-342872481-project] [instance: 10054724-aefc-4a9f-a212-14e5fc5a1672] Going to try to terminate instance {{(pid=129321) delete /opt/stack/nova/nova/compute/api.py:2664}} May 26 12:39:18.307905 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.policy [None req-6fa47bfb-f409-4add-b711-3867a81bbdf6 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0431b1f25497443ba483b3c440669080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e36ab03283d4ce6a2fed5e111e03d34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129322) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:39:18.316296 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: INFO nova.api.openstack.requestlog [None req-6fa47bfb-f409-4add-b711-3867a81bbdf6 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] 10.222.0.75 "GET /compute/v2.1/servers/605b9171-aa87-432a-b179-c552640e73dd" status: 200 len: 1522 microversion: 2.1 time: 0.191878 May 26 12:39:18.317164 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: [pid: 129322|app: 0|req: 97/185] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 26 12:39:18 2022] GET /compute/v2.1/servers/605b9171-aa87-432a-b179-c552640e73dd => generated 1522 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:39:18.348170 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: INFO nova.api.openstack.requestlog [None req-1ef47f6a-94a7-4a0b-9259-f9dbb79a97d9 tempest-DeleteServersTestJSON-342872481 tempest-DeleteServersTestJSON-342872481-project] 10.222.0.75 "DELETE /compute/v2.1/servers/10054724-aefc-4a9f-a212-14e5fc5a1672" status: 204 len: 0 microversion: 2.1 time: 0.152717 May 26 12:39:18.348810 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: [pid: 129321|app: 0|req: 89/186] 10.222.0.75 () {58 vars in 1238 bytes} [Thu May 26 12:39:18 2022] DELETE /compute/v2.1/servers/10054724-aefc-4a9f-a212-14e5fc5a1672 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) May 26 12:39:18.357848 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi [None req-676d282e-77e0-463a-b8b3-563bb53bba5f tempest-DeleteServersTestJSON-342872481 tempest-DeleteServersTestJSON-342872481-project] Calling method '>' {{(pid=129322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:39:18.358740 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.compute.api [None req-676d282e-77e0-463a-b8b3-563bb53bba5f tempest-DeleteServersTestJSON-342872481 tempest-DeleteServersTestJSON-342872481-project] [instance: 10054724-aefc-4a9f-a212-14e5fc5a1672] Fetching instance by UUID {{(pid=129322) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:39:18.365066 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-676d282e-77e0-463a-b8b3-563bb53bba5f tempest-DeleteServersTestJSON-342872481 tempest-DeleteServersTestJSON-342872481-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:39:18.365817 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-676d282e-77e0-463a-b8b3-563bb53bba5f tempest-DeleteServersTestJSON-342872481 tempest-DeleteServersTestJSON-342872481-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:39:18.366327 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-676d282e-77e0-463a-b8b3-563bb53bba5f tempest-DeleteServersTestJSON-342872481 tempest-DeleteServersTestJSON-342872481-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:39:18.366928 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-676d282e-77e0-463a-b8b3-563bb53bba5f tempest-DeleteServersTestJSON-342872481 tempest-DeleteServersTestJSON-342872481-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:39:18.512677 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.policy [None req-676d282e-77e0-463a-b8b3-563bb53bba5f tempest-DeleteServersTestJSON-342872481 tempest-DeleteServersTestJSON-342872481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d19942e971b4d7fac3ab8f9a5ad6086', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0f340fa7ff24ca899b0f1036d0e6a3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129322) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:39:18.520893 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: INFO nova.api.openstack.requestlog [None req-676d282e-77e0-463a-b8b3-563bb53bba5f tempest-DeleteServersTestJSON-342872481 tempest-DeleteServersTestJSON-342872481-project] 10.222.0.75 "GET /compute/v2.1/servers/10054724-aefc-4a9f-a212-14e5fc5a1672" status: 200 len: 1554 microversion: 2.1 time: 0.167059 May 26 12:39:18.521904 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: [pid: 129322|app: 0|req: 98/187] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 26 12:39:18 2022] GET /compute/v2.1/servers/10054724-aefc-4a9f-a212-14e5fc5a1672 => generated 1554 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:39:19.339568 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi [None req-7c3ec695-8426-43ab-a763-d6540778436c tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Calling method '>' {{(pid=129321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:39:19.340141 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.compute.api [None req-7c3ec695-8426-43ab-a763-d6540778436c tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] [instance: 605b9171-aa87-432a-b179-c552640e73dd] Fetching instance by UUID {{(pid=129321) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:39:19.346660 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-7c3ec695-8426-43ab-a763-d6540778436c tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:39:19.347106 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-7c3ec695-8426-43ab-a763-d6540778436c tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:39:19.347904 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-7c3ec695-8426-43ab-a763-d6540778436c tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:39:19.348336 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-7c3ec695-8426-43ab-a763-d6540778436c tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:39:19.480929 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.policy [None req-7c3ec695-8426-43ab-a763-d6540778436c tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0431b1f25497443ba483b3c440669080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e36ab03283d4ce6a2fed5e111e03d34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129321) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:39:19.484956 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG dbcounter [-] [129321] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=129321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:39:19.490382 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: INFO nova.api.openstack.requestlog [None req-7c3ec695-8426-43ab-a763-d6540778436c tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] 10.222.0.75 "GET /compute/v2.1/servers/605b9171-aa87-432a-b179-c552640e73dd" status: 200 len: 1522 microversion: 2.1 time: 0.155176 May 26 12:39:19.490962 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: [pid: 129321|app: 0|req: 90/188] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 26 12:39:19 2022] GET /compute/v2.1/servers/605b9171-aa87-432a-b179-c552640e73dd => generated 1522 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:39:19.538422 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi [None req-347200ee-b160-4c6e-8cf1-5344d3b868a9 tempest-DeleteServersTestJSON-342872481 tempest-DeleteServersTestJSON-342872481-project] Calling method '>' {{(pid=129322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:39:19.539173 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.compute.api [None req-347200ee-b160-4c6e-8cf1-5344d3b868a9 tempest-DeleteServersTestJSON-342872481 tempest-DeleteServersTestJSON-342872481-project] [instance: 10054724-aefc-4a9f-a212-14e5fc5a1672] Fetching instance by UUID {{(pid=129322) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:39:19.546479 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-347200ee-b160-4c6e-8cf1-5344d3b868a9 tempest-DeleteServersTestJSON-342872481 tempest-DeleteServersTestJSON-342872481-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:39:19.546907 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-347200ee-b160-4c6e-8cf1-5344d3b868a9 tempest-DeleteServersTestJSON-342872481 tempest-DeleteServersTestJSON-342872481-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:39:19.547708 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-347200ee-b160-4c6e-8cf1-5344d3b868a9 tempest-DeleteServersTestJSON-342872481 tempest-DeleteServersTestJSON-342872481-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:39:19.548139 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-347200ee-b160-4c6e-8cf1-5344d3b868a9 tempest-DeleteServersTestJSON-342872481 tempest-DeleteServersTestJSON-342872481-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:39:19.683982 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.policy [None req-347200ee-b160-4c6e-8cf1-5344d3b868a9 tempest-DeleteServersTestJSON-342872481 tempest-DeleteServersTestJSON-342872481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d19942e971b4d7fac3ab8f9a5ad6086', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0f340fa7ff24ca899b0f1036d0e6a3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129322) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:39:19.692848 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: INFO nova.api.openstack.requestlog [None req-347200ee-b160-4c6e-8cf1-5344d3b868a9 tempest-DeleteServersTestJSON-342872481 tempest-DeleteServersTestJSON-342872481-project] 10.222.0.75 "GET /compute/v2.1/servers/10054724-aefc-4a9f-a212-14e5fc5a1672" status: 200 len: 1554 microversion: 2.1 time: 0.158299 May 26 12:39:19.701874 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: [pid: 129322|app: 0|req: 99/189] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 26 12:39:19 2022] GET /compute/v2.1/servers/10054724-aefc-4a9f-a212-14e5fc5a1672 => generated 1554 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:39:20.512522 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi [None req-98dd019e-87da-4abb-86bd-d8d2378ea875 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Calling method '>' {{(pid=129321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:39:20.513535 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.compute.api [None req-98dd019e-87da-4abb-86bd-d8d2378ea875 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] [instance: 605b9171-aa87-432a-b179-c552640e73dd] Fetching instance by UUID {{(pid=129321) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:39:20.520842 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-98dd019e-87da-4abb-86bd-d8d2378ea875 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:39:20.521292 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-98dd019e-87da-4abb-86bd-d8d2378ea875 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:39:20.522421 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-98dd019e-87da-4abb-86bd-d8d2378ea875 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:39:20.522858 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-98dd019e-87da-4abb-86bd-d8d2378ea875 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:39:20.659845 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.policy [None req-98dd019e-87da-4abb-86bd-d8d2378ea875 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0431b1f25497443ba483b3c440669080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e36ab03283d4ce6a2fed5e111e03d34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129321) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:39:20.668637 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: INFO nova.api.openstack.requestlog [None req-98dd019e-87da-4abb-86bd-d8d2378ea875 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] 10.222.0.75 "GET /compute/v2.1/servers/605b9171-aa87-432a-b179-c552640e73dd" status: 200 len: 1522 microversion: 2.1 time: 0.161486 May 26 12:39:20.669206 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: [pid: 129321|app: 0|req: 91/190] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 26 12:39:20 2022] GET /compute/v2.1/servers/605b9171-aa87-432a-b179-c552640e73dd => generated 1522 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:39:20.710684 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi [None req-3f7e76d6-d02b-48f2-9041-d48d2f4d9c76 tempest-DeleteServersTestJSON-342872481 tempest-DeleteServersTestJSON-342872481-project] Calling method '>' {{(pid=129322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:39:20.711323 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.compute.api [None req-3f7e76d6-d02b-48f2-9041-d48d2f4d9c76 tempest-DeleteServersTestJSON-342872481 tempest-DeleteServersTestJSON-342872481-project] [instance: 10054724-aefc-4a9f-a212-14e5fc5a1672] Fetching instance by UUID {{(pid=129322) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:39:20.718286 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-3f7e76d6-d02b-48f2-9041-d48d2f4d9c76 tempest-DeleteServersTestJSON-342872481 tempest-DeleteServersTestJSON-342872481-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:39:20.718730 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-3f7e76d6-d02b-48f2-9041-d48d2f4d9c76 tempest-DeleteServersTestJSON-342872481 tempest-DeleteServersTestJSON-342872481-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:39:20.719891 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-3f7e76d6-d02b-48f2-9041-d48d2f4d9c76 tempest-DeleteServersTestJSON-342872481 tempest-DeleteServersTestJSON-342872481-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:39:20.720324 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-3f7e76d6-d02b-48f2-9041-d48d2f4d9c76 tempest-DeleteServersTestJSON-342872481 tempest-DeleteServersTestJSON-342872481-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:39:20.739454 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG dbcounter [-] [129322] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=129322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:39:20.902112 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.policy [None req-3f7e76d6-d02b-48f2-9041-d48d2f4d9c76 tempest-DeleteServersTestJSON-342872481 tempest-DeleteServersTestJSON-342872481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d19942e971b4d7fac3ab8f9a5ad6086', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0f340fa7ff24ca899b0f1036d0e6a3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129322) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:39:20.917439 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: INFO nova.api.openstack.requestlog [None req-3f7e76d6-d02b-48f2-9041-d48d2f4d9c76 tempest-DeleteServersTestJSON-342872481 tempest-DeleteServersTestJSON-342872481-project] 10.222.0.75 "GET /compute/v2.1/servers/10054724-aefc-4a9f-a212-14e5fc5a1672" status: 200 len: 1554 microversion: 2.1 time: 0.210778 May 26 12:39:20.918686 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: [pid: 129322|app: 0|req: 100/191] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 26 12:39:20 2022] GET /compute/v2.1/servers/10054724-aefc-4a9f-a212-14e5fc5a1672 => generated 1554 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:39:21.686306 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi [None req-24a07361-9b77-4533-b520-b1b499a9b650 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Calling method '>' {{(pid=129321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:39:21.687697 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.compute.api [None req-24a07361-9b77-4533-b520-b1b499a9b650 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] [instance: 605b9171-aa87-432a-b179-c552640e73dd] Fetching instance by UUID {{(pid=129321) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:39:21.694858 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-24a07361-9b77-4533-b520-b1b499a9b650 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:39:21.695398 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-24a07361-9b77-4533-b520-b1b499a9b650 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:39:21.696710 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-24a07361-9b77-4533-b520-b1b499a9b650 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:39:21.697159 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-24a07361-9b77-4533-b520-b1b499a9b650 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:39:21.935592 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi [None req-0e68fb04-5b54-4b4b-a1e9-60c3439817ee tempest-DeleteServersTestJSON-342872481 tempest-DeleteServersTestJSON-342872481-project] Calling method '>' {{(pid=129322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:39:21.936837 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.compute.api [None req-0e68fb04-5b54-4b4b-a1e9-60c3439817ee tempest-DeleteServersTestJSON-342872481 tempest-DeleteServersTestJSON-342872481-project] [instance: 10054724-aefc-4a9f-a212-14e5fc5a1672] Fetching instance by UUID {{(pid=129322) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:39:21.953297 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-0e68fb04-5b54-4b4b-a1e9-60c3439817ee tempest-DeleteServersTestJSON-342872481 tempest-DeleteServersTestJSON-342872481-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:39:21.956824 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-0e68fb04-5b54-4b4b-a1e9-60c3439817ee tempest-DeleteServersTestJSON-342872481 tempest-DeleteServersTestJSON-342872481-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:39:21.958330 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-0e68fb04-5b54-4b4b-a1e9-60c3439817ee tempest-DeleteServersTestJSON-342872481 tempest-DeleteServersTestJSON-342872481-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:39:21.958914 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-0e68fb04-5b54-4b4b-a1e9-60c3439817ee tempest-DeleteServersTestJSON-342872481 tempest-DeleteServersTestJSON-342872481-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:39:22.044024 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.policy [None req-24a07361-9b77-4533-b520-b1b499a9b650 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0431b1f25497443ba483b3c440669080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e36ab03283d4ce6a2fed5e111e03d34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129321) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:39:22.053953 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: INFO nova.api.openstack.requestlog [None req-24a07361-9b77-4533-b520-b1b499a9b650 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] 10.222.0.75 "GET /compute/v2.1/servers/605b9171-aa87-432a-b179-c552640e73dd" status: 200 len: 1522 microversion: 2.1 time: 0.372251 May 26 12:39:22.054549 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: [pid: 129321|app: 0|req: 92/192] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 26 12:39:21 2022] GET /compute/v2.1/servers/605b9171-aa87-432a-b179-c552640e73dd => generated 1522 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:39:22.246654 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.policy [None req-0e68fb04-5b54-4b4b-a1e9-60c3439817ee tempest-DeleteServersTestJSON-342872481 tempest-DeleteServersTestJSON-342872481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d19942e971b4d7fac3ab8f9a5ad6086', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0f340fa7ff24ca899b0f1036d0e6a3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129322) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:39:22.258820 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: INFO nova.api.openstack.requestlog [None req-0e68fb04-5b54-4b4b-a1e9-60c3439817ee tempest-DeleteServersTestJSON-342872481 tempest-DeleteServersTestJSON-342872481-project] 10.222.0.75 "GET /compute/v2.1/servers/10054724-aefc-4a9f-a212-14e5fc5a1672" status: 200 len: 1554 microversion: 2.1 time: 0.327911 May 26 12:39:22.265399 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: [pid: 129322|app: 0|req: 101/193] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 26 12:39:21 2022] GET /compute/v2.1/servers/10054724-aefc-4a9f-a212-14e5fc5a1672 => generated 1554 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:39:23.030267 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi [req-19d23b81-824d-4597-8112-415dedf0aa14 req-23f926eb-8d46-4693-8643-d2f31f91ff43 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "10054724-aefc-4a9f-a212-14e5fc5a1672", "name": "network-vif-deleted", "tag": "d58039df-b2ef-4fd4-b2be-5a00ba363704"}]} {{(pid=129321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 12:39:23.042501 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [req-19d23b81-824d-4597-8112-415dedf0aa14 req-23f926eb-8d46-4693-8643-d2f31f91ff43 service nova] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:39:23.044163 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [req-19d23b81-824d-4597-8112-415dedf0aa14 req-23f926eb-8d46-4693-8643-d2f31f91ff43 service nova] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:39:23.072860 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi [None req-8899ec97-a8cd-44dc-b67c-ff84b1fd415c tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Calling method '>' {{(pid=129322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:39:23.074076 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.compute.api [None req-8899ec97-a8cd-44dc-b67c-ff84b1fd415c tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] [instance: 605b9171-aa87-432a-b179-c552640e73dd] Fetching instance by UUID {{(pid=129322) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:39:23.091845 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-8899ec97-a8cd-44dc-b67c-ff84b1fd415c tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:39:23.092290 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-8899ec97-a8cd-44dc-b67c-ff84b1fd415c tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:39:23.095801 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: INFO nova.api.openstack.compute.server_external_events [req-19d23b81-824d-4597-8112-415dedf0aa14 req-23f926eb-8d46-4693-8643-d2f31f91ff43 service nova] Creating event network-vif-deleted:d58039df-b2ef-4fd4-b2be-5a00ba363704 for instance 10054724-aefc-4a9f-a212-14e5fc5a1672 on hv-cinder-81966 May 26 12:39:23.098146 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-8899ec97-a8cd-44dc-b67c-ff84b1fd415c tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:39:23.099053 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-8899ec97-a8cd-44dc-b67c-ff84b1fd415c tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:39:23.107072 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: INFO nova.api.openstack.requestlog [req-19d23b81-824d-4597-8112-415dedf0aa14 req-23f926eb-8d46-4693-8643-d2f31f91ff43 service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080956 May 26 12:39:23.109436 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: [pid: 129321|app: 0|req: 93/194] 10.222.0.75 () {64 vars in 1317 bytes} [Thu May 26 12:39:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 12:39:23.286224 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi [None req-da3c3415-d7fd-4e36-ad84-413f204e25b2 tempest-DeleteServersTestJSON-342872481 tempest-DeleteServersTestJSON-342872481-project] Calling method '>' {{(pid=129321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:39:23.287265 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.compute.api [None req-da3c3415-d7fd-4e36-ad84-413f204e25b2 tempest-DeleteServersTestJSON-342872481 tempest-DeleteServersTestJSON-342872481-project] [instance: 10054724-aefc-4a9f-a212-14e5fc5a1672] Fetching instance by UUID {{(pid=129321) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:39:23.288564 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.policy [None req-8899ec97-a8cd-44dc-b67c-ff84b1fd415c tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0431b1f25497443ba483b3c440669080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e36ab03283d4ce6a2fed5e111e03d34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129322) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:39:23.296749 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: INFO nova.api.openstack.requestlog [None req-8899ec97-a8cd-44dc-b67c-ff84b1fd415c tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] 10.222.0.75 "GET /compute/v2.1/servers/605b9171-aa87-432a-b179-c552640e73dd" status: 200 len: 1522 microversion: 2.1 time: 0.229041 May 26 12:39:23.297490 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: [pid: 129322|app: 0|req: 102/195] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 26 12:39:23 2022] GET /compute/v2.1/servers/605b9171-aa87-432a-b179-c552640e73dd => generated 1522 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 12:39:23.312175 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-da3c3415-d7fd-4e36-ad84-413f204e25b2 tempest-DeleteServersTestJSON-342872481 tempest-DeleteServersTestJSON-342872481-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:39:23.312628 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-da3c3415-d7fd-4e36-ad84-413f204e25b2 tempest-DeleteServersTestJSON-342872481 tempest-DeleteServersTestJSON-342872481-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:39:23.313401 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-da3c3415-d7fd-4e36-ad84-413f204e25b2 tempest-DeleteServersTestJSON-342872481 tempest-DeleteServersTestJSON-342872481-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:39:23.313838 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-da3c3415-d7fd-4e36-ad84-413f204e25b2 tempest-DeleteServersTestJSON-342872481 tempest-DeleteServersTestJSON-342872481-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:39:23.390837 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.policy [None req-da3c3415-d7fd-4e36-ad84-413f204e25b2 tempest-DeleteServersTestJSON-342872481 tempest-DeleteServersTestJSON-342872481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d19942e971b4d7fac3ab8f9a5ad6086', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0f340fa7ff24ca899b0f1036d0e6a3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129321) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:39:23.402743 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: INFO nova.api.openstack.requestlog [None req-da3c3415-d7fd-4e36-ad84-413f204e25b2 tempest-DeleteServersTestJSON-342872481 tempest-DeleteServersTestJSON-342872481-project] 10.222.0.75 "GET /compute/v2.1/servers/10054724-aefc-4a9f-a212-14e5fc5a1672" status: 200 len: 1346 microversion: 2.1 time: 0.122509 May 26 12:39:23.403704 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: [pid: 129321|app: 0|req: 94/196] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 26 12:39:23 2022] GET /compute/v2.1/servers/10054724-aefc-4a9f-a212-14e5fc5a1672 => generated 1346 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 12:39:24.317937 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi [None req-3635c56a-f329-4228-bd79-965194374efa tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Calling method '>' {{(pid=129322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:39:24.318544 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.compute.api [None req-3635c56a-f329-4228-bd79-965194374efa tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] [instance: 605b9171-aa87-432a-b179-c552640e73dd] Fetching instance by UUID {{(pid=129322) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:39:24.326402 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-3635c56a-f329-4228-bd79-965194374efa tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:39:24.326847 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-3635c56a-f329-4228-bd79-965194374efa tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:39:24.327861 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-3635c56a-f329-4228-bd79-965194374efa tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:39:24.328294 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-3635c56a-f329-4228-bd79-965194374efa tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:39:24.421366 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi [None req-2338d94e-8a6e-437c-893e-29994d878d9a tempest-DeleteServersTestJSON-342872481 tempest-DeleteServersTestJSON-342872481-project] Calling method '>' {{(pid=129321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:39:24.423879 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.compute.api [None req-2338d94e-8a6e-437c-893e-29994d878d9a tempest-DeleteServersTestJSON-342872481 tempest-DeleteServersTestJSON-342872481-project] [instance: 10054724-aefc-4a9f-a212-14e5fc5a1672] Fetching instance by UUID {{(pid=129321) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:39:24.435101 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-2338d94e-8a6e-437c-893e-29994d878d9a tempest-DeleteServersTestJSON-342872481 tempest-DeleteServersTestJSON-342872481-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:39:24.436014 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-2338d94e-8a6e-437c-893e-29994d878d9a tempest-DeleteServersTestJSON-342872481 tempest-DeleteServersTestJSON-342872481-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:39:24.436961 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-2338d94e-8a6e-437c-893e-29994d878d9a tempest-DeleteServersTestJSON-342872481 tempest-DeleteServersTestJSON-342872481-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:39:24.437467 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-2338d94e-8a6e-437c-893e-29994d878d9a tempest-DeleteServersTestJSON-342872481 tempest-DeleteServersTestJSON-342872481-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:39:24.456140 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: INFO nova.api.openstack.wsgi [None req-2338d94e-8a6e-437c-893e-29994d878d9a tempest-DeleteServersTestJSON-342872481 tempest-DeleteServersTestJSON-342872481-project] HTTP exception thrown: Instance 10054724-aefc-4a9f-a212-14e5fc5a1672 could not be found. May 26 12:39:24.461395 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi [None req-2338d94e-8a6e-437c-893e-29994d878d9a tempest-DeleteServersTestJSON-342872481 tempest-DeleteServersTestJSON-342872481-project] Request method failure captured: May 26 12:39:24.461395 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: request: GET /compute/v2.1/servers/10054724-aefc-4a9f-a212-14e5fc5a1672 HTTP/1.1 May 26 12:39:24.461395 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: Accept: application/json May 26 12:39:24.461395 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: Accept-Encoding: identity May 26 12:39:24.461395 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: Connection: close May 26 12:39:24.461395 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: Content-Length: 0 May 26 12:39:24.461395 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: Content-Type: application/json May 26 12:39:24.461395 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: Host: 10.222.0.75 May 26 12:39:24.461395 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: Openstack-System-Scope: None May 26 12:39:24.461395 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: User-Agent: python-urllib3/1.26.9 May 26 12:39:24.461395 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: X-Auth-Token: gAAAAABij3Ss73SWp7Uj3WQJLU9JMQcCcmwxitFUlf-nRpIvyJzsU9SeHWBBXSFiCuqbr-cycH6ZxPnRMAIBv2TiTdTOL2R3VuK6SjS5e1RfgmGx6z0KuGqjeiWhmUPCg13puBJoCTOrZCx3hokk0pbwNm2Ag71dTH4dHLtSC4TaSji5uINYM30 May 26 12:39:24.461395 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: X-Domain-Id: None May 26 12:39:24.461395 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: X-Domain-Name: None May 26 12:39:24.461395 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: X-Identity-Status: Confirmed May 26 12:39:24.461395 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: X-Is-Admin-Project: True May 26 12:39:24.461395 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: X-Project-Domain-Id: default May 26 12:39:24.461395 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: X-Project-Domain-Name: Default May 26 12:39:24.461395 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: X-Project-Id: f0f340fa7ff24ca899b0f1036d0e6a3b May 26 12:39:24.461395 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: X-Project-Name: tempest-DeleteServersTestJSON-342872481 May 26 12:39:24.461395 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: X-Role: member,reader May 26 12:39:24.461395 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: X-Roles: member,reader May 26 12:39:24.463003 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/f0f340fa7ff24ca899b0f1036d0e6a3b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.75:8080", "publicURL": "http://10.222.0.75:8080/v1/AUTH_f0f340fa7ff24ca899b0f1036d0e6a3b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2/f0f340fa7ff24ca899b0f1036d0e6a3b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/f0f340fa7ff24ca899b0f1036d0e6a3b"}]}] May 26 12:39:24.463003 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: X-Tenant: tempest-DeleteServersTestJSON-342872481 May 26 12:39:24.463003 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: X-Tenant-Id: f0f340fa7ff24ca899b0f1036d0e6a3b May 26 12:39:24.463003 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: X-Tenant-Name: tempest-DeleteServersTestJSON-342872481 May 26 12:39:24.463003 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: X-User: tempest-DeleteServersTestJSON-342872481-project May 26 12:39:24.463003 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: X-User-Domain-Id: default May 26 12:39:24.463003 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: X-User-Domain-Name: Default May 26 12:39:24.463003 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: X-User-Id: 5d19942e971b4d7fac3ab8f9a5ad6086 May 26 12:39:24.463003 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: X-User-Name: tempest-DeleteServersTestJSON-342872481-project May 26 12:39:24.463003 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: method: > May 26 12:39:24.463003 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: exception: Instance 10054724-aefc-4a9f-a212-14e5fc5a1672 could not be found. May 26 12:39:24.463003 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: action_args: {'id': '10054724-aefc-4a9f-a212-14e5fc5a1672'} May 26 12:39:24.463743 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: {{(pid=129321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 12:39:24.463743 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 12:39:24.463743 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 26 12:39:24.463743 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 26 12:39:24.463743 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 26 12:39:24.463743 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 26 12:39:24.463743 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 26 12:39:24.463743 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 26 12:39:24.463743 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 26 12:39:24.463743 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 26 12:39:24.463743 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 10054724-aefc-4a9f-a212-14e5fc5a1672 could not be found. May 26 12:39:24.463743 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi May 26 12:39:24.463743 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 12:39:24.463743 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi May 26 12:39:24.463743 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 12:39:24.463743 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 12:39:24.463743 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 12:39:24.463743 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 12:39:24.463743 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 12:39:24.463743 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 12:39:24.464857 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 12:39:24.464857 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 26 12:39:24.464857 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 26 12:39:24.464857 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 26 12:39:24.464857 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 26 12:39:24.464857 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 26 12:39:24.464857 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 12:39:24.464857 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 10054724-aefc-4a9f-a212-14e5fc5a1672 could not be found. May 26 12:39:24.464857 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi May 26 12:39:24.464857 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 12:39:24.464857 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi May 26 12:39:24.464857 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 12:39:24.464857 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 12:39:24.464857 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 12:39:24.464857 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 12:39:24.464857 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 12:39:24.464857 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 10054724-aefc-4a9f-a212-14e5fc5a1672 could not be found. May 26 12:39:24.464857 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi May 26 12:39:24.467416 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi [None req-2338d94e-8a6e-437c-893e-29994d878d9a tempest-DeleteServersTestJSON-342872481 tempest-DeleteServersTestJSON-342872481-project] Returning 404 to user: Instance 10054724-aefc-4a9f-a212-14e5fc5a1672 could not be found. {{(pid=129321) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 12:39:24.468501 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: INFO nova.api.openstack.requestlog [None req-2338d94e-8a6e-437c-893e-29994d878d9a tempest-DeleteServersTestJSON-342872481 tempest-DeleteServersTestJSON-342872481-project] 10.222.0.75 "GET /compute/v2.1/servers/10054724-aefc-4a9f-a212-14e5fc5a1672" status: 404 len: 111 microversion: 2.1 time: 0.052261 May 26 12:39:24.469258 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: [pid: 129321|app: 0|req: 95/197] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 26 12:39:24 2022] GET /compute/v2.1/servers/10054724-aefc-4a9f-a212-14e5fc5a1672 => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 26 12:39:24.502739 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.policy [None req-3635c56a-f329-4228-bd79-965194374efa tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0431b1f25497443ba483b3c440669080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e36ab03283d4ce6a2fed5e111e03d34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129322) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:39:24.512585 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: INFO nova.api.openstack.requestlog [None req-3635c56a-f329-4228-bd79-965194374efa tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] 10.222.0.75 "GET /compute/v2.1/servers/605b9171-aa87-432a-b179-c552640e73dd" status: 200 len: 1522 microversion: 2.1 time: 0.199125 May 26 12:39:24.513243 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: [pid: 129322|app: 0|req: 103/198] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 26 12:39:24 2022] GET /compute/v2.1/servers/605b9171-aa87-432a-b179-c552640e73dd => generated 1522 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:39:24.615176 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi [None req-b5efaaed-46e7-49e8-bcf9-c9c24a10eaa3 tempest-DeleteServersTestJSON-342872481 tempest-DeleteServersTestJSON-342872481-project] Calling method '>' {{(pid=129321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:39:24.616169 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.compute.api [None req-b5efaaed-46e7-49e8-bcf9-c9c24a10eaa3 tempest-DeleteServersTestJSON-342872481 tempest-DeleteServersTestJSON-342872481-project] [instance: 10054724-aefc-4a9f-a212-14e5fc5a1672] Fetching instance by UUID {{(pid=129321) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:39:24.622473 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-b5efaaed-46e7-49e8-bcf9-c9c24a10eaa3 tempest-DeleteServersTestJSON-342872481 tempest-DeleteServersTestJSON-342872481-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:39:24.623089 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-b5efaaed-46e7-49e8-bcf9-c9c24a10eaa3 tempest-DeleteServersTestJSON-342872481 tempest-DeleteServersTestJSON-342872481-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:39:24.624036 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-b5efaaed-46e7-49e8-bcf9-c9c24a10eaa3 tempest-DeleteServersTestJSON-342872481 tempest-DeleteServersTestJSON-342872481-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:39:24.624613 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-b5efaaed-46e7-49e8-bcf9-c9c24a10eaa3 tempest-DeleteServersTestJSON-342872481 tempest-DeleteServersTestJSON-342872481-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:39:24.638642 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: INFO nova.api.openstack.wsgi [None req-b5efaaed-46e7-49e8-bcf9-c9c24a10eaa3 tempest-DeleteServersTestJSON-342872481 tempest-DeleteServersTestJSON-342872481-project] HTTP exception thrown: Instance 10054724-aefc-4a9f-a212-14e5fc5a1672 could not be found. May 26 12:39:24.651256 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi [None req-b5efaaed-46e7-49e8-bcf9-c9c24a10eaa3 tempest-DeleteServersTestJSON-342872481 tempest-DeleteServersTestJSON-342872481-project] Request method failure captured: May 26 12:39:24.651256 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: request: GET /compute/v2.1/servers/10054724-aefc-4a9f-a212-14e5fc5a1672/os-volume_attachments HTTP/1.1 May 26 12:39:24.651256 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: Accept: application/json May 26 12:39:24.651256 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: Accept-Encoding: identity May 26 12:39:24.651256 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: Connection: close May 26 12:39:24.651256 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: Content-Length: 0 May 26 12:39:24.651256 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: Content-Type: application/json May 26 12:39:24.651256 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: Host: 10.222.0.75 May 26 12:39:24.651256 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: Openstack-System-Scope: None May 26 12:39:24.651256 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: User-Agent: python-urllib3/1.26.9 May 26 12:39:24.651256 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: X-Auth-Token: gAAAAABij3Ss73SWp7Uj3WQJLU9JMQcCcmwxitFUlf-nRpIvyJzsU9SeHWBBXSFiCuqbr-cycH6ZxPnRMAIBv2TiTdTOL2R3VuK6SjS5e1RfgmGx6z0KuGqjeiWhmUPCg13puBJoCTOrZCx3hokk0pbwNm2Ag71dTH4dHLtSC4TaSji5uINYM30 May 26 12:39:24.651256 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: X-Domain-Id: None May 26 12:39:24.651256 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: X-Domain-Name: None May 26 12:39:24.651256 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: X-Identity-Status: Confirmed May 26 12:39:24.651256 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: X-Is-Admin-Project: True May 26 12:39:24.651256 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: X-Project-Domain-Id: default May 26 12:39:24.651256 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: X-Project-Domain-Name: Default May 26 12:39:24.651256 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: X-Project-Id: f0f340fa7ff24ca899b0f1036d0e6a3b May 26 12:39:24.651256 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: X-Project-Name: tempest-DeleteServersTestJSON-342872481 May 26 12:39:24.651256 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: X-Role: member,reader May 26 12:39:24.651256 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: X-Roles: member,reader May 26 12:39:24.652668 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/f0f340fa7ff24ca899b0f1036d0e6a3b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.75:8080", "publicURL": "http://10.222.0.75:8080/v1/AUTH_f0f340fa7ff24ca899b0f1036d0e6a3b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2/f0f340fa7ff24ca899b0f1036d0e6a3b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/f0f340fa7ff24ca899b0f1036d0e6a3b"}]}] May 26 12:39:24.652668 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: X-Tenant: tempest-DeleteServersTestJSON-342872481 May 26 12:39:24.652668 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: X-Tenant-Id: f0f340fa7ff24ca899b0f1036d0e6a3b May 26 12:39:24.652668 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: X-Tenant-Name: tempest-DeleteServersTestJSON-342872481 May 26 12:39:24.652668 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: X-User: tempest-DeleteServersTestJSON-342872481-project May 26 12:39:24.652668 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: X-User-Domain-Id: default May 26 12:39:24.652668 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: X-User-Domain-Name: Default May 26 12:39:24.652668 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: X-User-Id: 5d19942e971b4d7fac3ab8f9a5ad6086 May 26 12:39:24.652668 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: X-User-Name: tempest-DeleteServersTestJSON-342872481-project May 26 12:39:24.652668 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: method: > May 26 12:39:24.652668 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: exception: Instance 10054724-aefc-4a9f-a212-14e5fc5a1672 could not be found. May 26 12:39:24.652668 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: action_args: {'server_id': '10054724-aefc-4a9f-a212-14e5fc5a1672'} May 26 12:39:24.653532 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: {{(pid=129321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 12:39:24.653532 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 12:39:24.653532 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 26 12:39:24.653532 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 26 12:39:24.653532 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 26 12:39:24.653532 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 26 12:39:24.653532 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 26 12:39:24.653532 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 26 12:39:24.653532 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 26 12:39:24.653532 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 26 12:39:24.653532 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 10054724-aefc-4a9f-a212-14e5fc5a1672 could not be found. May 26 12:39:24.653532 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi May 26 12:39:24.653532 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 12:39:24.653532 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi May 26 12:39:24.653532 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 12:39:24.653532 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 12:39:24.653532 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 12:39:24.653532 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 12:39:24.653532 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 12:39:24.653532 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 12:39:24.656534 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 12:39:24.656534 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper May 26 12:39:24.656534 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 26 12:39:24.656534 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper May 26 12:39:24.656534 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 26 12:39:24.656534 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index May 26 12:39:24.656534 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) May 26 12:39:24.656534 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 26 12:39:24.656534 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 12:39:24.656534 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 10054724-aefc-4a9f-a212-14e5fc5a1672 could not be found. May 26 12:39:24.656534 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi May 26 12:39:24.656534 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 12:39:24.656534 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi May 26 12:39:24.656534 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 12:39:24.656534 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 12:39:24.656534 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 12:39:24.656534 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 12:39:24.656534 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 12:39:24.656534 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 10054724-aefc-4a9f-a212-14e5fc5a1672 could not be found. May 26 12:39:24.656534 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi May 26 12:39:24.657656 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi [None req-b5efaaed-46e7-49e8-bcf9-c9c24a10eaa3 tempest-DeleteServersTestJSON-342872481 tempest-DeleteServersTestJSON-342872481-project] Returning 404 to user: Instance 10054724-aefc-4a9f-a212-14e5fc5a1672 could not be found. {{(pid=129321) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 12:39:24.657656 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: INFO nova.api.openstack.requestlog [None req-b5efaaed-46e7-49e8-bcf9-c9c24a10eaa3 tempest-DeleteServersTestJSON-342872481 tempest-DeleteServersTestJSON-342872481-project] 10.222.0.75 "GET /compute/v2.1/servers/10054724-aefc-4a9f-a212-14e5fc5a1672/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.042762 May 26 12:39:24.657656 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: [pid: 129321|app: 0|req: 96/199] 10.222.0.75 () {58 vars in 1301 bytes} [Thu May 26 12:39:24 2022] GET /compute/v2.1/servers/10054724-aefc-4a9f-a212-14e5fc5a1672/os-volume_attachments => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 26 12:39:25.540185 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi [None req-082323cd-92a7-4db7-a9bf-0688d1aa1095 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Calling method '>' {{(pid=129322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:39:25.540809 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.compute.api [None req-082323cd-92a7-4db7-a9bf-0688d1aa1095 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] [instance: 605b9171-aa87-432a-b179-c552640e73dd] Fetching instance by UUID {{(pid=129322) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:39:25.548482 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-082323cd-92a7-4db7-a9bf-0688d1aa1095 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:39:25.556544 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-082323cd-92a7-4db7-a9bf-0688d1aa1095 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:39:25.559864 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-082323cd-92a7-4db7-a9bf-0688d1aa1095 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:39:25.563407 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-082323cd-92a7-4db7-a9bf-0688d1aa1095 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:39:25.765883 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.policy [None req-082323cd-92a7-4db7-a9bf-0688d1aa1095 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0431b1f25497443ba483b3c440669080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e36ab03283d4ce6a2fed5e111e03d34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129322) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:39:25.775656 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: INFO nova.api.openstack.requestlog [None req-082323cd-92a7-4db7-a9bf-0688d1aa1095 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] 10.222.0.75 "GET /compute/v2.1/servers/605b9171-aa87-432a-b179-c552640e73dd" status: 200 len: 1522 microversion: 2.1 time: 0.250074 May 26 12:39:25.784683 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: [pid: 129322|app: 0|req: 104/200] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 26 12:39:25 2022] GET /compute/v2.1/servers/605b9171-aa87-432a-b179-c552640e73dd => generated 1522 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:39:25.947112 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi [None req-f53d2257-c171-4842-b6b2-995fa51a6aa8 tempest-DeleteServersTestJSON-342872481 tempest-DeleteServersTestJSON-342872481-project] Calling method '>' {{(pid=129321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:39:25.947631 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.compute.api [None req-f53d2257-c171-4842-b6b2-995fa51a6aa8 tempest-DeleteServersTestJSON-342872481 tempest-DeleteServersTestJSON-342872481-project] [instance: 10054724-aefc-4a9f-a212-14e5fc5a1672] Fetching instance by UUID {{(pid=129321) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:39:25.954756 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-f53d2257-c171-4842-b6b2-995fa51a6aa8 tempest-DeleteServersTestJSON-342872481 tempest-DeleteServersTestJSON-342872481-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:39:25.955187 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-f53d2257-c171-4842-b6b2-995fa51a6aa8 tempest-DeleteServersTestJSON-342872481 tempest-DeleteServersTestJSON-342872481-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:39:25.955981 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-f53d2257-c171-4842-b6b2-995fa51a6aa8 tempest-DeleteServersTestJSON-342872481 tempest-DeleteServersTestJSON-342872481-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:39:25.956399 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-f53d2257-c171-4842-b6b2-995fa51a6aa8 tempest-DeleteServersTestJSON-342872481 tempest-DeleteServersTestJSON-342872481-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:39:25.979910 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: INFO nova.api.openstack.wsgi [None req-f53d2257-c171-4842-b6b2-995fa51a6aa8 tempest-DeleteServersTestJSON-342872481 tempest-DeleteServersTestJSON-342872481-project] HTTP exception thrown: Instance 10054724-aefc-4a9f-a212-14e5fc5a1672 could not be found. May 26 12:39:25.981304 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi [None req-f53d2257-c171-4842-b6b2-995fa51a6aa8 tempest-DeleteServersTestJSON-342872481 tempest-DeleteServersTestJSON-342872481-project] Request method failure captured: May 26 12:39:25.981304 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: request: DELETE /compute/v2.1/servers/10054724-aefc-4a9f-a212-14e5fc5a1672 HTTP/1.1 May 26 12:39:25.981304 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: Accept: application/json May 26 12:39:25.981304 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: Accept-Encoding: identity May 26 12:39:25.981304 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: Connection: close May 26 12:39:25.981304 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: Content-Length: 0 May 26 12:39:25.981304 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: Content-Type: application/json May 26 12:39:25.981304 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: Host: 10.222.0.75 May 26 12:39:25.981304 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: Openstack-System-Scope: None May 26 12:39:25.981304 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: User-Agent: python-urllib3/1.26.9 May 26 12:39:25.981304 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: X-Auth-Token: gAAAAABij3Ss73SWp7Uj3WQJLU9JMQcCcmwxitFUlf-nRpIvyJzsU9SeHWBBXSFiCuqbr-cycH6ZxPnRMAIBv2TiTdTOL2R3VuK6SjS5e1RfgmGx6z0KuGqjeiWhmUPCg13puBJoCTOrZCx3hokk0pbwNm2Ag71dTH4dHLtSC4TaSji5uINYM30 May 26 12:39:25.981304 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: X-Domain-Id: None May 26 12:39:25.981304 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: X-Domain-Name: None May 26 12:39:25.981304 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: X-Identity-Status: Confirmed May 26 12:39:25.981304 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: X-Is-Admin-Project: True May 26 12:39:25.981304 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: X-Project-Domain-Id: default May 26 12:39:25.981304 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: X-Project-Domain-Name: Default May 26 12:39:25.981304 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: X-Project-Id: f0f340fa7ff24ca899b0f1036d0e6a3b May 26 12:39:25.981304 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: X-Project-Name: tempest-DeleteServersTestJSON-342872481 May 26 12:39:25.981304 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: X-Role: member,reader May 26 12:39:25.981304 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: X-Roles: member,reader May 26 12:39:25.982595 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/f0f340fa7ff24ca899b0f1036d0e6a3b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.75:8080", "publicURL": "http://10.222.0.75:8080/v1/AUTH_f0f340fa7ff24ca899b0f1036d0e6a3b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2/f0f340fa7ff24ca899b0f1036d0e6a3b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/f0f340fa7ff24ca899b0f1036d0e6a3b"}]}] May 26 12:39:25.982595 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: X-Tenant: tempest-DeleteServersTestJSON-342872481 May 26 12:39:25.982595 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: X-Tenant-Id: f0f340fa7ff24ca899b0f1036d0e6a3b May 26 12:39:25.982595 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: X-Tenant-Name: tempest-DeleteServersTestJSON-342872481 May 26 12:39:25.982595 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: X-User: tempest-DeleteServersTestJSON-342872481-project May 26 12:39:25.982595 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: X-User-Domain-Id: default May 26 12:39:25.982595 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: X-User-Domain-Name: Default May 26 12:39:25.982595 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: X-User-Id: 5d19942e971b4d7fac3ab8f9a5ad6086 May 26 12:39:25.982595 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: X-User-Name: tempest-DeleteServersTestJSON-342872481-project May 26 12:39:25.982595 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: method: > May 26 12:39:25.982595 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: exception: Instance 10054724-aefc-4a9f-a212-14e5fc5a1672 could not be found. May 26 12:39:25.982595 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: action_args: {'id': '10054724-aefc-4a9f-a212-14e5fc5a1672'} May 26 12:39:25.983436 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: {{(pid=129321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 12:39:25.983436 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 12:39:25.983436 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 26 12:39:25.983436 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 26 12:39:25.983436 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 26 12:39:25.983436 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 26 12:39:25.983436 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 26 12:39:25.983436 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 26 12:39:25.983436 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 26 12:39:25.983436 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 26 12:39:25.983436 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 10054724-aefc-4a9f-a212-14e5fc5a1672 could not be found. May 26 12:39:25.983436 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi May 26 12:39:25.983436 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 12:39:25.983436 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi May 26 12:39:25.983436 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 12:39:25.983436 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 12:39:25.983436 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 12:39:25.983436 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 12:39:25.983436 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 12:39:25.983436 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 12:39:25.984725 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 12:39:25.984725 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 26 12:39:25.984725 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 26 12:39:25.984725 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 26 12:39:25.984725 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 26 12:39:25.984725 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 26 12:39:25.984725 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 26 12:39:25.984725 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 26 12:39:25.984725 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 12:39:25.984725 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 10054724-aefc-4a9f-a212-14e5fc5a1672 could not be found. May 26 12:39:25.984725 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi May 26 12:39:25.984725 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 12:39:25.984725 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi May 26 12:39:25.984725 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 12:39:25.984725 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 12:39:25.984725 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 12:39:25.984725 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 12:39:25.984725 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 12:39:25.984725 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 10054724-aefc-4a9f-a212-14e5fc5a1672 could not be found. May 26 12:39:25.984725 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi May 26 12:39:25.986078 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi [None req-f53d2257-c171-4842-b6b2-995fa51a6aa8 tempest-DeleteServersTestJSON-342872481 tempest-DeleteServersTestJSON-342872481-project] Returning 404 to user: Instance 10054724-aefc-4a9f-a212-14e5fc5a1672 could not be found. {{(pid=129321) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 12:39:25.986078 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: INFO nova.api.openstack.requestlog [None req-f53d2257-c171-4842-b6b2-995fa51a6aa8 tempest-DeleteServersTestJSON-342872481 tempest-DeleteServersTestJSON-342872481-project] 10.222.0.75 "DELETE /compute/v2.1/servers/10054724-aefc-4a9f-a212-14e5fc5a1672" status: 404 len: 111 microversion: 2.1 time: 0.039779 May 26 12:39:25.986078 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: [pid: 129321|app: 0|req: 97/201] 10.222.0.75 () {58 vars in 1238 bytes} [Thu May 26 12:39:25 2022] DELETE /compute/v2.1/servers/10054724-aefc-4a9f-a212-14e5fc5a1672 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 26 12:39:25.995570 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi [None req-c89a4da1-ea07-494a-ad1e-7914a53b3f10 tempest-DeleteServersTestJSON-342872481 tempest-DeleteServersTestJSON-342872481-project] Calling method '>' {{(pid=129322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:39:25.996293 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.compute.api [None req-c89a4da1-ea07-494a-ad1e-7914a53b3f10 tempest-DeleteServersTestJSON-342872481 tempest-DeleteServersTestJSON-342872481-project] [instance: 10054724-aefc-4a9f-a212-14e5fc5a1672] Fetching instance by UUID {{(pid=129322) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:39:26.003676 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-c89a4da1-ea07-494a-ad1e-7914a53b3f10 tempest-DeleteServersTestJSON-342872481 tempest-DeleteServersTestJSON-342872481-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:39:26.005563 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-c89a4da1-ea07-494a-ad1e-7914a53b3f10 tempest-DeleteServersTestJSON-342872481 tempest-DeleteServersTestJSON-342872481-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:39:26.006457 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-c89a4da1-ea07-494a-ad1e-7914a53b3f10 tempest-DeleteServersTestJSON-342872481 tempest-DeleteServersTestJSON-342872481-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:39:26.006981 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-c89a4da1-ea07-494a-ad1e-7914a53b3f10 tempest-DeleteServersTestJSON-342872481 tempest-DeleteServersTestJSON-342872481-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:39:26.046044 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: INFO nova.api.openstack.wsgi [None req-c89a4da1-ea07-494a-ad1e-7914a53b3f10 tempest-DeleteServersTestJSON-342872481 tempest-DeleteServersTestJSON-342872481-project] HTTP exception thrown: Instance 10054724-aefc-4a9f-a212-14e5fc5a1672 could not be found. May 26 12:39:26.051047 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi [None req-c89a4da1-ea07-494a-ad1e-7914a53b3f10 tempest-DeleteServersTestJSON-342872481 tempest-DeleteServersTestJSON-342872481-project] Request method failure captured: May 26 12:39:26.051047 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: request: GET /compute/v2.1/servers/10054724-aefc-4a9f-a212-14e5fc5a1672 HTTP/1.1 May 26 12:39:26.051047 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: Accept: application/json May 26 12:39:26.051047 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: Accept-Encoding: identity May 26 12:39:26.051047 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: Connection: close May 26 12:39:26.051047 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: Content-Length: 0 May 26 12:39:26.051047 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: Content-Type: application/json May 26 12:39:26.051047 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: Host: 10.222.0.75 May 26 12:39:26.051047 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: Openstack-System-Scope: None May 26 12:39:26.051047 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: User-Agent: python-urllib3/1.26.9 May 26 12:39:26.051047 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: X-Auth-Token: gAAAAABij3Ss73SWp7Uj3WQJLU9JMQcCcmwxitFUlf-nRpIvyJzsU9SeHWBBXSFiCuqbr-cycH6ZxPnRMAIBv2TiTdTOL2R3VuK6SjS5e1RfgmGx6z0KuGqjeiWhmUPCg13puBJoCTOrZCx3hokk0pbwNm2Ag71dTH4dHLtSC4TaSji5uINYM30 May 26 12:39:26.051047 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: X-Domain-Id: None May 26 12:39:26.051047 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: X-Domain-Name: None May 26 12:39:26.051047 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: X-Identity-Status: Confirmed May 26 12:39:26.051047 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: X-Is-Admin-Project: True May 26 12:39:26.051047 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: X-Project-Domain-Id: default May 26 12:39:26.051047 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: X-Project-Domain-Name: Default May 26 12:39:26.051047 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: X-Project-Id: f0f340fa7ff24ca899b0f1036d0e6a3b May 26 12:39:26.051047 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: X-Project-Name: tempest-DeleteServersTestJSON-342872481 May 26 12:39:26.051047 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: X-Role: member,reader May 26 12:39:26.051047 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: X-Roles: member,reader May 26 12:39:26.052524 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/f0f340fa7ff24ca899b0f1036d0e6a3b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.75:8080", "publicURL": "http://10.222.0.75:8080/v1/AUTH_f0f340fa7ff24ca899b0f1036d0e6a3b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2/f0f340fa7ff24ca899b0f1036d0e6a3b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/f0f340fa7ff24ca899b0f1036d0e6a3b"}]}] May 26 12:39:26.052524 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: X-Tenant: tempest-DeleteServersTestJSON-342872481 May 26 12:39:26.052524 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: X-Tenant-Id: f0f340fa7ff24ca899b0f1036d0e6a3b May 26 12:39:26.052524 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: X-Tenant-Name: tempest-DeleteServersTestJSON-342872481 May 26 12:39:26.052524 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: X-User: tempest-DeleteServersTestJSON-342872481-project May 26 12:39:26.052524 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: X-User-Domain-Id: default May 26 12:39:26.052524 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: X-User-Domain-Name: Default May 26 12:39:26.052524 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: X-User-Id: 5d19942e971b4d7fac3ab8f9a5ad6086 May 26 12:39:26.052524 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: X-User-Name: tempest-DeleteServersTestJSON-342872481-project May 26 12:39:26.052524 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: method: > May 26 12:39:26.052524 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: exception: Instance 10054724-aefc-4a9f-a212-14e5fc5a1672 could not be found. May 26 12:39:26.052524 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: action_args: {'id': '10054724-aefc-4a9f-a212-14e5fc5a1672'} May 26 12:39:26.053322 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: {{(pid=129322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 12:39:26.053322 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 12:39:26.053322 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 26 12:39:26.053322 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 26 12:39:26.053322 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 26 12:39:26.053322 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 26 12:39:26.053322 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 26 12:39:26.053322 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 26 12:39:26.053322 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 26 12:39:26.053322 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 26 12:39:26.053322 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 10054724-aefc-4a9f-a212-14e5fc5a1672 could not be found. May 26 12:39:26.053322 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi May 26 12:39:26.053322 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 12:39:26.053322 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi May 26 12:39:26.053322 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 12:39:26.053322 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 12:39:26.053322 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 12:39:26.053322 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 12:39:26.053322 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 12:39:26.053322 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 12:39:26.054587 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 12:39:26.054587 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 26 12:39:26.054587 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 26 12:39:26.054587 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 26 12:39:26.054587 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 26 12:39:26.054587 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 26 12:39:26.054587 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 12:39:26.054587 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 10054724-aefc-4a9f-a212-14e5fc5a1672 could not be found. May 26 12:39:26.054587 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi May 26 12:39:26.054587 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 12:39:26.054587 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi May 26 12:39:26.054587 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 12:39:26.054587 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 12:39:26.054587 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 12:39:26.054587 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 12:39:26.054587 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 12:39:26.054587 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 10054724-aefc-4a9f-a212-14e5fc5a1672 could not be found. May 26 12:39:26.054587 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi May 26 12:39:26.055776 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi [None req-c89a4da1-ea07-494a-ad1e-7914a53b3f10 tempest-DeleteServersTestJSON-342872481 tempest-DeleteServersTestJSON-342872481-project] Returning 404 to user: Instance 10054724-aefc-4a9f-a212-14e5fc5a1672 could not be found. {{(pid=129322) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 12:39:26.058162 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: INFO nova.api.openstack.requestlog [None req-c89a4da1-ea07-494a-ad1e-7914a53b3f10 tempest-DeleteServersTestJSON-342872481 tempest-DeleteServersTestJSON-342872481-project] 10.222.0.75 "GET /compute/v2.1/servers/10054724-aefc-4a9f-a212-14e5fc5a1672" status: 404 len: 111 microversion: 2.1 time: 0.066801 May 26 12:39:26.058914 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: [pid: 129322|app: 0|req: 105/202] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 26 12:39:25 2022] GET /compute/v2.1/servers/10054724-aefc-4a9f-a212-14e5fc5a1672 => generated 111 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 26 12:39:26.797276 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi [None req-d19bb5e5-46bb-4d65-977f-753f29e4c8aa tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Calling method '>' {{(pid=129321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:39:26.798314 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.compute.api [None req-d19bb5e5-46bb-4d65-977f-753f29e4c8aa tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] [instance: 605b9171-aa87-432a-b179-c552640e73dd] Fetching instance by UUID {{(pid=129321) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:39:26.815742 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-d19bb5e5-46bb-4d65-977f-753f29e4c8aa tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:39:26.818040 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-d19bb5e5-46bb-4d65-977f-753f29e4c8aa tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:39:26.818375 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-d19bb5e5-46bb-4d65-977f-753f29e4c8aa tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:39:26.818806 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-d19bb5e5-46bb-4d65-977f-753f29e4c8aa tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:39:27.177344 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.policy [None req-d19bb5e5-46bb-4d65-977f-753f29e4c8aa tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0431b1f25497443ba483b3c440669080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e36ab03283d4ce6a2fed5e111e03d34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129321) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:39:27.195072 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: INFO nova.api.openstack.requestlog [None req-d19bb5e5-46bb-4d65-977f-753f29e4c8aa tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] 10.222.0.75 "GET /compute/v2.1/servers/605b9171-aa87-432a-b179-c552640e73dd" status: 200 len: 1522 microversion: 2.1 time: 0.406524 May 26 12:39:27.196860 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: [pid: 129321|app: 0|req: 98/203] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 26 12:39:26 2022] GET /compute/v2.1/servers/605b9171-aa87-432a-b179-c552640e73dd => generated 1522 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:39:28.217839 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi [None req-9b04b8b9-94dc-486c-8811-08ab5cdeffca tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Calling method '>' {{(pid=129322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:39:28.218466 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.compute.api [None req-9b04b8b9-94dc-486c-8811-08ab5cdeffca tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] [instance: 605b9171-aa87-432a-b179-c552640e73dd] Fetching instance by UUID {{(pid=129322) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:39:28.229682 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-9b04b8b9-94dc-486c-8811-08ab5cdeffca tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:39:28.230213 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-9b04b8b9-94dc-486c-8811-08ab5cdeffca tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:39:28.231776 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-9b04b8b9-94dc-486c-8811-08ab5cdeffca tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:39:28.234010 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-9b04b8b9-94dc-486c-8811-08ab5cdeffca tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:39:28.419574 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.policy [None req-9b04b8b9-94dc-486c-8811-08ab5cdeffca tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0431b1f25497443ba483b3c440669080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e36ab03283d4ce6a2fed5e111e03d34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129322) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:39:28.430156 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: INFO nova.api.openstack.requestlog [None req-9b04b8b9-94dc-486c-8811-08ab5cdeffca tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] 10.222.0.75 "GET /compute/v2.1/servers/605b9171-aa87-432a-b179-c552640e73dd" status: 200 len: 1522 microversion: 2.1 time: 0.218040 May 26 12:39:28.444142 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: [pid: 129322|app: 0|req: 106/204] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 26 12:39:28 2022] GET /compute/v2.1/servers/605b9171-aa87-432a-b179-c552640e73dd => generated 1522 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:39:29.447964 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi [None req-3da2ff2a-be28-49f7-a77f-291864e6a0e0 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Calling method '>' {{(pid=129321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:39:29.449262 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.compute.api [None req-3da2ff2a-be28-49f7-a77f-291864e6a0e0 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] [instance: 605b9171-aa87-432a-b179-c552640e73dd] Fetching instance by UUID {{(pid=129321) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:39:29.455599 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-3da2ff2a-be28-49f7-a77f-291864e6a0e0 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:39:29.456243 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-3da2ff2a-be28-49f7-a77f-291864e6a0e0 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:39:29.457196 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-3da2ff2a-be28-49f7-a77f-291864e6a0e0 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:39:29.457823 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-3da2ff2a-be28-49f7-a77f-291864e6a0e0 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:39:29.613796 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.policy [None req-3da2ff2a-be28-49f7-a77f-291864e6a0e0 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0431b1f25497443ba483b3c440669080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e36ab03283d4ce6a2fed5e111e03d34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129321) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:39:29.622193 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: INFO nova.api.openstack.requestlog [None req-3da2ff2a-be28-49f7-a77f-291864e6a0e0 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] 10.222.0.75 "GET /compute/v2.1/servers/605b9171-aa87-432a-b179-c552640e73dd" status: 200 len: 1522 microversion: 2.1 time: 0.179802 May 26 12:39:29.622779 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: [pid: 129321|app: 0|req: 99/205] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 26 12:39:29 2022] GET /compute/v2.1/servers/605b9171-aa87-432a-b179-c552640e73dd => generated 1522 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:39:30.640885 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi [None req-eba444d6-92f6-4ec6-9a12-424de937045f tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Calling method '>' {{(pid=129322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:39:30.642914 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.compute.api [None req-eba444d6-92f6-4ec6-9a12-424de937045f tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] [instance: 605b9171-aa87-432a-b179-c552640e73dd] Fetching instance by UUID {{(pid=129322) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:39:30.650766 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-eba444d6-92f6-4ec6-9a12-424de937045f tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:39:30.651282 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-eba444d6-92f6-4ec6-9a12-424de937045f tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:39:30.651999 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-eba444d6-92f6-4ec6-9a12-424de937045f tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:39:30.652722 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-eba444d6-92f6-4ec6-9a12-424de937045f tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:39:30.907171 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.policy [None req-eba444d6-92f6-4ec6-9a12-424de937045f tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0431b1f25497443ba483b3c440669080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e36ab03283d4ce6a2fed5e111e03d34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129322) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:39:30.917427 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: INFO nova.api.openstack.requestlog [None req-eba444d6-92f6-4ec6-9a12-424de937045f tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] 10.222.0.75 "GET /compute/v2.1/servers/605b9171-aa87-432a-b179-c552640e73dd" status: 200 len: 1522 microversion: 2.1 time: 0.281477 May 26 12:39:30.918035 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: [pid: 129322|app: 0|req: 107/206] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 26 12:39:30 2022] GET /compute/v2.1/servers/605b9171-aa87-432a-b179-c552640e73dd => generated 1522 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:39:31.934654 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi [None req-34b96a51-ea56-47d4-9e6e-16a6126ac45a tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Calling method '>' {{(pid=129321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:39:31.935212 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.compute.api [None req-34b96a51-ea56-47d4-9e6e-16a6126ac45a tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] [instance: 605b9171-aa87-432a-b179-c552640e73dd] Fetching instance by UUID {{(pid=129321) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:39:31.941517 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-34b96a51-ea56-47d4-9e6e-16a6126ac45a tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:39:31.941956 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-34b96a51-ea56-47d4-9e6e-16a6126ac45a tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:39:31.942694 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-34b96a51-ea56-47d4-9e6e-16a6126ac45a tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:39:31.943113 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-34b96a51-ea56-47d4-9e6e-16a6126ac45a tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:39:32.071676 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.policy [None req-34b96a51-ea56-47d4-9e6e-16a6126ac45a tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0431b1f25497443ba483b3c440669080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e36ab03283d4ce6a2fed5e111e03d34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129321) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:39:32.079666 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: INFO nova.api.openstack.requestlog [None req-34b96a51-ea56-47d4-9e6e-16a6126ac45a tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] 10.222.0.75 "GET /compute/v2.1/servers/605b9171-aa87-432a-b179-c552640e73dd" status: 200 len: 1522 microversion: 2.1 time: 0.149120 May 26 12:39:32.080182 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: [pid: 129321|app: 0|req: 100/207] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 26 12:39:31 2022] GET /compute/v2.1/servers/605b9171-aa87-432a-b179-c552640e73dd => generated 1522 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:39:33.096629 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi [None req-a9ed25a7-3ff7-4ab9-a684-047809733913 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Calling method '>' {{(pid=129322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:39:33.097349 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.compute.api [None req-a9ed25a7-3ff7-4ab9-a684-047809733913 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] [instance: 605b9171-aa87-432a-b179-c552640e73dd] Fetching instance by UUID {{(pid=129322) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:39:33.105472 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG dbcounter [-] [129322] Writing DB stats nova_api:SELECT=38 {{(pid=129322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:39:33.107813 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-a9ed25a7-3ff7-4ab9-a684-047809733913 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:39:33.108500 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-a9ed25a7-3ff7-4ab9-a684-047809733913 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:39:33.109688 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-a9ed25a7-3ff7-4ab9-a684-047809733913 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:39:33.110279 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-a9ed25a7-3ff7-4ab9-a684-047809733913 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:39:33.272774 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.policy [None req-a9ed25a7-3ff7-4ab9-a684-047809733913 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0431b1f25497443ba483b3c440669080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e36ab03283d4ce6a2fed5e111e03d34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129322) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:39:33.280955 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: INFO nova.api.openstack.requestlog [None req-a9ed25a7-3ff7-4ab9-a684-047809733913 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] 10.222.0.75 "GET /compute/v2.1/servers/605b9171-aa87-432a-b179-c552640e73dd" status: 200 len: 1522 microversion: 2.1 time: 0.188219 May 26 12:39:33.281716 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: [pid: 129322|app: 0|req: 108/208] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 26 12:39:33 2022] GET /compute/v2.1/servers/605b9171-aa87-432a-b179-c552640e73dd => generated 1522 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:39:33.710022 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi [None req-ac8a32b7-ab59-40c2-9379-c0868a6f3648 tempest-VolumesSnapshotTestJSON-1904508205 tempest-VolumesSnapshotTestJSON-1904508205-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1956355108", "imageRef": "1e3c323d-d797-4e6d-bd9a-482d90084b0c", "flavorRef": "452", "networks": [{"uuid": "302c6bf6-ca25-4af8-8c23-ffa0e49d26a6"}]}} {{(pid=129321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 12:39:33.716777 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG dbcounter [-] [129321] Writing DB stats nova_api:SELECT=45,nova_api:UPDATE=1 {{(pid=129321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:39:33.765407 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.network.neutron [None req-ac8a32b7-ab59-40c2-9379-c0868a6f3648 tempest-VolumesSnapshotTestJSON-1904508205 tempest-VolumesSnapshotTestJSON-1904508205-project] validate_networks() for [('302c6bf6-ca25-4af8-8c23-ffa0e49d26a6', None, None, None, None, None)] {{(pid=129321) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 26 12:39:34.114177 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.virt.hardware [None req-ac8a32b7-ab59-40c2-9379-c0868a6f3648 tempest-VolumesSnapshotTestJSON-1904508205 tempest-VolumesSnapshotTestJSON-1904508205-project] Flavor limits 0:0:0 {{(pid=129321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 26 12:39:34.114602 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.virt.hardware [None req-ac8a32b7-ab59-40c2-9379-c0868a6f3648 tempest-VolumesSnapshotTestJSON-1904508205 tempest-VolumesSnapshotTestJSON-1904508205-project] Image limits 0:0:0 {{(pid=129321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 26 12:39:34.115087 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.virt.hardware [None req-ac8a32b7-ab59-40c2-9379-c0868a6f3648 tempest-VolumesSnapshotTestJSON-1904508205 tempest-VolumesSnapshotTestJSON-1904508205-project] Flavor pref 0:0:0 {{(pid=129321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 26 12:39:34.115490 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.virt.hardware [None req-ac8a32b7-ab59-40c2-9379-c0868a6f3648 tempest-VolumesSnapshotTestJSON-1904508205 tempest-VolumesSnapshotTestJSON-1904508205-project] Image pref 0:0:0 {{(pid=129321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 26 12:39:34.115925 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.virt.hardware [None req-ac8a32b7-ab59-40c2-9379-c0868a6f3648 tempest-VolumesSnapshotTestJSON-1904508205 tempest-VolumesSnapshotTestJSON-1904508205-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 26 12:39:34.125623 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-ac8a32b7-ab59-40c2-9379-c0868a6f3648 tempest-VolumesSnapshotTestJSON-1904508205 tempest-VolumesSnapshotTestJSON-1904508205-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:39:34.126148 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-ac8a32b7-ab59-40c2-9379-c0868a6f3648 tempest-VolumesSnapshotTestJSON-1904508205 tempest-VolumesSnapshotTestJSON-1904508205-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:39:34.127100 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-ac8a32b7-ab59-40c2-9379-c0868a6f3648 tempest-VolumesSnapshotTestJSON-1904508205 tempest-VolumesSnapshotTestJSON-1904508205-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:39:34.127595 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-ac8a32b7-ab59-40c2-9379-c0868a6f3648 tempest-VolumesSnapshotTestJSON-1904508205 tempest-VolumesSnapshotTestJSON-1904508205-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:39:34.146609 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.quota [None req-ac8a32b7-ab59-40c2-9379-c0868a6f3648 tempest-VolumesSnapshotTestJSON-1904508205 tempest-VolumesSnapshotTestJSON-1904508205-project] Getting quotas for project 72bda4cbb07a43688506e01d06ba89c2. Resources: {'instances', 'cores', 'ram'} {{(pid=129321) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 26 12:39:34.151055 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.quota [None req-ac8a32b7-ab59-40c2-9379-c0868a6f3648 tempest-VolumesSnapshotTestJSON-1904508205 tempest-VolumesSnapshotTestJSON-1904508205-project] Getting quotas for user 805854e5ce2e412fb9420afd63f73ee6 and project 72bda4cbb07a43688506e01d06ba89c2. Resources: {'instances', 'cores', 'ram'} {{(pid=129321) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 26 12:39:34.162352 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.compute.api [None req-ac8a32b7-ab59-40c2-9379-c0868a6f3648 tempest-VolumesSnapshotTestJSON-1904508205 tempest-VolumesSnapshotTestJSON-1904508205-project] Going to run 1 instances... {{(pid=129321) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 26 12:39:34.164802 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.compute.api [None req-ac8a32b7-ab59-40c2-9379-c0868a6f3648 tempest-VolumesSnapshotTestJSON-1904508205 tempest-VolumesSnapshotTestJSON-1904508205-project] [instance: f392ba2b-2b88-4b1a-be61-0cf28ed1443a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1e3c323d-d797-4e6d-bd9a-482d90084b0c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129321) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 26 12:39:34.216396 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: INFO nova.api.openstack.requestlog [None req-ac8a32b7-ab59-40c2-9379-c0868a6f3648 tempest-VolumesSnapshotTestJSON-1904508205 tempest-VolumesSnapshotTestJSON-1904508205-project] 10.222.0.75 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.510153 May 26 12:39:34.217024 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: [pid: 129321|app: 0|req: 101/209] 10.222.0.75 () {60 vars in 1146 bytes} [Thu May 26 12:39:33 2022] POST /compute/v2.1/servers => generated 380 bytes in 512 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 26 12:39:34.227336 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi [None req-cbf8a058-97c0-42db-bb74-d1418f2eeeba tempest-VolumesSnapshotTestJSON-1904508205 tempest-VolumesSnapshotTestJSON-1904508205-project] Calling method '>' {{(pid=129322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:39:34.228237 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.compute.api [None req-cbf8a058-97c0-42db-bb74-d1418f2eeeba tempest-VolumesSnapshotTestJSON-1904508205 tempest-VolumesSnapshotTestJSON-1904508205-project] [instance: f392ba2b-2b88-4b1a-be61-0cf28ed1443a] Fetching instance by UUID {{(pid=129322) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:39:34.285518 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.policy [None req-cbf8a058-97c0-42db-bb74-d1418f2eeeba tempest-VolumesSnapshotTestJSON-1904508205 tempest-VolumesSnapshotTestJSON-1904508205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '805854e5ce2e412fb9420afd63f73ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72bda4cbb07a43688506e01d06ba89c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129322) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:39:34.295030 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: INFO nova.api.openstack.requestlog [None req-cbf8a058-97c0-42db-bb74-d1418f2eeeba tempest-VolumesSnapshotTestJSON-1904508205 tempest-VolumesSnapshotTestJSON-1904508205-project] 10.222.0.75 "GET /compute/v2.1/servers/f392ba2b-2b88-4b1a-be61-0cf28ed1443a" status: 200 len: 1219 microversion: 2.1 time: 0.071730 May 26 12:39:34.296405 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: [pid: 129322|app: 0|req: 109/210] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 26 12:39:34 2022] GET /compute/v2.1/servers/f392ba2b-2b88-4b1a-be61-0cf28ed1443a => generated 1219 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:39:34.298894 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi [None req-be972563-8076-4c04-9703-8a4f68fac4d1 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Calling method '>' {{(pid=129321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:39:34.300494 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.compute.api [None req-be972563-8076-4c04-9703-8a4f68fac4d1 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] [instance: 605b9171-aa87-432a-b179-c552640e73dd] Fetching instance by UUID {{(pid=129321) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:39:34.309774 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-be972563-8076-4c04-9703-8a4f68fac4d1 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:39:34.310352 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-be972563-8076-4c04-9703-8a4f68fac4d1 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:39:34.311190 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-be972563-8076-4c04-9703-8a4f68fac4d1 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:39:34.311678 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-be972563-8076-4c04-9703-8a4f68fac4d1 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:39:34.452244 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.policy [None req-be972563-8076-4c04-9703-8a4f68fac4d1 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0431b1f25497443ba483b3c440669080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e36ab03283d4ce6a2fed5e111e03d34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129321) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:39:34.460247 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: INFO nova.api.openstack.requestlog [None req-be972563-8076-4c04-9703-8a4f68fac4d1 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] 10.222.0.75 "GET /compute/v2.1/servers/605b9171-aa87-432a-b179-c552640e73dd" status: 200 len: 1522 microversion: 2.1 time: 0.166455 May 26 12:39:34.460820 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: [pid: 129321|app: 0|req: 102/211] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 26 12:39:34 2022] GET /compute/v2.1/servers/605b9171-aa87-432a-b179-c552640e73dd => generated 1522 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:39:35.313583 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi [None req-16412965-0ee6-410b-9124-905ea8f9155c tempest-VolumesSnapshotTestJSON-1904508205 tempest-VolumesSnapshotTestJSON-1904508205-project] Calling method '>' {{(pid=129322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:39:35.314444 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.compute.api [None req-16412965-0ee6-410b-9124-905ea8f9155c tempest-VolumesSnapshotTestJSON-1904508205 tempest-VolumesSnapshotTestJSON-1904508205-project] [instance: f392ba2b-2b88-4b1a-be61-0cf28ed1443a] Fetching instance by UUID {{(pid=129322) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:39:35.322617 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-16412965-0ee6-410b-9124-905ea8f9155c tempest-VolumesSnapshotTestJSON-1904508205 tempest-VolumesSnapshotTestJSON-1904508205-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:39:35.323312 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-16412965-0ee6-410b-9124-905ea8f9155c tempest-VolumesSnapshotTestJSON-1904508205 tempest-VolumesSnapshotTestJSON-1904508205-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:39:35.324167 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-16412965-0ee6-410b-9124-905ea8f9155c tempest-VolumesSnapshotTestJSON-1904508205 tempest-VolumesSnapshotTestJSON-1904508205-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:39:35.324710 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-16412965-0ee6-410b-9124-905ea8f9155c tempest-VolumesSnapshotTestJSON-1904508205 tempest-VolumesSnapshotTestJSON-1904508205-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:39:35.398547 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.policy [None req-16412965-0ee6-410b-9124-905ea8f9155c tempest-VolumesSnapshotTestJSON-1904508205 tempest-VolumesSnapshotTestJSON-1904508205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '805854e5ce2e412fb9420afd63f73ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72bda4cbb07a43688506e01d06ba89c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129322) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:39:35.407308 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: INFO nova.api.openstack.requestlog [None req-16412965-0ee6-410b-9124-905ea8f9155c tempest-VolumesSnapshotTestJSON-1904508205 tempest-VolumesSnapshotTestJSON-1904508205-project] 10.222.0.75 "GET /compute/v2.1/servers/f392ba2b-2b88-4b1a-be61-0cf28ed1443a" status: 200 len: 1279 microversion: 2.1 time: 0.098119 May 26 12:39:35.408262 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: [pid: 129322|app: 0|req: 110/212] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 26 12:39:35 2022] GET /compute/v2.1/servers/f392ba2b-2b88-4b1a-be61-0cf28ed1443a => generated 1279 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:39:35.478185 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi [None req-0300a622-5892-458a-9606-52c35deefd84 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Calling method '>' {{(pid=129321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:39:35.479223 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.compute.api [None req-0300a622-5892-458a-9606-52c35deefd84 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] [instance: 605b9171-aa87-432a-b179-c552640e73dd] Fetching instance by UUID {{(pid=129321) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:39:35.485633 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-0300a622-5892-458a-9606-52c35deefd84 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:39:35.486072 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-0300a622-5892-458a-9606-52c35deefd84 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:39:35.486821 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-0300a622-5892-458a-9606-52c35deefd84 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:39:35.487242 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-0300a622-5892-458a-9606-52c35deefd84 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:39:35.691769 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.policy [None req-0300a622-5892-458a-9606-52c35deefd84 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0431b1f25497443ba483b3c440669080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e36ab03283d4ce6a2fed5e111e03d34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129321) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:39:35.700281 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: INFO nova.api.openstack.requestlog [None req-0300a622-5892-458a-9606-52c35deefd84 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] 10.222.0.75 "GET /compute/v2.1/servers/605b9171-aa87-432a-b179-c552640e73dd" status: 200 len: 1522 microversion: 2.1 time: 0.226477 May 26 12:39:35.701192 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: [pid: 129321|app: 0|req: 103/213] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 26 12:39:35 2022] GET /compute/v2.1/servers/605b9171-aa87-432a-b179-c552640e73dd => generated 1522 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:39:36.425670 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi [None req-9fb87419-eedf-4702-b251-6812f5a81724 tempest-VolumesSnapshotTestJSON-1904508205 tempest-VolumesSnapshotTestJSON-1904508205-project] Calling method '>' {{(pid=129322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:39:36.426352 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.compute.api [None req-9fb87419-eedf-4702-b251-6812f5a81724 tempest-VolumesSnapshotTestJSON-1904508205 tempest-VolumesSnapshotTestJSON-1904508205-project] [instance: f392ba2b-2b88-4b1a-be61-0cf28ed1443a] Fetching instance by UUID {{(pid=129322) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:39:36.433621 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-9fb87419-eedf-4702-b251-6812f5a81724 tempest-VolumesSnapshotTestJSON-1904508205 tempest-VolumesSnapshotTestJSON-1904508205-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:39:36.434076 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-9fb87419-eedf-4702-b251-6812f5a81724 tempest-VolumesSnapshotTestJSON-1904508205 tempest-VolumesSnapshotTestJSON-1904508205-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:39:36.434857 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-9fb87419-eedf-4702-b251-6812f5a81724 tempest-VolumesSnapshotTestJSON-1904508205 tempest-VolumesSnapshotTestJSON-1904508205-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:39:36.435280 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-9fb87419-eedf-4702-b251-6812f5a81724 tempest-VolumesSnapshotTestJSON-1904508205 tempest-VolumesSnapshotTestJSON-1904508205-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:39:36.576980 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.policy [None req-9fb87419-eedf-4702-b251-6812f5a81724 tempest-VolumesSnapshotTestJSON-1904508205 tempest-VolumesSnapshotTestJSON-1904508205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '805854e5ce2e412fb9420afd63f73ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72bda4cbb07a43688506e01d06ba89c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129322) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:39:36.585206 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: INFO nova.api.openstack.requestlog [None req-9fb87419-eedf-4702-b251-6812f5a81724 tempest-VolumesSnapshotTestJSON-1904508205 tempest-VolumesSnapshotTestJSON-1904508205-project] 10.222.0.75 "GET /compute/v2.1/servers/f392ba2b-2b88-4b1a-be61-0cf28ed1443a" status: 200 len: 1319 microversion: 2.1 time: 0.164150 May 26 12:39:36.585986 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: [pid: 129322|app: 0|req: 111/214] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 26 12:39:36 2022] GET /compute/v2.1/servers/f392ba2b-2b88-4b1a-be61-0cf28ed1443a => generated 1319 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:39:36.718259 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi [None req-6dc2fe21-4393-4d46-94bc-1beaf5662c04 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Calling method '>' {{(pid=129321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:39:36.718850 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.compute.api [None req-6dc2fe21-4393-4d46-94bc-1beaf5662c04 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] [instance: 605b9171-aa87-432a-b179-c552640e73dd] Fetching instance by UUID {{(pid=129321) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:39:36.725347 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-6dc2fe21-4393-4d46-94bc-1beaf5662c04 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:39:36.725727 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-6dc2fe21-4393-4d46-94bc-1beaf5662c04 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:39:36.726478 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-6dc2fe21-4393-4d46-94bc-1beaf5662c04 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:39:36.726902 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-6dc2fe21-4393-4d46-94bc-1beaf5662c04 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:39:36.729920 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi [req-9a7ee4f5-65c4-4f5c-aefd-4bd943d00740 req-cf4b2cfd-d970-4216-8b8e-e7e914c439d2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f392ba2b-2b88-4b1a-be61-0cf28ed1443a", "tag": "10bca8e7-0bd1-4264-811e-ec4cb5f9c2bd"}]} {{(pid=129322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 12:39:36.749714 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [req-9a7ee4f5-65c4-4f5c-aefd-4bd943d00740 req-cf4b2cfd-d970-4216-8b8e-e7e914c439d2 service nova] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:39:36.750336 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [req-9a7ee4f5-65c4-4f5c-aefd-4bd943d00740 req-cf4b2cfd-d970-4216-8b8e-e7e914c439d2 service nova] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:39:36.765390 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: INFO nova.api.openstack.compute.server_external_events [req-9a7ee4f5-65c4-4f5c-aefd-4bd943d00740 req-cf4b2cfd-d970-4216-8b8e-e7e914c439d2 service nova] Creating event network-changed:10bca8e7-0bd1-4264-811e-ec4cb5f9c2bd for instance f392ba2b-2b88-4b1a-be61-0cf28ed1443a on hv-cinder-81966 May 26 12:39:36.776455 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: INFO nova.api.openstack.requestlog [req-9a7ee4f5-65c4-4f5c-aefd-4bd943d00740 req-cf4b2cfd-d970-4216-8b8e-e7e914c439d2 service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051873 May 26 12:39:36.777067 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: [pid: 129322|app: 0|req: 112/215] 10.222.0.75 () {64 vars in 1317 bytes} [Thu May 26 12:39:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 26 12:39:36.939443 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.policy [None req-6dc2fe21-4393-4d46-94bc-1beaf5662c04 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0431b1f25497443ba483b3c440669080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e36ab03283d4ce6a2fed5e111e03d34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129321) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:39:36.948310 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: INFO nova.api.openstack.requestlog [None req-6dc2fe21-4393-4d46-94bc-1beaf5662c04 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] 10.222.0.75 "GET /compute/v2.1/servers/605b9171-aa87-432a-b179-c552640e73dd" status: 200 len: 1522 microversion: 2.1 time: 0.234369 May 26 12:39:36.949347 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: [pid: 129321|app: 0|req: 104/216] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 26 12:39:36 2022] GET /compute/v2.1/servers/605b9171-aa87-432a-b179-c552640e73dd => generated 1522 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:39:37.604270 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi [None req-8e906b82-d440-4e8c-a344-e29fe72a9671 tempest-VolumesSnapshotTestJSON-1904508205 tempest-VolumesSnapshotTestJSON-1904508205-project] Calling method '>' {{(pid=129322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:39:37.604986 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.compute.api [None req-8e906b82-d440-4e8c-a344-e29fe72a9671 tempest-VolumesSnapshotTestJSON-1904508205 tempest-VolumesSnapshotTestJSON-1904508205-project] [instance: f392ba2b-2b88-4b1a-be61-0cf28ed1443a] Fetching instance by UUID {{(pid=129322) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:39:37.611241 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-8e906b82-d440-4e8c-a344-e29fe72a9671 tempest-VolumesSnapshotTestJSON-1904508205 tempest-VolumesSnapshotTestJSON-1904508205-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:39:37.611727 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-8e906b82-d440-4e8c-a344-e29fe72a9671 tempest-VolumesSnapshotTestJSON-1904508205 tempest-VolumesSnapshotTestJSON-1904508205-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:39:37.612631 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-8e906b82-d440-4e8c-a344-e29fe72a9671 tempest-VolumesSnapshotTestJSON-1904508205 tempest-VolumesSnapshotTestJSON-1904508205-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:39:37.613064 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-8e906b82-d440-4e8c-a344-e29fe72a9671 tempest-VolumesSnapshotTestJSON-1904508205 tempest-VolumesSnapshotTestJSON-1904508205-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:39:37.747889 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.policy [None req-8e906b82-d440-4e8c-a344-e29fe72a9671 tempest-VolumesSnapshotTestJSON-1904508205 tempest-VolumesSnapshotTestJSON-1904508205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '805854e5ce2e412fb9420afd63f73ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72bda4cbb07a43688506e01d06ba89c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129322) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:39:37.760395 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: INFO nova.api.openstack.requestlog [None req-8e906b82-d440-4e8c-a344-e29fe72a9671 tempest-VolumesSnapshotTestJSON-1904508205 tempest-VolumesSnapshotTestJSON-1904508205-project] 10.222.0.75 "GET /compute/v2.1/servers/f392ba2b-2b88-4b1a-be61-0cf28ed1443a" status: 200 len: 1319 microversion: 2.1 time: 0.161266 May 26 12:39:37.760968 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: [pid: 129322|app: 0|req: 113/217] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 26 12:39:37 2022] GET /compute/v2.1/servers/f392ba2b-2b88-4b1a-be61-0cf28ed1443a => generated 1319 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:39:37.966398 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi [None req-6fa65ca8-40da-4ce6-a62d-ba4f6178cf3f tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Calling method '>' {{(pid=129321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:39:37.967106 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.compute.api [None req-6fa65ca8-40da-4ce6-a62d-ba4f6178cf3f tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] [instance: 605b9171-aa87-432a-b179-c552640e73dd] Fetching instance by UUID {{(pid=129321) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:39:37.973603 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-6fa65ca8-40da-4ce6-a62d-ba4f6178cf3f tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:39:37.974048 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-6fa65ca8-40da-4ce6-a62d-ba4f6178cf3f tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:39:37.974805 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-6fa65ca8-40da-4ce6-a62d-ba4f6178cf3f tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:39:37.975212 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-6fa65ca8-40da-4ce6-a62d-ba4f6178cf3f tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:39:38.111513 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.policy [None req-6fa65ca8-40da-4ce6-a62d-ba4f6178cf3f tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0431b1f25497443ba483b3c440669080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e36ab03283d4ce6a2fed5e111e03d34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129321) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:39:38.120928 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: INFO nova.api.openstack.requestlog [None req-6fa65ca8-40da-4ce6-a62d-ba4f6178cf3f tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] 10.222.0.75 "GET /compute/v2.1/servers/605b9171-aa87-432a-b179-c552640e73dd" status: 200 len: 1522 microversion: 2.1 time: 0.158592 May 26 12:39:38.121498 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: [pid: 129321|app: 0|req: 105/218] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 26 12:39:37 2022] GET /compute/v2.1/servers/605b9171-aa87-432a-b179-c552640e73dd => generated 1522 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:39:38.794415 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi [None req-f96d29d8-96fb-41b1-b1cb-a254deff8580 tempest-VolumesSnapshotTestJSON-1904508205 tempest-VolumesSnapshotTestJSON-1904508205-project] Calling method '>' {{(pid=129322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:39:38.795479 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.compute.api [None req-f96d29d8-96fb-41b1-b1cb-a254deff8580 tempest-VolumesSnapshotTestJSON-1904508205 tempest-VolumesSnapshotTestJSON-1904508205-project] [instance: f392ba2b-2b88-4b1a-be61-0cf28ed1443a] Fetching instance by UUID {{(pid=129322) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:39:38.805712 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-f96d29d8-96fb-41b1-b1cb-a254deff8580 tempest-VolumesSnapshotTestJSON-1904508205 tempest-VolumesSnapshotTestJSON-1904508205-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:39:38.808443 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-f96d29d8-96fb-41b1-b1cb-a254deff8580 tempest-VolumesSnapshotTestJSON-1904508205 tempest-VolumesSnapshotTestJSON-1904508205-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:39:38.811629 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-f96d29d8-96fb-41b1-b1cb-a254deff8580 tempest-VolumesSnapshotTestJSON-1904508205 tempest-VolumesSnapshotTestJSON-1904508205-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:39:38.812615 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-f96d29d8-96fb-41b1-b1cb-a254deff8580 tempest-VolumesSnapshotTestJSON-1904508205 tempest-VolumesSnapshotTestJSON-1904508205-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:39:39.002639 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.policy [None req-f96d29d8-96fb-41b1-b1cb-a254deff8580 tempest-VolumesSnapshotTestJSON-1904508205 tempest-VolumesSnapshotTestJSON-1904508205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '805854e5ce2e412fb9420afd63f73ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72bda4cbb07a43688506e01d06ba89c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129322) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:39:39.010759 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: INFO nova.api.openstack.requestlog [None req-f96d29d8-96fb-41b1-b1cb-a254deff8580 tempest-VolumesSnapshotTestJSON-1904508205 tempest-VolumesSnapshotTestJSON-1904508205-project] 10.222.0.75 "GET /compute/v2.1/servers/f392ba2b-2b88-4b1a-be61-0cf28ed1443a" status: 200 len: 1319 microversion: 2.1 time: 0.233006 May 26 12:39:39.011588 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: [pid: 129322|app: 0|req: 114/219] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 26 12:39:38 2022] GET /compute/v2.1/servers/f392ba2b-2b88-4b1a-be61-0cf28ed1443a => generated 1319 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:39:39.138084 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi [None req-a9b21539-0e98-407b-8c2b-63a9bac3b3ca tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Calling method '>' {{(pid=129321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:39:39.138744 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.compute.api [None req-a9b21539-0e98-407b-8c2b-63a9bac3b3ca tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] [instance: 605b9171-aa87-432a-b179-c552640e73dd] Fetching instance by UUID {{(pid=129321) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:39:39.145836 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-a9b21539-0e98-407b-8c2b-63a9bac3b3ca tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:39:39.146651 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-a9b21539-0e98-407b-8c2b-63a9bac3b3ca tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:39:39.147416 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-a9b21539-0e98-407b-8c2b-63a9bac3b3ca tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:39:39.147877 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-a9b21539-0e98-407b-8c2b-63a9bac3b3ca tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:39:39.336074 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.policy [None req-a9b21539-0e98-407b-8c2b-63a9bac3b3ca tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0431b1f25497443ba483b3c440669080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e36ab03283d4ce6a2fed5e111e03d34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129321) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:39:39.344653 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: INFO nova.api.openstack.requestlog [None req-a9b21539-0e98-407b-8c2b-63a9bac3b3ca tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] 10.222.0.75 "GET /compute/v2.1/servers/605b9171-aa87-432a-b179-c552640e73dd" status: 200 len: 1522 microversion: 2.1 time: 0.210818 May 26 12:39:39.345418 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: [pid: 129321|app: 0|req: 106/220] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 26 12:39:39 2022] GET /compute/v2.1/servers/605b9171-aa87-432a-b179-c552640e73dd => generated 1522 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:39:40.029186 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi [None req-8db879b8-e858-4d75-af42-94f4a5886673 tempest-VolumesSnapshotTestJSON-1904508205 tempest-VolumesSnapshotTestJSON-1904508205-project] Calling method '>' {{(pid=129322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:39:40.029795 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.compute.api [None req-8db879b8-e858-4d75-af42-94f4a5886673 tempest-VolumesSnapshotTestJSON-1904508205 tempest-VolumesSnapshotTestJSON-1904508205-project] [instance: f392ba2b-2b88-4b1a-be61-0cf28ed1443a] Fetching instance by UUID {{(pid=129322) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:39:40.038488 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-8db879b8-e858-4d75-af42-94f4a5886673 tempest-VolumesSnapshotTestJSON-1904508205 tempest-VolumesSnapshotTestJSON-1904508205-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:39:40.039096 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-8db879b8-e858-4d75-af42-94f4a5886673 tempest-VolumesSnapshotTestJSON-1904508205 tempest-VolumesSnapshotTestJSON-1904508205-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:39:40.040027 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-8db879b8-e858-4d75-af42-94f4a5886673 tempest-VolumesSnapshotTestJSON-1904508205 tempest-VolumesSnapshotTestJSON-1904508205-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:39:40.040845 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-8db879b8-e858-4d75-af42-94f4a5886673 tempest-VolumesSnapshotTestJSON-1904508205 tempest-VolumesSnapshotTestJSON-1904508205-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:39:40.198444 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.policy [None req-8db879b8-e858-4d75-af42-94f4a5886673 tempest-VolumesSnapshotTestJSON-1904508205 tempest-VolumesSnapshotTestJSON-1904508205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '805854e5ce2e412fb9420afd63f73ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72bda4cbb07a43688506e01d06ba89c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129322) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:39:40.206865 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: INFO nova.api.openstack.requestlog [None req-8db879b8-e858-4d75-af42-94f4a5886673 tempest-VolumesSnapshotTestJSON-1904508205 tempest-VolumesSnapshotTestJSON-1904508205-project] 10.222.0.75 "GET /compute/v2.1/servers/f392ba2b-2b88-4b1a-be61-0cf28ed1443a" status: 200 len: 1319 microversion: 2.1 time: 0.182239 May 26 12:39:40.207573 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: [pid: 129322|app: 0|req: 115/221] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 26 12:39:40 2022] GET /compute/v2.1/servers/f392ba2b-2b88-4b1a-be61-0cf28ed1443a => generated 1319 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:39:40.362843 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi [None req-8c83c9d2-8cd2-42d6-ba54-ed427e168d54 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Calling method '>' {{(pid=129321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:39:40.364463 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.compute.api [None req-8c83c9d2-8cd2-42d6-ba54-ed427e168d54 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] [instance: 605b9171-aa87-432a-b179-c552640e73dd] Fetching instance by UUID {{(pid=129321) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:39:40.370769 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-8c83c9d2-8cd2-42d6-ba54-ed427e168d54 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:39:40.371215 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-8c83c9d2-8cd2-42d6-ba54-ed427e168d54 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:39:40.372087 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-8c83c9d2-8cd2-42d6-ba54-ed427e168d54 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:39:40.372538 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-8c83c9d2-8cd2-42d6-ba54-ed427e168d54 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:39:40.520006 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.policy [None req-8c83c9d2-8cd2-42d6-ba54-ed427e168d54 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0431b1f25497443ba483b3c440669080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e36ab03283d4ce6a2fed5e111e03d34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129321) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:39:40.529578 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: INFO nova.api.openstack.requestlog [None req-8c83c9d2-8cd2-42d6-ba54-ed427e168d54 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] 10.222.0.75 "GET /compute/v2.1/servers/605b9171-aa87-432a-b179-c552640e73dd" status: 200 len: 1522 microversion: 2.1 time: 0.171326 May 26 12:39:40.530157 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: [pid: 129321|app: 0|req: 107/222] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 26 12:39:40 2022] GET /compute/v2.1/servers/605b9171-aa87-432a-b179-c552640e73dd => generated 1522 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:39:41.224052 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi [None req-d0a7c43b-4ba6-4968-932d-d8240b2ff40a tempest-VolumesSnapshotTestJSON-1904508205 tempest-VolumesSnapshotTestJSON-1904508205-project] Calling method '>' {{(pid=129322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:39:41.224650 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.compute.api [None req-d0a7c43b-4ba6-4968-932d-d8240b2ff40a tempest-VolumesSnapshotTestJSON-1904508205 tempest-VolumesSnapshotTestJSON-1904508205-project] [instance: f392ba2b-2b88-4b1a-be61-0cf28ed1443a] Fetching instance by UUID {{(pid=129322) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:39:41.231920 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-d0a7c43b-4ba6-4968-932d-d8240b2ff40a tempest-VolumesSnapshotTestJSON-1904508205 tempest-VolumesSnapshotTestJSON-1904508205-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:39:41.232362 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-d0a7c43b-4ba6-4968-932d-d8240b2ff40a tempest-VolumesSnapshotTestJSON-1904508205 tempest-VolumesSnapshotTestJSON-1904508205-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:39:41.233303 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-d0a7c43b-4ba6-4968-932d-d8240b2ff40a tempest-VolumesSnapshotTestJSON-1904508205 tempest-VolumesSnapshotTestJSON-1904508205-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:39:41.233727 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-d0a7c43b-4ba6-4968-932d-d8240b2ff40a tempest-VolumesSnapshotTestJSON-1904508205 tempest-VolumesSnapshotTestJSON-1904508205-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:39:41.364725 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.policy [None req-d0a7c43b-4ba6-4968-932d-d8240b2ff40a tempest-VolumesSnapshotTestJSON-1904508205 tempest-VolumesSnapshotTestJSON-1904508205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '805854e5ce2e412fb9420afd63f73ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72bda4cbb07a43688506e01d06ba89c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129322) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:39:41.375198 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: INFO nova.api.openstack.requestlog [None req-d0a7c43b-4ba6-4968-932d-d8240b2ff40a tempest-VolumesSnapshotTestJSON-1904508205 tempest-VolumesSnapshotTestJSON-1904508205-project] 10.222.0.75 "GET /compute/v2.1/servers/f392ba2b-2b88-4b1a-be61-0cf28ed1443a" status: 200 len: 1319 microversion: 2.1 time: 0.154856 May 26 12:39:41.375890 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: [pid: 129322|app: 0|req: 116/223] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 26 12:39:41 2022] GET /compute/v2.1/servers/f392ba2b-2b88-4b1a-be61-0cf28ed1443a => generated 1319 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:39:41.546174 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi [None req-efe719b5-83f6-436d-b145-0f337013eceb tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Calling method '>' {{(pid=129321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:39:41.546878 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.compute.api [None req-efe719b5-83f6-436d-b145-0f337013eceb tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] [instance: 605b9171-aa87-432a-b179-c552640e73dd] Fetching instance by UUID {{(pid=129321) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:39:41.553411 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-efe719b5-83f6-436d-b145-0f337013eceb tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:39:41.553796 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-efe719b5-83f6-436d-b145-0f337013eceb tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:39:41.554582 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-efe719b5-83f6-436d-b145-0f337013eceb tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:39:41.554988 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-efe719b5-83f6-436d-b145-0f337013eceb tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:39:41.689066 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.policy [None req-efe719b5-83f6-436d-b145-0f337013eceb tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0431b1f25497443ba483b3c440669080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e36ab03283d4ce6a2fed5e111e03d34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129321) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:39:41.696546 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: INFO nova.api.openstack.requestlog [None req-efe719b5-83f6-436d-b145-0f337013eceb tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] 10.222.0.75 "GET /compute/v2.1/servers/605b9171-aa87-432a-b179-c552640e73dd" status: 200 len: 1522 microversion: 2.1 time: 0.154222 May 26 12:39:41.697118 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: [pid: 129321|app: 0|req: 108/224] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 26 12:39:41 2022] GET /compute/v2.1/servers/605b9171-aa87-432a-b179-c552640e73dd => generated 1522 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:39:42.396547 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi [None req-bdd4ea38-2391-42a9-bfa5-64f2a75e0be8 tempest-VolumesSnapshotTestJSON-1904508205 tempest-VolumesSnapshotTestJSON-1904508205-project] Calling method '>' {{(pid=129322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:39:42.397407 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.compute.api [None req-bdd4ea38-2391-42a9-bfa5-64f2a75e0be8 tempest-VolumesSnapshotTestJSON-1904508205 tempest-VolumesSnapshotTestJSON-1904508205-project] [instance: f392ba2b-2b88-4b1a-be61-0cf28ed1443a] Fetching instance by UUID {{(pid=129322) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:39:42.408399 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-bdd4ea38-2391-42a9-bfa5-64f2a75e0be8 tempest-VolumesSnapshotTestJSON-1904508205 tempest-VolumesSnapshotTestJSON-1904508205-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:39:42.409181 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-bdd4ea38-2391-42a9-bfa5-64f2a75e0be8 tempest-VolumesSnapshotTestJSON-1904508205 tempest-VolumesSnapshotTestJSON-1904508205-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:39:42.410415 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-bdd4ea38-2391-42a9-bfa5-64f2a75e0be8 tempest-VolumesSnapshotTestJSON-1904508205 tempest-VolumesSnapshotTestJSON-1904508205-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:39:42.411123 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-bdd4ea38-2391-42a9-bfa5-64f2a75e0be8 tempest-VolumesSnapshotTestJSON-1904508205 tempest-VolumesSnapshotTestJSON-1904508205-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:39:42.547990 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.policy [None req-bdd4ea38-2391-42a9-bfa5-64f2a75e0be8 tempest-VolumesSnapshotTestJSON-1904508205 tempest-VolumesSnapshotTestJSON-1904508205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '805854e5ce2e412fb9420afd63f73ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72bda4cbb07a43688506e01d06ba89c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129322) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:39:42.559991 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: INFO nova.api.openstack.requestlog [None req-bdd4ea38-2391-42a9-bfa5-64f2a75e0be8 tempest-VolumesSnapshotTestJSON-1904508205 tempest-VolumesSnapshotTestJSON-1904508205-project] 10.222.0.75 "GET /compute/v2.1/servers/f392ba2b-2b88-4b1a-be61-0cf28ed1443a" status: 200 len: 1319 microversion: 2.1 time: 0.169890 May 26 12:39:42.560719 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: [pid: 129322|app: 0|req: 117/225] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 26 12:39:42 2022] GET /compute/v2.1/servers/f392ba2b-2b88-4b1a-be61-0cf28ed1443a => generated 1319 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:39:42.718732 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi [None req-fea1bbb7-0767-432d-bf9f-54861bbcb6c2 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Calling method '>' {{(pid=129321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:39:42.719786 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.compute.api [None req-fea1bbb7-0767-432d-bf9f-54861bbcb6c2 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] [instance: 605b9171-aa87-432a-b179-c552640e73dd] Fetching instance by UUID {{(pid=129321) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:39:42.729610 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-fea1bbb7-0767-432d-bf9f-54861bbcb6c2 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:39:42.730055 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-fea1bbb7-0767-432d-bf9f-54861bbcb6c2 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:39:42.730816 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-fea1bbb7-0767-432d-bf9f-54861bbcb6c2 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:39:42.731244 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-fea1bbb7-0767-432d-bf9f-54861bbcb6c2 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:39:42.873486 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.policy [None req-fea1bbb7-0767-432d-bf9f-54861bbcb6c2 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0431b1f25497443ba483b3c440669080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e36ab03283d4ce6a2fed5e111e03d34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129321) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:39:42.885311 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: INFO nova.api.openstack.requestlog [None req-fea1bbb7-0767-432d-bf9f-54861bbcb6c2 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] 10.222.0.75 "GET /compute/v2.1/servers/605b9171-aa87-432a-b179-c552640e73dd" status: 200 len: 1522 microversion: 2.1 time: 0.174422 May 26 12:39:42.886182 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: [pid: 129321|app: 0|req: 109/226] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 26 12:39:42 2022] GET /compute/v2.1/servers/605b9171-aa87-432a-b179-c552640e73dd => generated 1522 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:39:43.585189 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi [None req-743ca508-34ab-498d-bf97-26abdf939602 tempest-VolumesSnapshotTestJSON-1904508205 tempest-VolumesSnapshotTestJSON-1904508205-project] Calling method '>' {{(pid=129322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:39:43.586020 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.compute.api [None req-743ca508-34ab-498d-bf97-26abdf939602 tempest-VolumesSnapshotTestJSON-1904508205 tempest-VolumesSnapshotTestJSON-1904508205-project] [instance: f392ba2b-2b88-4b1a-be61-0cf28ed1443a] Fetching instance by UUID {{(pid=129322) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:39:43.593431 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-743ca508-34ab-498d-bf97-26abdf939602 tempest-VolumesSnapshotTestJSON-1904508205 tempest-VolumesSnapshotTestJSON-1904508205-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:39:43.593873 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-743ca508-34ab-498d-bf97-26abdf939602 tempest-VolumesSnapshotTestJSON-1904508205 tempest-VolumesSnapshotTestJSON-1904508205-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:39:43.594622 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-743ca508-34ab-498d-bf97-26abdf939602 tempest-VolumesSnapshotTestJSON-1904508205 tempest-VolumesSnapshotTestJSON-1904508205-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:39:43.595045 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-743ca508-34ab-498d-bf97-26abdf939602 tempest-VolumesSnapshotTestJSON-1904508205 tempest-VolumesSnapshotTestJSON-1904508205-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:39:43.727522 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.policy [None req-743ca508-34ab-498d-bf97-26abdf939602 tempest-VolumesSnapshotTestJSON-1904508205 tempest-VolumesSnapshotTestJSON-1904508205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '805854e5ce2e412fb9420afd63f73ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72bda4cbb07a43688506e01d06ba89c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129322) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:39:43.735647 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: INFO nova.api.openstack.requestlog [None req-743ca508-34ab-498d-bf97-26abdf939602 tempest-VolumesSnapshotTestJSON-1904508205 tempest-VolumesSnapshotTestJSON-1904508205-project] 10.222.0.75 "GET /compute/v2.1/servers/f392ba2b-2b88-4b1a-be61-0cf28ed1443a" status: 200 len: 1319 microversion: 2.1 time: 0.157205 May 26 12:39:43.736219 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: [pid: 129322|app: 0|req: 118/227] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 26 12:39:43 2022] GET /compute/v2.1/servers/f392ba2b-2b88-4b1a-be61-0cf28ed1443a => generated 1319 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:39:43.907383 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi [None req-96292115-4df7-4c0b-aabc-25338f1cf9d6 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Calling method '>' {{(pid=129321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:39:43.908256 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.compute.api [None req-96292115-4df7-4c0b-aabc-25338f1cf9d6 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] [instance: 605b9171-aa87-432a-b179-c552640e73dd] Fetching instance by UUID {{(pid=129321) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:39:43.917508 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-96292115-4df7-4c0b-aabc-25338f1cf9d6 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:39:43.917951 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-96292115-4df7-4c0b-aabc-25338f1cf9d6 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:39:43.918707 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-96292115-4df7-4c0b-aabc-25338f1cf9d6 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:39:43.919138 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-96292115-4df7-4c0b-aabc-25338f1cf9d6 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:39:44.058036 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.policy [None req-96292115-4df7-4c0b-aabc-25338f1cf9d6 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0431b1f25497443ba483b3c440669080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e36ab03283d4ce6a2fed5e111e03d34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129321) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:39:44.060465 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG dbcounter [-] [129321] Writing DB stats nova_cell1:SELECT=100 {{(pid=129321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:39:44.065337 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: INFO nova.api.openstack.requestlog [None req-96292115-4df7-4c0b-aabc-25338f1cf9d6 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] 10.222.0.75 "GET /compute/v2.1/servers/605b9171-aa87-432a-b179-c552640e73dd" status: 200 len: 1522 microversion: 2.1 time: 0.164741 May 26 12:39:44.066076 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: [pid: 129321|app: 0|req: 110/228] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 26 12:39:43 2022] GET /compute/v2.1/servers/605b9171-aa87-432a-b179-c552640e73dd => generated 1522 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:39:44.757234 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi [None req-04c0fd8e-0920-435b-bce2-78d2051a5850 tempest-VolumesSnapshotTestJSON-1904508205 tempest-VolumesSnapshotTestJSON-1904508205-project] Calling method '>' {{(pid=129322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:39:44.758320 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.compute.api [None req-04c0fd8e-0920-435b-bce2-78d2051a5850 tempest-VolumesSnapshotTestJSON-1904508205 tempest-VolumesSnapshotTestJSON-1904508205-project] [instance: f392ba2b-2b88-4b1a-be61-0cf28ed1443a] Fetching instance by UUID {{(pid=129322) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:39:44.760832 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG dbcounter [-] [129322] Writing DB stats nova_cell0:SELECT=2 {{(pid=129322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:39:44.767103 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-04c0fd8e-0920-435b-bce2-78d2051a5850 tempest-VolumesSnapshotTestJSON-1904508205 tempest-VolumesSnapshotTestJSON-1904508205-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:39:44.767525 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-04c0fd8e-0920-435b-bce2-78d2051a5850 tempest-VolumesSnapshotTestJSON-1904508205 tempest-VolumesSnapshotTestJSON-1904508205-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:39:44.768320 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-04c0fd8e-0920-435b-bce2-78d2051a5850 tempest-VolumesSnapshotTestJSON-1904508205 tempest-VolumesSnapshotTestJSON-1904508205-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:39:44.768753 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-04c0fd8e-0920-435b-bce2-78d2051a5850 tempest-VolumesSnapshotTestJSON-1904508205 tempest-VolumesSnapshotTestJSON-1904508205-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:39:44.788328 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG dbcounter [-] [129322] Writing DB stats nova_cell1:SELECT=100 {{(pid=129322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:39:44.911167 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.policy [None req-04c0fd8e-0920-435b-bce2-78d2051a5850 tempest-VolumesSnapshotTestJSON-1904508205 tempest-VolumesSnapshotTestJSON-1904508205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '805854e5ce2e412fb9420afd63f73ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72bda4cbb07a43688506e01d06ba89c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129322) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:39:44.919428 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: INFO nova.api.openstack.requestlog [None req-04c0fd8e-0920-435b-bce2-78d2051a5850 tempest-VolumesSnapshotTestJSON-1904508205 tempest-VolumesSnapshotTestJSON-1904508205-project] 10.222.0.75 "GET /compute/v2.1/servers/f392ba2b-2b88-4b1a-be61-0cf28ed1443a" status: 200 len: 1319 microversion: 2.1 time: 0.168912 May 26 12:39:44.920152 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: [pid: 129322|app: 0|req: 119/229] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 26 12:39:44 2022] GET /compute/v2.1/servers/f392ba2b-2b88-4b1a-be61-0cf28ed1443a => generated 1319 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:39:45.087276 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi [None req-ec66681b-5304-4fc9-a551-2ad9c916f2d7 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Calling method '>' {{(pid=129321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:39:45.087970 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.compute.api [None req-ec66681b-5304-4fc9-a551-2ad9c916f2d7 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] [instance: 605b9171-aa87-432a-b179-c552640e73dd] Fetching instance by UUID {{(pid=129321) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:39:45.089830 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG dbcounter [-] [129321] Writing DB stats nova_cell0:SELECT=2 {{(pid=129321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:39:45.090476 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG dbcounter [-] [129321] Writing DB stats nova_cell0:SELECT=6 {{(pid=129321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:39:45.096512 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-ec66681b-5304-4fc9-a551-2ad9c916f2d7 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:39:45.096960 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-ec66681b-5304-4fc9-a551-2ad9c916f2d7 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:39:45.097725 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-ec66681b-5304-4fc9-a551-2ad9c916f2d7 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:39:45.098157 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-ec66681b-5304-4fc9-a551-2ad9c916f2d7 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:39:45.235486 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.policy [None req-ec66681b-5304-4fc9-a551-2ad9c916f2d7 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0431b1f25497443ba483b3c440669080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e36ab03283d4ce6a2fed5e111e03d34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129321) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:39:45.246036 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: INFO nova.api.openstack.requestlog [None req-ec66681b-5304-4fc9-a551-2ad9c916f2d7 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] 10.222.0.75 "GET /compute/v2.1/servers/605b9171-aa87-432a-b179-c552640e73dd" status: 200 len: 1522 microversion: 2.1 time: 0.166156 May 26 12:39:45.246609 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: [pid: 129321|app: 0|req: 111/230] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 26 12:39:45 2022] GET /compute/v2.1/servers/605b9171-aa87-432a-b179-c552640e73dd => generated 1522 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:39:45.938059 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi [None req-409b9148-dd0a-4e02-a617-a55c12c97927 tempest-VolumesSnapshotTestJSON-1904508205 tempest-VolumesSnapshotTestJSON-1904508205-project] Calling method '>' {{(pid=129322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:39:45.938578 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.compute.api [None req-409b9148-dd0a-4e02-a617-a55c12c97927 tempest-VolumesSnapshotTestJSON-1904508205 tempest-VolumesSnapshotTestJSON-1904508205-project] [instance: f392ba2b-2b88-4b1a-be61-0cf28ed1443a] Fetching instance by UUID {{(pid=129322) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:39:45.945493 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-409b9148-dd0a-4e02-a617-a55c12c97927 tempest-VolumesSnapshotTestJSON-1904508205 tempest-VolumesSnapshotTestJSON-1904508205-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:39:45.945940 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-409b9148-dd0a-4e02-a617-a55c12c97927 tempest-VolumesSnapshotTestJSON-1904508205 tempest-VolumesSnapshotTestJSON-1904508205-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:39:45.946695 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-409b9148-dd0a-4e02-a617-a55c12c97927 tempest-VolumesSnapshotTestJSON-1904508205 tempest-VolumesSnapshotTestJSON-1904508205-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:39:45.947153 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-409b9148-dd0a-4e02-a617-a55c12c97927 tempest-VolumesSnapshotTestJSON-1904508205 tempest-VolumesSnapshotTestJSON-1904508205-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:39:46.086822 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.policy [None req-409b9148-dd0a-4e02-a617-a55c12c97927 tempest-VolumesSnapshotTestJSON-1904508205 tempest-VolumesSnapshotTestJSON-1904508205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '805854e5ce2e412fb9420afd63f73ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72bda4cbb07a43688506e01d06ba89c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129322) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:39:46.095989 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: INFO nova.api.openstack.requestlog [None req-409b9148-dd0a-4e02-a617-a55c12c97927 tempest-VolumesSnapshotTestJSON-1904508205 tempest-VolumesSnapshotTestJSON-1904508205-project] 10.222.0.75 "GET /compute/v2.1/servers/f392ba2b-2b88-4b1a-be61-0cf28ed1443a" status: 200 len: 1319 microversion: 2.1 time: 0.161863 May 26 12:39:46.096837 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: [pid: 129322|app: 0|req: 120/231] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 26 12:39:45 2022] GET /compute/v2.1/servers/f392ba2b-2b88-4b1a-be61-0cf28ed1443a => generated 1319 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:39:46.262171 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi [None req-c38cbaed-ee2e-444d-bb32-04b80629c8d4 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Calling method '>' {{(pid=129321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:39:46.263052 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.compute.api [None req-c38cbaed-ee2e-444d-bb32-04b80629c8d4 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] [instance: 605b9171-aa87-432a-b179-c552640e73dd] Fetching instance by UUID {{(pid=129321) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:39:46.269510 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-c38cbaed-ee2e-444d-bb32-04b80629c8d4 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:39:46.270026 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-c38cbaed-ee2e-444d-bb32-04b80629c8d4 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:39:46.270863 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-c38cbaed-ee2e-444d-bb32-04b80629c8d4 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:39:46.271735 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-c38cbaed-ee2e-444d-bb32-04b80629c8d4 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:39:46.709040 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.policy [None req-c38cbaed-ee2e-444d-bb32-04b80629c8d4 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0431b1f25497443ba483b3c440669080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e36ab03283d4ce6a2fed5e111e03d34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129321) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:39:46.717177 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: INFO nova.api.openstack.requestlog [None req-c38cbaed-ee2e-444d-bb32-04b80629c8d4 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] 10.222.0.75 "GET /compute/v2.1/servers/605b9171-aa87-432a-b179-c552640e73dd" status: 200 len: 1522 microversion: 2.1 time: 0.458782 May 26 12:39:46.717684 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: [pid: 129321|app: 0|req: 112/232] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 26 12:39:46 2022] GET /compute/v2.1/servers/605b9171-aa87-432a-b179-c552640e73dd => generated 1522 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:39:47.113238 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi [None req-ead4af64-2968-4f96-bda2-63f6ac789752 tempest-VolumesSnapshotTestJSON-1904508205 tempest-VolumesSnapshotTestJSON-1904508205-project] Calling method '>' {{(pid=129322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:39:47.113803 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.compute.api [None req-ead4af64-2968-4f96-bda2-63f6ac789752 tempest-VolumesSnapshotTestJSON-1904508205 tempest-VolumesSnapshotTestJSON-1904508205-project] [instance: f392ba2b-2b88-4b1a-be61-0cf28ed1443a] Fetching instance by UUID {{(pid=129322) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:39:47.120550 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-ead4af64-2968-4f96-bda2-63f6ac789752 tempest-VolumesSnapshotTestJSON-1904508205 tempest-VolumesSnapshotTestJSON-1904508205-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:39:47.121032 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-ead4af64-2968-4f96-bda2-63f6ac789752 tempest-VolumesSnapshotTestJSON-1904508205 tempest-VolumesSnapshotTestJSON-1904508205-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:39:47.121772 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-ead4af64-2968-4f96-bda2-63f6ac789752 tempest-VolumesSnapshotTestJSON-1904508205 tempest-VolumesSnapshotTestJSON-1904508205-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:39:47.122347 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-ead4af64-2968-4f96-bda2-63f6ac789752 tempest-VolumesSnapshotTestJSON-1904508205 tempest-VolumesSnapshotTestJSON-1904508205-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:39:47.253763 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.policy [None req-ead4af64-2968-4f96-bda2-63f6ac789752 tempest-VolumesSnapshotTestJSON-1904508205 tempest-VolumesSnapshotTestJSON-1904508205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '805854e5ce2e412fb9420afd63f73ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72bda4cbb07a43688506e01d06ba89c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129322) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:39:47.264784 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: INFO nova.api.openstack.requestlog [None req-ead4af64-2968-4f96-bda2-63f6ac789752 tempest-VolumesSnapshotTestJSON-1904508205 tempest-VolumesSnapshotTestJSON-1904508205-project] 10.222.0.75 "GET /compute/v2.1/servers/f392ba2b-2b88-4b1a-be61-0cf28ed1443a" status: 200 len: 1319 microversion: 2.1 time: 0.155420 May 26 12:39:47.265359 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: [pid: 129322|app: 0|req: 121/233] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 26 12:39:47 2022] GET /compute/v2.1/servers/f392ba2b-2b88-4b1a-be61-0cf28ed1443a => generated 1319 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:39:47.734245 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi [None req-596d9a23-6c3a-4008-9a26-5e0c2ca2c2be tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Calling method '>' {{(pid=129321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:39:47.734871 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.compute.api [None req-596d9a23-6c3a-4008-9a26-5e0c2ca2c2be tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] [instance: 605b9171-aa87-432a-b179-c552640e73dd] Fetching instance by UUID {{(pid=129321) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:39:47.741315 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-596d9a23-6c3a-4008-9a26-5e0c2ca2c2be tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:39:47.741759 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-596d9a23-6c3a-4008-9a26-5e0c2ca2c2be tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:39:47.742510 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-596d9a23-6c3a-4008-9a26-5e0c2ca2c2be tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:39:47.742913 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-596d9a23-6c3a-4008-9a26-5e0c2ca2c2be tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:39:47.881068 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.policy [None req-596d9a23-6c3a-4008-9a26-5e0c2ca2c2be tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0431b1f25497443ba483b3c440669080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e36ab03283d4ce6a2fed5e111e03d34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129321) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:39:47.889085 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: INFO nova.api.openstack.requestlog [None req-596d9a23-6c3a-4008-9a26-5e0c2ca2c2be tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] 10.222.0.75 "GET /compute/v2.1/servers/605b9171-aa87-432a-b179-c552640e73dd" status: 200 len: 1522 microversion: 2.1 time: 0.158809 May 26 12:39:47.889648 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: [pid: 129321|app: 0|req: 113/234] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 26 12:39:47 2022] GET /compute/v2.1/servers/605b9171-aa87-432a-b179-c552640e73dd => generated 1522 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:39:48.286867 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi [None req-a2a69bad-08c2-4fd2-a013-bfc179a78c86 tempest-VolumesSnapshotTestJSON-1904508205 tempest-VolumesSnapshotTestJSON-1904508205-project] Calling method '>' {{(pid=129322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:39:48.287914 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.compute.api [None req-a2a69bad-08c2-4fd2-a013-bfc179a78c86 tempest-VolumesSnapshotTestJSON-1904508205 tempest-VolumesSnapshotTestJSON-1904508205-project] [instance: f392ba2b-2b88-4b1a-be61-0cf28ed1443a] Fetching instance by UUID {{(pid=129322) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:39:48.297252 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-a2a69bad-08c2-4fd2-a013-bfc179a78c86 tempest-VolumesSnapshotTestJSON-1904508205 tempest-VolumesSnapshotTestJSON-1904508205-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:39:48.297701 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-a2a69bad-08c2-4fd2-a013-bfc179a78c86 tempest-VolumesSnapshotTestJSON-1904508205 tempest-VolumesSnapshotTestJSON-1904508205-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:39:48.298451 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-a2a69bad-08c2-4fd2-a013-bfc179a78c86 tempest-VolumesSnapshotTestJSON-1904508205 tempest-VolumesSnapshotTestJSON-1904508205-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:39:48.298877 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-a2a69bad-08c2-4fd2-a013-bfc179a78c86 tempest-VolumesSnapshotTestJSON-1904508205 tempest-VolumesSnapshotTestJSON-1904508205-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:39:48.432070 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.policy [None req-a2a69bad-08c2-4fd2-a013-bfc179a78c86 tempest-VolumesSnapshotTestJSON-1904508205 tempest-VolumesSnapshotTestJSON-1904508205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '805854e5ce2e412fb9420afd63f73ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72bda4cbb07a43688506e01d06ba89c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129322) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:39:48.439712 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: INFO nova.api.openstack.requestlog [None req-a2a69bad-08c2-4fd2-a013-bfc179a78c86 tempest-VolumesSnapshotTestJSON-1904508205 tempest-VolumesSnapshotTestJSON-1904508205-project] 10.222.0.75 "GET /compute/v2.1/servers/f392ba2b-2b88-4b1a-be61-0cf28ed1443a" status: 200 len: 1319 microversion: 2.1 time: 0.159316 May 26 12:39:48.440293 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: [pid: 129322|app: 0|req: 122/235] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 26 12:39:48 2022] GET /compute/v2.1/servers/f392ba2b-2b88-4b1a-be61-0cf28ed1443a => generated 1319 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:39:48.908753 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi [None req-aab9dd08-f222-4335-8fb1-1c5b1a344041 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Calling method '>' {{(pid=129321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:39:48.909782 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.compute.api [None req-aab9dd08-f222-4335-8fb1-1c5b1a344041 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] [instance: 605b9171-aa87-432a-b179-c552640e73dd] Fetching instance by UUID {{(pid=129321) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:39:48.917519 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-aab9dd08-f222-4335-8fb1-1c5b1a344041 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:39:48.918236 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-aab9dd08-f222-4335-8fb1-1c5b1a344041 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:39:48.919405 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-aab9dd08-f222-4335-8fb1-1c5b1a344041 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:39:48.920036 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-aab9dd08-f222-4335-8fb1-1c5b1a344041 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:39:49.053812 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.policy [None req-aab9dd08-f222-4335-8fb1-1c5b1a344041 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0431b1f25497443ba483b3c440669080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e36ab03283d4ce6a2fed5e111e03d34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129321) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:39:49.061732 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: INFO nova.api.openstack.requestlog [None req-aab9dd08-f222-4335-8fb1-1c5b1a344041 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] 10.222.0.75 "GET /compute/v2.1/servers/605b9171-aa87-432a-b179-c552640e73dd" status: 200 len: 1522 microversion: 2.1 time: 0.158755 May 26 12:39:49.062266 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: [pid: 129321|app: 0|req: 114/236] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 26 12:39:48 2022] GET /compute/v2.1/servers/605b9171-aa87-432a-b179-c552640e73dd => generated 1522 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:39:49.463309 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi [None req-e703568f-85a4-4c9f-8679-3535ec7683a0 tempest-VolumesSnapshotTestJSON-1904508205 tempest-VolumesSnapshotTestJSON-1904508205-project] Calling method '>' {{(pid=129322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:39:49.464290 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.compute.api [None req-e703568f-85a4-4c9f-8679-3535ec7683a0 tempest-VolumesSnapshotTestJSON-1904508205 tempest-VolumesSnapshotTestJSON-1904508205-project] [instance: f392ba2b-2b88-4b1a-be61-0cf28ed1443a] Fetching instance by UUID {{(pid=129322) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:39:49.472667 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-e703568f-85a4-4c9f-8679-3535ec7683a0 tempest-VolumesSnapshotTestJSON-1904508205 tempest-VolumesSnapshotTestJSON-1904508205-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:39:49.473113 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-e703568f-85a4-4c9f-8679-3535ec7683a0 tempest-VolumesSnapshotTestJSON-1904508205 tempest-VolumesSnapshotTestJSON-1904508205-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:39:49.473870 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-e703568f-85a4-4c9f-8679-3535ec7683a0 tempest-VolumesSnapshotTestJSON-1904508205 tempest-VolumesSnapshotTestJSON-1904508205-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:39:49.474300 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-e703568f-85a4-4c9f-8679-3535ec7683a0 tempest-VolumesSnapshotTestJSON-1904508205 tempest-VolumesSnapshotTestJSON-1904508205-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:39:49.612031 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.policy [None req-e703568f-85a4-4c9f-8679-3535ec7683a0 tempest-VolumesSnapshotTestJSON-1904508205 tempest-VolumesSnapshotTestJSON-1904508205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '805854e5ce2e412fb9420afd63f73ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72bda4cbb07a43688506e01d06ba89c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129322) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:39:49.622233 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: INFO nova.api.openstack.requestlog [None req-e703568f-85a4-4c9f-8679-3535ec7683a0 tempest-VolumesSnapshotTestJSON-1904508205 tempest-VolumesSnapshotTestJSON-1904508205-project] 10.222.0.75 "GET /compute/v2.1/servers/f392ba2b-2b88-4b1a-be61-0cf28ed1443a" status: 200 len: 1319 microversion: 2.1 time: 0.165173 May 26 12:39:49.622991 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: [pid: 129322|app: 0|req: 123/237] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 26 12:39:49 2022] GET /compute/v2.1/servers/f392ba2b-2b88-4b1a-be61-0cf28ed1443a => generated 1319 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:39:50.082256 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi [None req-7d6a604f-9be9-4e42-adcd-b64e9636e4ad tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Calling method '>' {{(pid=129321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:39:50.083309 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.compute.api [None req-7d6a604f-9be9-4e42-adcd-b64e9636e4ad tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] [instance: 605b9171-aa87-432a-b179-c552640e73dd] Fetching instance by UUID {{(pid=129321) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:39:50.093602 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-7d6a604f-9be9-4e42-adcd-b64e9636e4ad tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:39:50.094417 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-7d6a604f-9be9-4e42-adcd-b64e9636e4ad tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:39:50.095265 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-7d6a604f-9be9-4e42-adcd-b64e9636e4ad tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:39:50.095724 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-7d6a604f-9be9-4e42-adcd-b64e9636e4ad tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:39:50.230979 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.policy [None req-7d6a604f-9be9-4e42-adcd-b64e9636e4ad tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0431b1f25497443ba483b3c440669080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e36ab03283d4ce6a2fed5e111e03d34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129321) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:39:50.238702 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: INFO nova.api.openstack.requestlog [None req-7d6a604f-9be9-4e42-adcd-b64e9636e4ad tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] 10.222.0.75 "GET /compute/v2.1/servers/605b9171-aa87-432a-b179-c552640e73dd" status: 200 len: 1522 microversion: 2.1 time: 0.162992 May 26 12:39:50.239244 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: [pid: 129321|app: 0|req: 115/238] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 26 12:39:50 2022] GET /compute/v2.1/servers/605b9171-aa87-432a-b179-c552640e73dd => generated 1522 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:39:50.643726 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi [None req-8cb2dae1-a0cc-4ba2-9737-fc13a5bdc8ee tempest-VolumesSnapshotTestJSON-1904508205 tempest-VolumesSnapshotTestJSON-1904508205-project] Calling method '>' {{(pid=129322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:39:50.644336 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.compute.api [None req-8cb2dae1-a0cc-4ba2-9737-fc13a5bdc8ee tempest-VolumesSnapshotTestJSON-1904508205 tempest-VolumesSnapshotTestJSON-1904508205-project] [instance: f392ba2b-2b88-4b1a-be61-0cf28ed1443a] Fetching instance by UUID {{(pid=129322) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:39:50.651729 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-8cb2dae1-a0cc-4ba2-9737-fc13a5bdc8ee tempest-VolumesSnapshotTestJSON-1904508205 tempest-VolumesSnapshotTestJSON-1904508205-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:39:50.652177 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-8cb2dae1-a0cc-4ba2-9737-fc13a5bdc8ee tempest-VolumesSnapshotTestJSON-1904508205 tempest-VolumesSnapshotTestJSON-1904508205-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:39:50.652950 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-8cb2dae1-a0cc-4ba2-9737-fc13a5bdc8ee tempest-VolumesSnapshotTestJSON-1904508205 tempest-VolumesSnapshotTestJSON-1904508205-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:39:50.653375 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-8cb2dae1-a0cc-4ba2-9737-fc13a5bdc8ee tempest-VolumesSnapshotTestJSON-1904508205 tempest-VolumesSnapshotTestJSON-1904508205-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:39:50.793265 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.policy [None req-8cb2dae1-a0cc-4ba2-9737-fc13a5bdc8ee tempest-VolumesSnapshotTestJSON-1904508205 tempest-VolumesSnapshotTestJSON-1904508205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '805854e5ce2e412fb9420afd63f73ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72bda4cbb07a43688506e01d06ba89c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129322) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:39:50.801567 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: INFO nova.api.openstack.requestlog [None req-8cb2dae1-a0cc-4ba2-9737-fc13a5bdc8ee tempest-VolumesSnapshotTestJSON-1904508205 tempest-VolumesSnapshotTestJSON-1904508205-project] 10.222.0.75 "GET /compute/v2.1/servers/f392ba2b-2b88-4b1a-be61-0cf28ed1443a" status: 200 len: 1319 microversion: 2.1 time: 0.163770 May 26 12:39:50.802141 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: [pid: 129322|app: 0|req: 124/239] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 26 12:39:50 2022] GET /compute/v2.1/servers/f392ba2b-2b88-4b1a-be61-0cf28ed1443a => generated 1319 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:39:51.260366 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi [None req-88d8d4ba-98a0-4acf-bb8e-945488177a08 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Calling method '>' {{(pid=129321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:39:51.261222 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.compute.api [None req-88d8d4ba-98a0-4acf-bb8e-945488177a08 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] [instance: 605b9171-aa87-432a-b179-c552640e73dd] Fetching instance by UUID {{(pid=129321) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:39:51.269659 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-88d8d4ba-98a0-4acf-bb8e-945488177a08 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:39:51.270108 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-88d8d4ba-98a0-4acf-bb8e-945488177a08 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:39:51.270869 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-88d8d4ba-98a0-4acf-bb8e-945488177a08 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:39:51.271709 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-88d8d4ba-98a0-4acf-bb8e-945488177a08 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:39:51.407018 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.policy [None req-88d8d4ba-98a0-4acf-bb8e-945488177a08 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0431b1f25497443ba483b3c440669080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e36ab03283d4ce6a2fed5e111e03d34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129321) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:39:51.420078 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: INFO nova.api.openstack.requestlog [None req-88d8d4ba-98a0-4acf-bb8e-945488177a08 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] 10.222.0.75 "GET /compute/v2.1/servers/605b9171-aa87-432a-b179-c552640e73dd" status: 200 len: 1522 microversion: 2.1 time: 0.165848 May 26 12:39:51.420991 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: [pid: 129321|app: 0|req: 116/240] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 26 12:39:51 2022] GET /compute/v2.1/servers/605b9171-aa87-432a-b179-c552640e73dd => generated 1522 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:39:51.818378 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi [None req-ce09c048-e10e-4590-b46f-cbaf6befe65f tempest-VolumesSnapshotTestJSON-1904508205 tempest-VolumesSnapshotTestJSON-1904508205-project] Calling method '>' {{(pid=129322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:39:51.819041 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.compute.api [None req-ce09c048-e10e-4590-b46f-cbaf6befe65f tempest-VolumesSnapshotTestJSON-1904508205 tempest-VolumesSnapshotTestJSON-1904508205-project] [instance: f392ba2b-2b88-4b1a-be61-0cf28ed1443a] Fetching instance by UUID {{(pid=129322) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:39:51.827643 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-ce09c048-e10e-4590-b46f-cbaf6befe65f tempest-VolumesSnapshotTestJSON-1904508205 tempest-VolumesSnapshotTestJSON-1904508205-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:39:51.828296 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-ce09c048-e10e-4590-b46f-cbaf6befe65f tempest-VolumesSnapshotTestJSON-1904508205 tempest-VolumesSnapshotTestJSON-1904508205-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:39:51.829192 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-ce09c048-e10e-4590-b46f-cbaf6befe65f tempest-VolumesSnapshotTestJSON-1904508205 tempest-VolumesSnapshotTestJSON-1904508205-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:39:51.829599 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-ce09c048-e10e-4590-b46f-cbaf6befe65f tempest-VolumesSnapshotTestJSON-1904508205 tempest-VolumesSnapshotTestJSON-1904508205-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:39:51.961227 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.policy [None req-ce09c048-e10e-4590-b46f-cbaf6befe65f tempest-VolumesSnapshotTestJSON-1904508205 tempest-VolumesSnapshotTestJSON-1904508205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '805854e5ce2e412fb9420afd63f73ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72bda4cbb07a43688506e01d06ba89c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129322) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:39:51.969018 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: INFO nova.api.openstack.requestlog [None req-ce09c048-e10e-4590-b46f-cbaf6befe65f tempest-VolumesSnapshotTestJSON-1904508205 tempest-VolumesSnapshotTestJSON-1904508205-project] 10.222.0.75 "GET /compute/v2.1/servers/f392ba2b-2b88-4b1a-be61-0cf28ed1443a" status: 200 len: 1319 microversion: 2.1 time: 0.154479 May 26 12:39:51.969509 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: [pid: 129322|app: 0|req: 125/241] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 26 12:39:51 2022] GET /compute/v2.1/servers/f392ba2b-2b88-4b1a-be61-0cf28ed1443a => generated 1319 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:39:52.002951 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi [req-09ce5373-a957-4152-9b97-359f4fdc33e0 req-e3e6648d-d268-45f1-92f6-018ea2f70c37 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f392ba2b-2b88-4b1a-be61-0cf28ed1443a", "name": "network-vif-plugged", "status": "completed", "tag": "10bca8e7-0bd1-4264-811e-ec4cb5f9c2bd"}]} {{(pid=129321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 12:39:52.013130 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [req-09ce5373-a957-4152-9b97-359f4fdc33e0 req-e3e6648d-d268-45f1-92f6-018ea2f70c37 service nova] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:39:52.013583 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [req-09ce5373-a957-4152-9b97-359f4fdc33e0 req-e3e6648d-d268-45f1-92f6-018ea2f70c37 service nova] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:39:52.026487 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: INFO nova.api.openstack.compute.server_external_events [req-09ce5373-a957-4152-9b97-359f4fdc33e0 req-e3e6648d-d268-45f1-92f6-018ea2f70c37 service nova] Creating event network-vif-plugged:10bca8e7-0bd1-4264-811e-ec4cb5f9c2bd for instance f392ba2b-2b88-4b1a-be61-0cf28ed1443a on hv-cinder-81966 May 26 12:39:52.031739 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: INFO nova.api.openstack.requestlog [req-09ce5373-a957-4152-9b97-359f4fdc33e0 req-e3e6648d-d268-45f1-92f6-018ea2f70c37 service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032811 May 26 12:39:52.032476 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: [pid: 129321|app: 0|req: 117/242] 10.222.0.75 () {64 vars in 1317 bytes} [Thu May 26 12:39:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 12:39:52.441502 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi [None req-f8c22e76-e344-491a-841e-fdbc67edc2d7 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Calling method '>' {{(pid=129322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:39:52.442303 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.compute.api [None req-f8c22e76-e344-491a-841e-fdbc67edc2d7 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] [instance: 605b9171-aa87-432a-b179-c552640e73dd] Fetching instance by UUID {{(pid=129322) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:39:52.450628 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-f8c22e76-e344-491a-841e-fdbc67edc2d7 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:39:52.451221 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-f8c22e76-e344-491a-841e-fdbc67edc2d7 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:39:52.452271 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-f8c22e76-e344-491a-841e-fdbc67edc2d7 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:39:52.452842 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-f8c22e76-e344-491a-841e-fdbc67edc2d7 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:39:52.592164 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.policy [None req-f8c22e76-e344-491a-841e-fdbc67edc2d7 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0431b1f25497443ba483b3c440669080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e36ab03283d4ce6a2fed5e111e03d34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129322) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:39:52.601265 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: INFO nova.api.openstack.requestlog [None req-f8c22e76-e344-491a-841e-fdbc67edc2d7 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] 10.222.0.75 "GET /compute/v2.1/servers/605b9171-aa87-432a-b179-c552640e73dd" status: 200 len: 1522 microversion: 2.1 time: 0.165958 May 26 12:39:52.601844 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: [pid: 129322|app: 0|req: 126/243] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 26 12:39:52 2022] GET /compute/v2.1/servers/605b9171-aa87-432a-b179-c552640e73dd => generated 1522 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:39:52.986728 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi [None req-e04adb5b-86e6-4fbc-8ce5-2a895994ee3b tempest-VolumesSnapshotTestJSON-1904508205 tempest-VolumesSnapshotTestJSON-1904508205-project] Calling method '>' {{(pid=129321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:39:52.987410 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.compute.api [None req-e04adb5b-86e6-4fbc-8ce5-2a895994ee3b tempest-VolumesSnapshotTestJSON-1904508205 tempest-VolumesSnapshotTestJSON-1904508205-project] [instance: f392ba2b-2b88-4b1a-be61-0cf28ed1443a] Fetching instance by UUID {{(pid=129321) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:39:52.994046 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-e04adb5b-86e6-4fbc-8ce5-2a895994ee3b tempest-VolumesSnapshotTestJSON-1904508205 tempest-VolumesSnapshotTestJSON-1904508205-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:39:52.994475 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-e04adb5b-86e6-4fbc-8ce5-2a895994ee3b tempest-VolumesSnapshotTestJSON-1904508205 tempest-VolumesSnapshotTestJSON-1904508205-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:39:52.995232 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-e04adb5b-86e6-4fbc-8ce5-2a895994ee3b tempest-VolumesSnapshotTestJSON-1904508205 tempest-VolumesSnapshotTestJSON-1904508205-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:39:52.995692 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-e04adb5b-86e6-4fbc-8ce5-2a895994ee3b tempest-VolumesSnapshotTestJSON-1904508205 tempest-VolumesSnapshotTestJSON-1904508205-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:39:53.126328 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.policy [None req-e04adb5b-86e6-4fbc-8ce5-2a895994ee3b tempest-VolumesSnapshotTestJSON-1904508205 tempest-VolumesSnapshotTestJSON-1904508205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '805854e5ce2e412fb9420afd63f73ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72bda4cbb07a43688506e01d06ba89c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129321) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:39:53.134119 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: INFO nova.api.openstack.requestlog [None req-e04adb5b-86e6-4fbc-8ce5-2a895994ee3b tempest-VolumesSnapshotTestJSON-1904508205 tempest-VolumesSnapshotTestJSON-1904508205-project] 10.222.0.75 "GET /compute/v2.1/servers/f392ba2b-2b88-4b1a-be61-0cf28ed1443a" status: 200 len: 1319 microversion: 2.1 time: 0.151715 May 26 12:39:53.134699 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: [pid: 129321|app: 0|req: 118/244] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 26 12:39:52 2022] GET /compute/v2.1/servers/f392ba2b-2b88-4b1a-be61-0cf28ed1443a => generated 1319 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:39:53.620227 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi [None req-faed35fd-edf3-471c-a75f-d68970397fb5 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Calling method '>' {{(pid=129322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:39:53.620807 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.compute.api [None req-faed35fd-edf3-471c-a75f-d68970397fb5 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] [instance: 605b9171-aa87-432a-b179-c552640e73dd] Fetching instance by UUID {{(pid=129322) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:39:53.627805 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-faed35fd-edf3-471c-a75f-d68970397fb5 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:39:53.628252 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-faed35fd-edf3-471c-a75f-d68970397fb5 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:39:53.629286 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-faed35fd-edf3-471c-a75f-d68970397fb5 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:39:53.629820 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-faed35fd-edf3-471c-a75f-d68970397fb5 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:39:53.769283 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.policy [None req-faed35fd-edf3-471c-a75f-d68970397fb5 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0431b1f25497443ba483b3c440669080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e36ab03283d4ce6a2fed5e111e03d34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129322) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:39:53.779964 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: INFO nova.api.openstack.requestlog [None req-faed35fd-edf3-471c-a75f-d68970397fb5 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] 10.222.0.75 "GET /compute/v2.1/servers/605b9171-aa87-432a-b179-c552640e73dd" status: 200 len: 1522 microversion: 2.1 time: 0.164674 May 26 12:39:53.780633 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: [pid: 129322|app: 0|req: 127/245] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 26 12:39:53 2022] GET /compute/v2.1/servers/605b9171-aa87-432a-b179-c552640e73dd => generated 1522 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:39:54.150873 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi [None req-bebfcb5b-6d5f-48c5-bd64-00cf4fe8c8e0 tempest-VolumesSnapshotTestJSON-1904508205 tempest-VolumesSnapshotTestJSON-1904508205-project] Calling method '>' {{(pid=129321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:39:54.151408 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.compute.api [None req-bebfcb5b-6d5f-48c5-bd64-00cf4fe8c8e0 tempest-VolumesSnapshotTestJSON-1904508205 tempest-VolumesSnapshotTestJSON-1904508205-project] [instance: f392ba2b-2b88-4b1a-be61-0cf28ed1443a] Fetching instance by UUID {{(pid=129321) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:39:54.157919 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-bebfcb5b-6d5f-48c5-bd64-00cf4fe8c8e0 tempest-VolumesSnapshotTestJSON-1904508205 tempest-VolumesSnapshotTestJSON-1904508205-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:39:54.158365 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-bebfcb5b-6d5f-48c5-bd64-00cf4fe8c8e0 tempest-VolumesSnapshotTestJSON-1904508205 tempest-VolumesSnapshotTestJSON-1904508205-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:39:54.159117 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-bebfcb5b-6d5f-48c5-bd64-00cf4fe8c8e0 tempest-VolumesSnapshotTestJSON-1904508205 tempest-VolumesSnapshotTestJSON-1904508205-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:39:54.159595 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-bebfcb5b-6d5f-48c5-bd64-00cf4fe8c8e0 tempest-VolumesSnapshotTestJSON-1904508205 tempest-VolumesSnapshotTestJSON-1904508205-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:39:54.291076 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.policy [None req-bebfcb5b-6d5f-48c5-bd64-00cf4fe8c8e0 tempest-VolumesSnapshotTestJSON-1904508205 tempest-VolumesSnapshotTestJSON-1904508205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '805854e5ce2e412fb9420afd63f73ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72bda4cbb07a43688506e01d06ba89c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129321) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:39:54.302003 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: INFO nova.api.openstack.requestlog [None req-bebfcb5b-6d5f-48c5-bd64-00cf4fe8c8e0 tempest-VolumesSnapshotTestJSON-1904508205 tempest-VolumesSnapshotTestJSON-1904508205-project] 10.222.0.75 "GET /compute/v2.1/servers/f392ba2b-2b88-4b1a-be61-0cf28ed1443a" status: 200 len: 1319 microversion: 2.1 time: 0.155447 May 26 12:39:54.302572 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: [pid: 129321|app: 0|req: 119/246] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 26 12:39:54 2022] GET /compute/v2.1/servers/f392ba2b-2b88-4b1a-be61-0cf28ed1443a => generated 1319 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:39:54.797309 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi [None req-2f83a257-6484-4f7e-8af7-767face93aaf tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Calling method '>' {{(pid=129322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:39:54.797957 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.compute.api [None req-2f83a257-6484-4f7e-8af7-767face93aaf tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] [instance: 605b9171-aa87-432a-b179-c552640e73dd] Fetching instance by UUID {{(pid=129322) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:39:54.805290 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-2f83a257-6484-4f7e-8af7-767face93aaf tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:39:54.805739 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-2f83a257-6484-4f7e-8af7-767face93aaf tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:39:54.806494 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-2f83a257-6484-4f7e-8af7-767face93aaf tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:39:54.806925 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-2f83a257-6484-4f7e-8af7-767face93aaf tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:39:54.942371 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.policy [None req-2f83a257-6484-4f7e-8af7-767face93aaf tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0431b1f25497443ba483b3c440669080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e36ab03283d4ce6a2fed5e111e03d34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129322) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:39:54.951639 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: INFO nova.api.openstack.requestlog [None req-2f83a257-6484-4f7e-8af7-767face93aaf tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] 10.222.0.75 "GET /compute/v2.1/servers/605b9171-aa87-432a-b179-c552640e73dd" status: 200 len: 1522 microversion: 2.1 time: 0.158138 May 26 12:39:54.952230 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: [pid: 129322|app: 0|req: 128/247] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 26 12:39:54 2022] GET /compute/v2.1/servers/605b9171-aa87-432a-b179-c552640e73dd => generated 1522 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:39:55.320245 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi [None req-12c769cf-dff8-4309-a696-ce0939d323b0 tempest-VolumesSnapshotTestJSON-1904508205 tempest-VolumesSnapshotTestJSON-1904508205-project] Calling method '>' {{(pid=129321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:39:55.320813 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.compute.api [None req-12c769cf-dff8-4309-a696-ce0939d323b0 tempest-VolumesSnapshotTestJSON-1904508205 tempest-VolumesSnapshotTestJSON-1904508205-project] [instance: f392ba2b-2b88-4b1a-be61-0cf28ed1443a] Fetching instance by UUID {{(pid=129321) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:39:55.327335 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-12c769cf-dff8-4309-a696-ce0939d323b0 tempest-VolumesSnapshotTestJSON-1904508205 tempest-VolumesSnapshotTestJSON-1904508205-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:39:55.327991 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-12c769cf-dff8-4309-a696-ce0939d323b0 tempest-VolumesSnapshotTestJSON-1904508205 tempest-VolumesSnapshotTestJSON-1904508205-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:39:55.328741 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-12c769cf-dff8-4309-a696-ce0939d323b0 tempest-VolumesSnapshotTestJSON-1904508205 tempest-VolumesSnapshotTestJSON-1904508205-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:39:55.329172 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-12c769cf-dff8-4309-a696-ce0939d323b0 tempest-VolumesSnapshotTestJSON-1904508205 tempest-VolumesSnapshotTestJSON-1904508205-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:39:55.459454 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.policy [None req-12c769cf-dff8-4309-a696-ce0939d323b0 tempest-VolumesSnapshotTestJSON-1904508205 tempest-VolumesSnapshotTestJSON-1904508205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '805854e5ce2e412fb9420afd63f73ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72bda4cbb07a43688506e01d06ba89c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129321) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:39:55.470563 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: INFO nova.api.openstack.requestlog [None req-12c769cf-dff8-4309-a696-ce0939d323b0 tempest-VolumesSnapshotTestJSON-1904508205 tempest-VolumesSnapshotTestJSON-1904508205-project] 10.222.0.75 "GET /compute/v2.1/servers/f392ba2b-2b88-4b1a-be61-0cf28ed1443a" status: 200 len: 1319 microversion: 2.1 time: 0.154472 May 26 12:39:55.471396 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: [pid: 129321|app: 0|req: 120/248] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 26 12:39:55 2022] GET /compute/v2.1/servers/f392ba2b-2b88-4b1a-be61-0cf28ed1443a => generated 1319 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:39:55.973096 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi [None req-c7f52c98-2d4b-4e6a-a7d9-773a9901eb79 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Calling method '>' {{(pid=129322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:39:55.974326 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.compute.api [None req-c7f52c98-2d4b-4e6a-a7d9-773a9901eb79 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] [instance: 605b9171-aa87-432a-b179-c552640e73dd] Fetching instance by UUID {{(pid=129322) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:39:55.985443 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-c7f52c98-2d4b-4e6a-a7d9-773a9901eb79 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:39:55.986214 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-c7f52c98-2d4b-4e6a-a7d9-773a9901eb79 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:39:55.987468 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-c7f52c98-2d4b-4e6a-a7d9-773a9901eb79 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:39:55.988195 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-c7f52c98-2d4b-4e6a-a7d9-773a9901eb79 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:39:56.300866 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.policy [None req-c7f52c98-2d4b-4e6a-a7d9-773a9901eb79 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0431b1f25497443ba483b3c440669080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e36ab03283d4ce6a2fed5e111e03d34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129322) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:39:56.312190 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: INFO nova.api.openstack.requestlog [None req-c7f52c98-2d4b-4e6a-a7d9-773a9901eb79 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] 10.222.0.75 "GET /compute/v2.1/servers/605b9171-aa87-432a-b179-c552640e73dd" status: 200 len: 1522 microversion: 2.1 time: 0.345313 May 26 12:39:56.313117 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: [pid: 129322|app: 0|req: 129/249] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 26 12:39:55 2022] GET /compute/v2.1/servers/605b9171-aa87-432a-b179-c552640e73dd => generated 1522 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:39:56.490697 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi [None req-e44ee74f-1cfe-4fcc-b4fb-066f42e9349e tempest-VolumesSnapshotTestJSON-1904508205 tempest-VolumesSnapshotTestJSON-1904508205-project] Calling method '>' {{(pid=129321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:39:56.491264 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.compute.api [None req-e44ee74f-1cfe-4fcc-b4fb-066f42e9349e tempest-VolumesSnapshotTestJSON-1904508205 tempest-VolumesSnapshotTestJSON-1904508205-project] [instance: f392ba2b-2b88-4b1a-be61-0cf28ed1443a] Fetching instance by UUID {{(pid=129321) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:39:56.497985 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-e44ee74f-1cfe-4fcc-b4fb-066f42e9349e tempest-VolumesSnapshotTestJSON-1904508205 tempest-VolumesSnapshotTestJSON-1904508205-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:39:56.498427 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-e44ee74f-1cfe-4fcc-b4fb-066f42e9349e tempest-VolumesSnapshotTestJSON-1904508205 tempest-VolumesSnapshotTestJSON-1904508205-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:39:56.499176 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-e44ee74f-1cfe-4fcc-b4fb-066f42e9349e tempest-VolumesSnapshotTestJSON-1904508205 tempest-VolumesSnapshotTestJSON-1904508205-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:39:56.499631 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-e44ee74f-1cfe-4fcc-b4fb-066f42e9349e tempest-VolumesSnapshotTestJSON-1904508205 tempest-VolumesSnapshotTestJSON-1904508205-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:39:56.641332 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.policy [None req-e44ee74f-1cfe-4fcc-b4fb-066f42e9349e tempest-VolumesSnapshotTestJSON-1904508205 tempest-VolumesSnapshotTestJSON-1904508205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '805854e5ce2e412fb9420afd63f73ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72bda4cbb07a43688506e01d06ba89c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129321) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:39:56.650031 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: INFO nova.api.openstack.requestlog [None req-e44ee74f-1cfe-4fcc-b4fb-066f42e9349e tempest-VolumesSnapshotTestJSON-1904508205 tempest-VolumesSnapshotTestJSON-1904508205-project] 10.222.0.75 "GET /compute/v2.1/servers/f392ba2b-2b88-4b1a-be61-0cf28ed1443a" status: 200 len: 1319 microversion: 2.1 time: 0.164418 May 26 12:39:56.650623 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: [pid: 129321|app: 0|req: 121/250] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 26 12:39:56 2022] GET /compute/v2.1/servers/f392ba2b-2b88-4b1a-be61-0cf28ed1443a => generated 1319 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:39:57.330557 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi [None req-6c021f2d-503e-491e-9d3d-0b57d2df71f1 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Calling method '>' {{(pid=129322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:39:57.331200 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.compute.api [None req-6c021f2d-503e-491e-9d3d-0b57d2df71f1 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] [instance: 605b9171-aa87-432a-b179-c552640e73dd] Fetching instance by UUID {{(pid=129322) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:39:57.337692 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-6c021f2d-503e-491e-9d3d-0b57d2df71f1 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:39:57.338272 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-6c021f2d-503e-491e-9d3d-0b57d2df71f1 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:39:57.339126 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-6c021f2d-503e-491e-9d3d-0b57d2df71f1 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:39:57.339639 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-6c021f2d-503e-491e-9d3d-0b57d2df71f1 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:39:57.471749 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.policy [None req-6c021f2d-503e-491e-9d3d-0b57d2df71f1 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0431b1f25497443ba483b3c440669080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e36ab03283d4ce6a2fed5e111e03d34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129322) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:39:57.479472 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: INFO nova.api.openstack.requestlog [None req-6c021f2d-503e-491e-9d3d-0b57d2df71f1 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] 10.222.0.75 "GET /compute/v2.1/servers/605b9171-aa87-432a-b179-c552640e73dd" status: 200 len: 1522 microversion: 2.1 time: 0.153124 May 26 12:39:57.480064 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: [pid: 129322|app: 0|req: 130/251] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 26 12:39:57 2022] GET /compute/v2.1/servers/605b9171-aa87-432a-b179-c552640e73dd => generated 1522 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:39:57.668572 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi [None req-f49aae85-197a-4c49-918d-1068ddb812d3 tempest-VolumesSnapshotTestJSON-1904508205 tempest-VolumesSnapshotTestJSON-1904508205-project] Calling method '>' {{(pid=129321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:39:57.669168 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.compute.api [None req-f49aae85-197a-4c49-918d-1068ddb812d3 tempest-VolumesSnapshotTestJSON-1904508205 tempest-VolumesSnapshotTestJSON-1904508205-project] [instance: f392ba2b-2b88-4b1a-be61-0cf28ed1443a] Fetching instance by UUID {{(pid=129321) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:39:57.676297 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-f49aae85-197a-4c49-918d-1068ddb812d3 tempest-VolumesSnapshotTestJSON-1904508205 tempest-VolumesSnapshotTestJSON-1904508205-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:39:57.676885 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-f49aae85-197a-4c49-918d-1068ddb812d3 tempest-VolumesSnapshotTestJSON-1904508205 tempest-VolumesSnapshotTestJSON-1904508205-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:39:57.678393 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-f49aae85-197a-4c49-918d-1068ddb812d3 tempest-VolumesSnapshotTestJSON-1904508205 tempest-VolumesSnapshotTestJSON-1904508205-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:39:57.678881 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-f49aae85-197a-4c49-918d-1068ddb812d3 tempest-VolumesSnapshotTestJSON-1904508205 tempest-VolumesSnapshotTestJSON-1904508205-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:39:57.833634 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.policy [None req-f49aae85-197a-4c49-918d-1068ddb812d3 tempest-VolumesSnapshotTestJSON-1904508205 tempest-VolumesSnapshotTestJSON-1904508205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '805854e5ce2e412fb9420afd63f73ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72bda4cbb07a43688506e01d06ba89c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129321) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:39:57.841827 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: INFO nova.api.openstack.requestlog [None req-f49aae85-197a-4c49-918d-1068ddb812d3 tempest-VolumesSnapshotTestJSON-1904508205 tempest-VolumesSnapshotTestJSON-1904508205-project] 10.222.0.75 "GET /compute/v2.1/servers/f392ba2b-2b88-4b1a-be61-0cf28ed1443a" status: 200 len: 1319 microversion: 2.1 time: 0.177725 May 26 12:39:57.842404 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: [pid: 129321|app: 0|req: 122/252] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 26 12:39:57 2022] GET /compute/v2.1/servers/f392ba2b-2b88-4b1a-be61-0cf28ed1443a => generated 1319 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:39:58.496327 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi [None req-47bff623-f394-4e52-b592-657e3a7e6015 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Calling method '>' {{(pid=129322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:39:58.496903 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.compute.api [None req-47bff623-f394-4e52-b592-657e3a7e6015 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] [instance: 605b9171-aa87-432a-b179-c552640e73dd] Fetching instance by UUID {{(pid=129322) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:39:58.503946 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-47bff623-f394-4e52-b592-657e3a7e6015 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:39:58.504392 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-47bff623-f394-4e52-b592-657e3a7e6015 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:39:58.505391 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-47bff623-f394-4e52-b592-657e3a7e6015 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:39:58.506010 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-47bff623-f394-4e52-b592-657e3a7e6015 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:39:58.643171 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.policy [None req-47bff623-f394-4e52-b592-657e3a7e6015 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0431b1f25497443ba483b3c440669080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e36ab03283d4ce6a2fed5e111e03d34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129322) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:39:58.652362 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: INFO nova.api.openstack.requestlog [None req-47bff623-f394-4e52-b592-657e3a7e6015 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] 10.222.0.75 "GET /compute/v2.1/servers/605b9171-aa87-432a-b179-c552640e73dd" status: 200 len: 1522 microversion: 2.1 time: 0.159815 May 26 12:39:58.652943 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: [pid: 129322|app: 0|req: 131/253] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 26 12:39:58 2022] GET /compute/v2.1/servers/605b9171-aa87-432a-b179-c552640e73dd => generated 1522 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:39:58.862457 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi [None req-a8704d1e-967f-468d-87fd-c0f12e2d7ce8 tempest-VolumesSnapshotTestJSON-1904508205 tempest-VolumesSnapshotTestJSON-1904508205-project] Calling method '>' {{(pid=129321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:39:58.863486 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.compute.api [None req-a8704d1e-967f-468d-87fd-c0f12e2d7ce8 tempest-VolumesSnapshotTestJSON-1904508205 tempest-VolumesSnapshotTestJSON-1904508205-project] [instance: f392ba2b-2b88-4b1a-be61-0cf28ed1443a] Fetching instance by UUID {{(pid=129321) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:39:58.870811 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-a8704d1e-967f-468d-87fd-c0f12e2d7ce8 tempest-VolumesSnapshotTestJSON-1904508205 tempest-VolumesSnapshotTestJSON-1904508205-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:39:58.871255 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-a8704d1e-967f-468d-87fd-c0f12e2d7ce8 tempest-VolumesSnapshotTestJSON-1904508205 tempest-VolumesSnapshotTestJSON-1904508205-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:39:58.872044 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-a8704d1e-967f-468d-87fd-c0f12e2d7ce8 tempest-VolumesSnapshotTestJSON-1904508205 tempest-VolumesSnapshotTestJSON-1904508205-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:39:58.872472 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-a8704d1e-967f-468d-87fd-c0f12e2d7ce8 tempest-VolumesSnapshotTestJSON-1904508205 tempest-VolumesSnapshotTestJSON-1904508205-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:39:59.009055 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.policy [None req-a8704d1e-967f-468d-87fd-c0f12e2d7ce8 tempest-VolumesSnapshotTestJSON-1904508205 tempest-VolumesSnapshotTestJSON-1904508205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '805854e5ce2e412fb9420afd63f73ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72bda4cbb07a43688506e01d06ba89c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129321) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:39:59.020179 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: INFO nova.api.openstack.requestlog [None req-a8704d1e-967f-468d-87fd-c0f12e2d7ce8 tempest-VolumesSnapshotTestJSON-1904508205 tempest-VolumesSnapshotTestJSON-1904508205-project] 10.222.0.75 "GET /compute/v2.1/servers/f392ba2b-2b88-4b1a-be61-0cf28ed1443a" status: 200 len: 1319 microversion: 2.1 time: 0.164176 May 26 12:39:59.020755 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: [pid: 129321|app: 0|req: 123/254] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 26 12:39:58 2022] GET /compute/v2.1/servers/f392ba2b-2b88-4b1a-be61-0cf28ed1443a => generated 1319 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:39:59.669218 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi [None req-55bf08d2-876d-4c88-a0c5-6a562d3e6b32 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Calling method '>' {{(pid=129322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:39:59.669743 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.compute.api [None req-55bf08d2-876d-4c88-a0c5-6a562d3e6b32 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] [instance: 605b9171-aa87-432a-b179-c552640e73dd] Fetching instance by UUID {{(pid=129322) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:39:59.676653 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-55bf08d2-876d-4c88-a0c5-6a562d3e6b32 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:39:59.677106 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-55bf08d2-876d-4c88-a0c5-6a562d3e6b32 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:39:59.677866 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-55bf08d2-876d-4c88-a0c5-6a562d3e6b32 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:39:59.678320 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-55bf08d2-876d-4c88-a0c5-6a562d3e6b32 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:39:59.806918 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.policy [None req-55bf08d2-876d-4c88-a0c5-6a562d3e6b32 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0431b1f25497443ba483b3c440669080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e36ab03283d4ce6a2fed5e111e03d34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129322) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:39:59.814623 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: INFO nova.api.openstack.requestlog [None req-55bf08d2-876d-4c88-a0c5-6a562d3e6b32 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] 10.222.0.75 "GET /compute/v2.1/servers/605b9171-aa87-432a-b179-c552640e73dd" status: 200 len: 1522 microversion: 2.1 time: 0.149459 May 26 12:39:59.815198 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: [pid: 129322|app: 0|req: 132/255] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 26 12:39:59 2022] GET /compute/v2.1/servers/605b9171-aa87-432a-b179-c552640e73dd => generated 1522 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:40:00.040489 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi [None req-3857a6a9-b510-4ba3-9988-1af099697bc9 tempest-VolumesSnapshotTestJSON-1904508205 tempest-VolumesSnapshotTestJSON-1904508205-project] Calling method '>' {{(pid=129321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:40:00.041090 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.compute.api [None req-3857a6a9-b510-4ba3-9988-1af099697bc9 tempest-VolumesSnapshotTestJSON-1904508205 tempest-VolumesSnapshotTestJSON-1904508205-project] [instance: f392ba2b-2b88-4b1a-be61-0cf28ed1443a] Fetching instance by UUID {{(pid=129321) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:40:00.048058 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-3857a6a9-b510-4ba3-9988-1af099697bc9 tempest-VolumesSnapshotTestJSON-1904508205 tempest-VolumesSnapshotTestJSON-1904508205-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:40:00.048506 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-3857a6a9-b510-4ba3-9988-1af099697bc9 tempest-VolumesSnapshotTestJSON-1904508205 tempest-VolumesSnapshotTestJSON-1904508205-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:40:00.049265 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-3857a6a9-b510-4ba3-9988-1af099697bc9 tempest-VolumesSnapshotTestJSON-1904508205 tempest-VolumesSnapshotTestJSON-1904508205-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:40:00.049696 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-3857a6a9-b510-4ba3-9988-1af099697bc9 tempest-VolumesSnapshotTestJSON-1904508205 tempest-VolumesSnapshotTestJSON-1904508205-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:40:00.184644 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.policy [None req-3857a6a9-b510-4ba3-9988-1af099697bc9 tempest-VolumesSnapshotTestJSON-1904508205 tempest-VolumesSnapshotTestJSON-1904508205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '805854e5ce2e412fb9420afd63f73ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72bda4cbb07a43688506e01d06ba89c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129321) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:40:00.192313 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: INFO nova.api.openstack.requestlog [None req-3857a6a9-b510-4ba3-9988-1af099697bc9 tempest-VolumesSnapshotTestJSON-1904508205 tempest-VolumesSnapshotTestJSON-1904508205-project] 10.222.0.75 "GET /compute/v2.1/servers/f392ba2b-2b88-4b1a-be61-0cf28ed1443a" status: 200 len: 1319 microversion: 2.1 time: 0.157344 May 26 12:40:00.192899 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: [pid: 129321|app: 0|req: 124/256] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 26 12:40:00 2022] GET /compute/v2.1/servers/f392ba2b-2b88-4b1a-be61-0cf28ed1443a => generated 1319 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:40:00.834954 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi [None req-717b263c-765b-40ce-aa66-395649964680 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Calling method '>' {{(pid=129322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:40:00.835719 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.compute.api [None req-717b263c-765b-40ce-aa66-395649964680 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] [instance: 605b9171-aa87-432a-b179-c552640e73dd] Fetching instance by UUID {{(pid=129322) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:40:00.842582 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-717b263c-765b-40ce-aa66-395649964680 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:40:00.843016 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-717b263c-765b-40ce-aa66-395649964680 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:40:00.843820 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-717b263c-765b-40ce-aa66-395649964680 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:40:00.844225 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-717b263c-765b-40ce-aa66-395649964680 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:40:00.979327 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.policy [None req-717b263c-765b-40ce-aa66-395649964680 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0431b1f25497443ba483b3c440669080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e36ab03283d4ce6a2fed5e111e03d34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129322) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:40:00.987620 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: INFO nova.api.openstack.requestlog [None req-717b263c-765b-40ce-aa66-395649964680 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] 10.222.0.75 "GET /compute/v2.1/servers/605b9171-aa87-432a-b179-c552640e73dd" status: 200 len: 1522 microversion: 2.1 time: 0.158907 May 26 12:40:00.988192 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: [pid: 129322|app: 0|req: 133/257] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 26 12:40:00 2022] GET /compute/v2.1/servers/605b9171-aa87-432a-b179-c552640e73dd => generated 1522 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:40:01.208592 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi [None req-6f229eab-ea68-4378-acbe-cd730906764e tempest-VolumesSnapshotTestJSON-1904508205 tempest-VolumesSnapshotTestJSON-1904508205-project] Calling method '>' {{(pid=129321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:40:01.209207 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.compute.api [None req-6f229eab-ea68-4378-acbe-cd730906764e tempest-VolumesSnapshotTestJSON-1904508205 tempest-VolumesSnapshotTestJSON-1904508205-project] [instance: f392ba2b-2b88-4b1a-be61-0cf28ed1443a] Fetching instance by UUID {{(pid=129321) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:40:01.215684 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-6f229eab-ea68-4378-acbe-cd730906764e tempest-VolumesSnapshotTestJSON-1904508205 tempest-VolumesSnapshotTestJSON-1904508205-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:40:01.216129 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-6f229eab-ea68-4378-acbe-cd730906764e tempest-VolumesSnapshotTestJSON-1904508205 tempest-VolumesSnapshotTestJSON-1904508205-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:40:01.216896 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-6f229eab-ea68-4378-acbe-cd730906764e tempest-VolumesSnapshotTestJSON-1904508205 tempest-VolumesSnapshotTestJSON-1904508205-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:40:01.217321 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-6f229eab-ea68-4378-acbe-cd730906764e tempest-VolumesSnapshotTestJSON-1904508205 tempest-VolumesSnapshotTestJSON-1904508205-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:40:01.352935 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.policy [None req-6f229eab-ea68-4378-acbe-cd730906764e tempest-VolumesSnapshotTestJSON-1904508205 tempest-VolumesSnapshotTestJSON-1904508205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '805854e5ce2e412fb9420afd63f73ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72bda4cbb07a43688506e01d06ba89c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129321) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:40:01.361200 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: INFO nova.api.openstack.requestlog [None req-6f229eab-ea68-4378-acbe-cd730906764e tempest-VolumesSnapshotTestJSON-1904508205 tempest-VolumesSnapshotTestJSON-1904508205-project] 10.222.0.75 "GET /compute/v2.1/servers/f392ba2b-2b88-4b1a-be61-0cf28ed1443a" status: 200 len: 1319 microversion: 2.1 time: 0.156540 May 26 12:40:01.361775 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: [pid: 129321|app: 0|req: 125/258] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 26 12:40:01 2022] GET /compute/v2.1/servers/f392ba2b-2b88-4b1a-be61-0cf28ed1443a => generated 1319 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:40:02.005013 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi [None req-92a3e872-37ea-4c9c-943d-797639c1ae36 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Calling method '>' {{(pid=129322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:40:02.005637 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.compute.api [None req-92a3e872-37ea-4c9c-943d-797639c1ae36 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] [instance: 605b9171-aa87-432a-b179-c552640e73dd] Fetching instance by UUID {{(pid=129322) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:40:02.012670 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-92a3e872-37ea-4c9c-943d-797639c1ae36 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:40:02.013074 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-92a3e872-37ea-4c9c-943d-797639c1ae36 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:40:02.013825 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-92a3e872-37ea-4c9c-943d-797639c1ae36 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:40:02.014251 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-92a3e872-37ea-4c9c-943d-797639c1ae36 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:40:02.168658 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.policy [None req-92a3e872-37ea-4c9c-943d-797639c1ae36 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0431b1f25497443ba483b3c440669080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e36ab03283d4ce6a2fed5e111e03d34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129322) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:40:02.176340 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: INFO nova.api.openstack.requestlog [None req-92a3e872-37ea-4c9c-943d-797639c1ae36 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] 10.222.0.75 "GET /compute/v2.1/servers/605b9171-aa87-432a-b179-c552640e73dd" status: 200 len: 1522 microversion: 2.1 time: 0.175179 May 26 12:40:02.176930 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: [pid: 129322|app: 0|req: 134/259] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 26 12:40:01 2022] GET /compute/v2.1/servers/605b9171-aa87-432a-b179-c552640e73dd => generated 1522 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:40:02.378684 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi [None req-d0301864-e856-4a6e-bf23-4607538e1484 tempest-VolumesSnapshotTestJSON-1904508205 tempest-VolumesSnapshotTestJSON-1904508205-project] Calling method '>' {{(pid=129321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:40:02.379260 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.compute.api [None req-d0301864-e856-4a6e-bf23-4607538e1484 tempest-VolumesSnapshotTestJSON-1904508205 tempest-VolumesSnapshotTestJSON-1904508205-project] [instance: f392ba2b-2b88-4b1a-be61-0cf28ed1443a] Fetching instance by UUID {{(pid=129321) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:40:02.386009 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-d0301864-e856-4a6e-bf23-4607538e1484 tempest-VolumesSnapshotTestJSON-1904508205 tempest-VolumesSnapshotTestJSON-1904508205-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:40:02.386440 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-d0301864-e856-4a6e-bf23-4607538e1484 tempest-VolumesSnapshotTestJSON-1904508205 tempest-VolumesSnapshotTestJSON-1904508205-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:40:02.387283 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-d0301864-e856-4a6e-bf23-4607538e1484 tempest-VolumesSnapshotTestJSON-1904508205 tempest-VolumesSnapshotTestJSON-1904508205-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:40:02.388534 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-d0301864-e856-4a6e-bf23-4607538e1484 tempest-VolumesSnapshotTestJSON-1904508205 tempest-VolumesSnapshotTestJSON-1904508205-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:40:02.527744 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.policy [None req-d0301864-e856-4a6e-bf23-4607538e1484 tempest-VolumesSnapshotTestJSON-1904508205 tempest-VolumesSnapshotTestJSON-1904508205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '805854e5ce2e412fb9420afd63f73ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72bda4cbb07a43688506e01d06ba89c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129321) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:40:02.536370 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: INFO nova.api.openstack.requestlog [None req-d0301864-e856-4a6e-bf23-4607538e1484 tempest-VolumesSnapshotTestJSON-1904508205 tempest-VolumesSnapshotTestJSON-1904508205-project] 10.222.0.75 "GET /compute/v2.1/servers/f392ba2b-2b88-4b1a-be61-0cf28ed1443a" status: 200 len: 1319 microversion: 2.1 time: 0.161529 May 26 12:40:02.536855 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: [pid: 129321|app: 0|req: 126/260] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 26 12:40:02 2022] GET /compute/v2.1/servers/f392ba2b-2b88-4b1a-be61-0cf28ed1443a => generated 1319 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:40:03.196240 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi [None req-64fb16d6-ead6-451d-a9f7-60e6fd7ec46d tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Calling method '>' {{(pid=129322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:40:03.197093 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.compute.api [None req-64fb16d6-ead6-451d-a9f7-60e6fd7ec46d tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] [instance: 605b9171-aa87-432a-b179-c552640e73dd] Fetching instance by UUID {{(pid=129322) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:40:03.200106 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG dbcounter [-] [129322] Writing DB stats nova_api:SELECT=56 {{(pid=129322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:40:03.207335 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-64fb16d6-ead6-451d-a9f7-60e6fd7ec46d tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:40:03.208121 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-64fb16d6-ead6-451d-a9f7-60e6fd7ec46d tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:40:03.209233 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-64fb16d6-ead6-451d-a9f7-60e6fd7ec46d tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:40:03.209841 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-64fb16d6-ead6-451d-a9f7-60e6fd7ec46d tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:40:03.341038 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.policy [None req-64fb16d6-ead6-451d-a9f7-60e6fd7ec46d tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0431b1f25497443ba483b3c440669080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e36ab03283d4ce6a2fed5e111e03d34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129322) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:40:03.349031 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: INFO nova.api.openstack.requestlog [None req-64fb16d6-ead6-451d-a9f7-60e6fd7ec46d tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] 10.222.0.75 "GET /compute/v2.1/servers/605b9171-aa87-432a-b179-c552640e73dd" status: 200 len: 1522 microversion: 2.1 time: 0.157948 May 26 12:40:03.350157 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: [pid: 129322|app: 0|req: 135/261] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 26 12:40:03 2022] GET /compute/v2.1/servers/605b9171-aa87-432a-b179-c552640e73dd => generated 1522 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:40:03.557370 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi [None req-fe9ced79-df56-490a-8bfa-5d31d372c493 tempest-VolumesSnapshotTestJSON-1904508205 tempest-VolumesSnapshotTestJSON-1904508205-project] Calling method '>' {{(pid=129321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:40:03.558266 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.compute.api [None req-fe9ced79-df56-490a-8bfa-5d31d372c493 tempest-VolumesSnapshotTestJSON-1904508205 tempest-VolumesSnapshotTestJSON-1904508205-project] [instance: f392ba2b-2b88-4b1a-be61-0cf28ed1443a] Fetching instance by UUID {{(pid=129321) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:40:03.569072 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-fe9ced79-df56-490a-8bfa-5d31d372c493 tempest-VolumesSnapshotTestJSON-1904508205 tempest-VolumesSnapshotTestJSON-1904508205-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:40:03.569881 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-fe9ced79-df56-490a-8bfa-5d31d372c493 tempest-VolumesSnapshotTestJSON-1904508205 tempest-VolumesSnapshotTestJSON-1904508205-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:40:03.570651 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-fe9ced79-df56-490a-8bfa-5d31d372c493 tempest-VolumesSnapshotTestJSON-1904508205 tempest-VolumesSnapshotTestJSON-1904508205-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:40:03.571081 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-fe9ced79-df56-490a-8bfa-5d31d372c493 tempest-VolumesSnapshotTestJSON-1904508205 tempest-VolumesSnapshotTestJSON-1904508205-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:40:03.712892 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.policy [None req-fe9ced79-df56-490a-8bfa-5d31d372c493 tempest-VolumesSnapshotTestJSON-1904508205 tempest-VolumesSnapshotTestJSON-1904508205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '805854e5ce2e412fb9420afd63f73ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72bda4cbb07a43688506e01d06ba89c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129321) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:40:03.720729 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: INFO nova.api.openstack.requestlog [None req-fe9ced79-df56-490a-8bfa-5d31d372c493 tempest-VolumesSnapshotTestJSON-1904508205 tempest-VolumesSnapshotTestJSON-1904508205-project] 10.222.0.75 "GET /compute/v2.1/servers/f392ba2b-2b88-4b1a-be61-0cf28ed1443a" status: 200 len: 1319 microversion: 2.1 time: 0.170125 May 26 12:40:03.721311 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: [pid: 129321|app: 0|req: 127/262] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 26 12:40:03 2022] GET /compute/v2.1/servers/f392ba2b-2b88-4b1a-be61-0cf28ed1443a => generated 1319 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:40:04.369885 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi [None req-a92826b6-790e-4673-95ab-365947f103a1 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Calling method '>' {{(pid=129322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:40:04.370873 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.compute.api [None req-a92826b6-790e-4673-95ab-365947f103a1 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] [instance: 605b9171-aa87-432a-b179-c552640e73dd] Fetching instance by UUID {{(pid=129322) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:40:04.381841 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-a92826b6-790e-4673-95ab-365947f103a1 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:40:04.382672 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-a92826b6-790e-4673-95ab-365947f103a1 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:40:04.383638 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-a92826b6-790e-4673-95ab-365947f103a1 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:40:04.384070 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-a92826b6-790e-4673-95ab-365947f103a1 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:40:04.388036 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG dbcounter [-] [129322] Writing DB stats nova_cell1:SELECT=100 {{(pid=129322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:40:04.522465 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.policy [None req-a92826b6-790e-4673-95ab-365947f103a1 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0431b1f25497443ba483b3c440669080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e36ab03283d4ce6a2fed5e111e03d34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129322) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:40:04.530587 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: INFO nova.api.openstack.requestlog [None req-a92826b6-790e-4673-95ab-365947f103a1 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] 10.222.0.75 "GET /compute/v2.1/servers/605b9171-aa87-432a-b179-c552640e73dd" status: 200 len: 1522 microversion: 2.1 time: 0.167138 May 26 12:40:04.531090 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: [pid: 129322|app: 0|req: 136/263] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 26 12:40:04 2022] GET /compute/v2.1/servers/605b9171-aa87-432a-b179-c552640e73dd => generated 1522 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:40:04.742092 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi [None req-80b10e28-b973-4b19-8e81-bcf9cdd19e0d tempest-VolumesSnapshotTestJSON-1904508205 tempest-VolumesSnapshotTestJSON-1904508205-project] Calling method '>' {{(pid=129321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:40:04.742980 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.compute.api [None req-80b10e28-b973-4b19-8e81-bcf9cdd19e0d tempest-VolumesSnapshotTestJSON-1904508205 tempest-VolumesSnapshotTestJSON-1904508205-project] [instance: f392ba2b-2b88-4b1a-be61-0cf28ed1443a] Fetching instance by UUID {{(pid=129321) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:40:04.745429 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG dbcounter [-] [129321] Writing DB stats nova_api:SELECT=65,nova_api:INSERT=3 {{(pid=129321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:40:04.752120 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-80b10e28-b973-4b19-8e81-bcf9cdd19e0d tempest-VolumesSnapshotTestJSON-1904508205 tempest-VolumesSnapshotTestJSON-1904508205-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:40:04.752713 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-80b10e28-b973-4b19-8e81-bcf9cdd19e0d tempest-VolumesSnapshotTestJSON-1904508205 tempest-VolumesSnapshotTestJSON-1904508205-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:40:04.753645 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-80b10e28-b973-4b19-8e81-bcf9cdd19e0d tempest-VolumesSnapshotTestJSON-1904508205 tempest-VolumesSnapshotTestJSON-1904508205-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:40:04.754172 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-80b10e28-b973-4b19-8e81-bcf9cdd19e0d tempest-VolumesSnapshotTestJSON-1904508205 tempest-VolumesSnapshotTestJSON-1904508205-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:40:04.762685 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG dbcounter [-] [129321] Writing DB stats nova_cell1:SELECT=100 {{(pid=129321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:40:04.900711 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.policy [None req-80b10e28-b973-4b19-8e81-bcf9cdd19e0d tempest-VolumesSnapshotTestJSON-1904508205 tempest-VolumesSnapshotTestJSON-1904508205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '805854e5ce2e412fb9420afd63f73ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72bda4cbb07a43688506e01d06ba89c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129321) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:40:04.912523 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: INFO nova.api.openstack.requestlog [None req-80b10e28-b973-4b19-8e81-bcf9cdd19e0d tempest-VolumesSnapshotTestJSON-1904508205 tempest-VolumesSnapshotTestJSON-1904508205-project] 10.222.0.75 "GET /compute/v2.1/servers/f392ba2b-2b88-4b1a-be61-0cf28ed1443a" status: 200 len: 1319 microversion: 2.1 time: 0.177145 May 26 12:40:04.913326 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: [pid: 129321|app: 0|req: 128/264] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 26 12:40:04 2022] GET /compute/v2.1/servers/f392ba2b-2b88-4b1a-be61-0cf28ed1443a => generated 1319 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:40:05.549296 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi [None req-d27c87db-3c8d-48a7-a70d-441679661a0d tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Calling method '>' {{(pid=129322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:40:05.550016 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.compute.api [None req-d27c87db-3c8d-48a7-a70d-441679661a0d tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] [instance: 605b9171-aa87-432a-b179-c552640e73dd] Fetching instance by UUID {{(pid=129322) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:40:05.556774 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-d27c87db-3c8d-48a7-a70d-441679661a0d tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:40:05.557216 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-d27c87db-3c8d-48a7-a70d-441679661a0d tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:40:05.558046 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-d27c87db-3c8d-48a7-a70d-441679661a0d tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:40:05.558404 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-d27c87db-3c8d-48a7-a70d-441679661a0d tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:40:05.701445 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.policy [None req-d27c87db-3c8d-48a7-a70d-441679661a0d tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0431b1f25497443ba483b3c440669080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e36ab03283d4ce6a2fed5e111e03d34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129322) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:40:05.713329 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: INFO nova.api.openstack.requestlog [None req-d27c87db-3c8d-48a7-a70d-441679661a0d tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] 10.222.0.75 "GET /compute/v2.1/servers/605b9171-aa87-432a-b179-c552640e73dd" status: 200 len: 1522 microversion: 2.1 time: 0.167692 May 26 12:40:05.714179 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: [pid: 129322|app: 0|req: 137/265] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 26 12:40:05 2022] GET /compute/v2.1/servers/605b9171-aa87-432a-b179-c552640e73dd => generated 1522 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:40:05.933339 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi [None req-d5839de4-ebf3-4451-ba2b-9bd34c2bac1f tempest-VolumesSnapshotTestJSON-1904508205 tempest-VolumesSnapshotTestJSON-1904508205-project] Calling method '>' {{(pid=129321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:40:05.934194 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.compute.api [None req-d5839de4-ebf3-4451-ba2b-9bd34c2bac1f tempest-VolumesSnapshotTestJSON-1904508205 tempest-VolumesSnapshotTestJSON-1904508205-project] [instance: f392ba2b-2b88-4b1a-be61-0cf28ed1443a] Fetching instance by UUID {{(pid=129321) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:40:05.943322 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-d5839de4-ebf3-4451-ba2b-9bd34c2bac1f tempest-VolumesSnapshotTestJSON-1904508205 tempest-VolumesSnapshotTestJSON-1904508205-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:40:05.944014 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-d5839de4-ebf3-4451-ba2b-9bd34c2bac1f tempest-VolumesSnapshotTestJSON-1904508205 tempest-VolumesSnapshotTestJSON-1904508205-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:40:05.945080 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-d5839de4-ebf3-4451-ba2b-9bd34c2bac1f tempest-VolumesSnapshotTestJSON-1904508205 tempest-VolumesSnapshotTestJSON-1904508205-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:40:05.945787 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-d5839de4-ebf3-4451-ba2b-9bd34c2bac1f tempest-VolumesSnapshotTestJSON-1904508205 tempest-VolumesSnapshotTestJSON-1904508205-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:40:06.078360 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.policy [None req-d5839de4-ebf3-4451-ba2b-9bd34c2bac1f tempest-VolumesSnapshotTestJSON-1904508205 tempest-VolumesSnapshotTestJSON-1904508205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '805854e5ce2e412fb9420afd63f73ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72bda4cbb07a43688506e01d06ba89c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129321) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:40:06.088183 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: INFO nova.api.openstack.requestlog [None req-d5839de4-ebf3-4451-ba2b-9bd34c2bac1f tempest-VolumesSnapshotTestJSON-1904508205 tempest-VolumesSnapshotTestJSON-1904508205-project] 10.222.0.75 "GET /compute/v2.1/servers/f392ba2b-2b88-4b1a-be61-0cf28ed1443a" status: 200 len: 1319 microversion: 2.1 time: 0.159032 May 26 12:40:06.088750 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: [pid: 129321|app: 0|req: 129/266] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 26 12:40:05 2022] GET /compute/v2.1/servers/f392ba2b-2b88-4b1a-be61-0cf28ed1443a => generated 1319 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:40:06.739239 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi [None req-3f370d2e-3724-4b00-8955-8622a3fba3ac tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Calling method '>' {{(pid=129322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:40:06.740280 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.compute.api [None req-3f370d2e-3724-4b00-8955-8622a3fba3ac tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] [instance: 605b9171-aa87-432a-b179-c552640e73dd] Fetching instance by UUID {{(pid=129322) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:40:06.751724 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-3f370d2e-3724-4b00-8955-8622a3fba3ac tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:40:06.752496 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-3f370d2e-3724-4b00-8955-8622a3fba3ac tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:40:06.753720 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-3f370d2e-3724-4b00-8955-8622a3fba3ac tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:40:06.754466 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-3f370d2e-3724-4b00-8955-8622a3fba3ac tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:40:06.896006 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.policy [None req-3f370d2e-3724-4b00-8955-8622a3fba3ac tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0431b1f25497443ba483b3c440669080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e36ab03283d4ce6a2fed5e111e03d34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129322) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:40:06.904086 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: INFO nova.api.openstack.requestlog [None req-3f370d2e-3724-4b00-8955-8622a3fba3ac tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] 10.222.0.75 "GET /compute/v2.1/servers/605b9171-aa87-432a-b179-c552640e73dd" status: 200 len: 1522 microversion: 2.1 time: 0.171312 May 26 12:40:06.904648 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: [pid: 129322|app: 0|req: 138/267] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 26 12:40:06 2022] GET /compute/v2.1/servers/605b9171-aa87-432a-b179-c552640e73dd => generated 1522 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:40:07.105790 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi [None req-94052153-e57b-40f9-ad0b-d9857ccd4506 tempest-VolumesSnapshotTestJSON-1904508205 tempest-VolumesSnapshotTestJSON-1904508205-project] Calling method '>' {{(pid=129321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:40:07.107085 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.compute.api [None req-94052153-e57b-40f9-ad0b-d9857ccd4506 tempest-VolumesSnapshotTestJSON-1904508205 tempest-VolumesSnapshotTestJSON-1904508205-project] [instance: f392ba2b-2b88-4b1a-be61-0cf28ed1443a] Fetching instance by UUID {{(pid=129321) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:40:07.113650 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-94052153-e57b-40f9-ad0b-d9857ccd4506 tempest-VolumesSnapshotTestJSON-1904508205 tempest-VolumesSnapshotTestJSON-1904508205-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:40:07.114150 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-94052153-e57b-40f9-ad0b-d9857ccd4506 tempest-VolumesSnapshotTestJSON-1904508205 tempest-VolumesSnapshotTestJSON-1904508205-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:40:07.114912 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-94052153-e57b-40f9-ad0b-d9857ccd4506 tempest-VolumesSnapshotTestJSON-1904508205 tempest-VolumesSnapshotTestJSON-1904508205-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:40:07.115344 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-94052153-e57b-40f9-ad0b-d9857ccd4506 tempest-VolumesSnapshotTestJSON-1904508205 tempest-VolumesSnapshotTestJSON-1904508205-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:40:07.252523 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.policy [None req-94052153-e57b-40f9-ad0b-d9857ccd4506 tempest-VolumesSnapshotTestJSON-1904508205 tempest-VolumesSnapshotTestJSON-1904508205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '805854e5ce2e412fb9420afd63f73ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72bda4cbb07a43688506e01d06ba89c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129321) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:40:07.262422 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: INFO nova.api.openstack.requestlog [None req-94052153-e57b-40f9-ad0b-d9857ccd4506 tempest-VolumesSnapshotTestJSON-1904508205 tempest-VolumesSnapshotTestJSON-1904508205-project] 10.222.0.75 "GET /compute/v2.1/servers/f392ba2b-2b88-4b1a-be61-0cf28ed1443a" status: 200 len: 1319 microversion: 2.1 time: 0.160960 May 26 12:40:07.263017 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: [pid: 129321|app: 0|req: 130/268] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 26 12:40:07 2022] GET /compute/v2.1/servers/f392ba2b-2b88-4b1a-be61-0cf28ed1443a => generated 1319 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:40:07.921713 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi [None req-61ab0e59-7566-4edc-a91c-63e4836b0186 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Calling method '>' {{(pid=129322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:40:07.922423 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.compute.api [None req-61ab0e59-7566-4edc-a91c-63e4836b0186 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] [instance: 605b9171-aa87-432a-b179-c552640e73dd] Fetching instance by UUID {{(pid=129322) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:40:07.930044 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-61ab0e59-7566-4edc-a91c-63e4836b0186 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:40:07.930565 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-61ab0e59-7566-4edc-a91c-63e4836b0186 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:40:07.931456 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-61ab0e59-7566-4edc-a91c-63e4836b0186 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:40:07.932001 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-61ab0e59-7566-4edc-a91c-63e4836b0186 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:40:08.061469 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.policy [None req-61ab0e59-7566-4edc-a91c-63e4836b0186 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0431b1f25497443ba483b3c440669080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e36ab03283d4ce6a2fed5e111e03d34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129322) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:40:08.069603 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: INFO nova.api.openstack.requestlog [None req-61ab0e59-7566-4edc-a91c-63e4836b0186 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] 10.222.0.75 "GET /compute/v2.1/servers/605b9171-aa87-432a-b179-c552640e73dd" status: 200 len: 1522 microversion: 2.1 time: 0.152350 May 26 12:40:08.070158 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: [pid: 129322|app: 0|req: 139/269] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 26 12:40:07 2022] GET /compute/v2.1/servers/605b9171-aa87-432a-b179-c552640e73dd => generated 1522 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:40:08.284041 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi [None req-a7a93975-6d86-4dfa-b3ee-10901b005257 tempest-VolumesSnapshotTestJSON-1904508205 tempest-VolumesSnapshotTestJSON-1904508205-project] Calling method '>' {{(pid=129321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:40:08.285052 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.compute.api [None req-a7a93975-6d86-4dfa-b3ee-10901b005257 tempest-VolumesSnapshotTestJSON-1904508205 tempest-VolumesSnapshotTestJSON-1904508205-project] [instance: f392ba2b-2b88-4b1a-be61-0cf28ed1443a] Fetching instance by UUID {{(pid=129321) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:40:08.295490 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-a7a93975-6d86-4dfa-b3ee-10901b005257 tempest-VolumesSnapshotTestJSON-1904508205 tempest-VolumesSnapshotTestJSON-1904508205-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:40:08.296607 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-a7a93975-6d86-4dfa-b3ee-10901b005257 tempest-VolumesSnapshotTestJSON-1904508205 tempest-VolumesSnapshotTestJSON-1904508205-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:40:08.297870 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-a7a93975-6d86-4dfa-b3ee-10901b005257 tempest-VolumesSnapshotTestJSON-1904508205 tempest-VolumesSnapshotTestJSON-1904508205-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:40:08.298589 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-a7a93975-6d86-4dfa-b3ee-10901b005257 tempest-VolumesSnapshotTestJSON-1904508205 tempest-VolumesSnapshotTestJSON-1904508205-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:40:08.431594 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.policy [None req-a7a93975-6d86-4dfa-b3ee-10901b005257 tempest-VolumesSnapshotTestJSON-1904508205 tempest-VolumesSnapshotTestJSON-1904508205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '805854e5ce2e412fb9420afd63f73ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72bda4cbb07a43688506e01d06ba89c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129321) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:40:08.439407 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: INFO nova.api.openstack.requestlog [None req-a7a93975-6d86-4dfa-b3ee-10901b005257 tempest-VolumesSnapshotTestJSON-1904508205 tempest-VolumesSnapshotTestJSON-1904508205-project] 10.222.0.75 "GET /compute/v2.1/servers/f392ba2b-2b88-4b1a-be61-0cf28ed1443a" status: 200 len: 1507 microversion: 2.1 time: 0.161870 May 26 12:40:08.440009 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: [pid: 129321|app: 0|req: 131/270] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 26 12:40:08 2022] GET /compute/v2.1/servers/f392ba2b-2b88-4b1a-be61-0cf28ed1443a => generated 1507 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:40:09.089686 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi [None req-69620cf3-701d-4737-85f2-a9f93e7ab3dd tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Calling method '>' {{(pid=129322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:40:09.090344 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.compute.api [None req-69620cf3-701d-4737-85f2-a9f93e7ab3dd tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] [instance: 605b9171-aa87-432a-b179-c552640e73dd] Fetching instance by UUID {{(pid=129322) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:40:09.098283 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-69620cf3-701d-4737-85f2-a9f93e7ab3dd tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:40:09.098805 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-69620cf3-701d-4737-85f2-a9f93e7ab3dd tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:40:09.099743 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-69620cf3-701d-4737-85f2-a9f93e7ab3dd tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:40:09.100243 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-69620cf3-701d-4737-85f2-a9f93e7ab3dd tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:40:09.238244 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.policy [None req-69620cf3-701d-4737-85f2-a9f93e7ab3dd tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0431b1f25497443ba483b3c440669080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e36ab03283d4ce6a2fed5e111e03d34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129322) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:40:09.246522 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: INFO nova.api.openstack.requestlog [None req-69620cf3-701d-4737-85f2-a9f93e7ab3dd tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] 10.222.0.75 "GET /compute/v2.1/servers/605b9171-aa87-432a-b179-c552640e73dd" status: 200 len: 1522 microversion: 2.1 time: 0.162752 May 26 12:40:09.247112 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: [pid: 129322|app: 0|req: 140/271] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 26 12:40:09 2022] GET /compute/v2.1/servers/605b9171-aa87-432a-b179-c552640e73dd => generated 1522 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:40:10.268410 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi [None req-941458b7-2bf7-4890-8cd9-fd90f52e8146 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Calling method '>' {{(pid=129321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:40:10.269357 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.compute.api [None req-941458b7-2bf7-4890-8cd9-fd90f52e8146 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] [instance: 605b9171-aa87-432a-b179-c552640e73dd] Fetching instance by UUID {{(pid=129321) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:40:10.280256 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-941458b7-2bf7-4890-8cd9-fd90f52e8146 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:40:10.280986 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-941458b7-2bf7-4890-8cd9-fd90f52e8146 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:40:10.282261 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-941458b7-2bf7-4890-8cd9-fd90f52e8146 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:40:10.282924 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-941458b7-2bf7-4890-8cd9-fd90f52e8146 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:40:10.421226 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.policy [None req-941458b7-2bf7-4890-8cd9-fd90f52e8146 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0431b1f25497443ba483b3c440669080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e36ab03283d4ce6a2fed5e111e03d34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129321) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:40:10.432467 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: INFO nova.api.openstack.requestlog [None req-941458b7-2bf7-4890-8cd9-fd90f52e8146 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] 10.222.0.75 "GET /compute/v2.1/servers/605b9171-aa87-432a-b179-c552640e73dd" status: 200 len: 1522 microversion: 2.1 time: 0.170361 May 26 12:40:10.433207 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: [pid: 129321|app: 0|req: 132/272] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 26 12:40:10 2022] GET /compute/v2.1/servers/605b9171-aa87-432a-b179-c552640e73dd => generated 1522 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:40:11.454077 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi [None req-2e18acea-a22f-4769-926d-68052506eff7 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Calling method '>' {{(pid=129322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:40:11.454727 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.compute.api [None req-2e18acea-a22f-4769-926d-68052506eff7 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] [instance: 605b9171-aa87-432a-b179-c552640e73dd] Fetching instance by UUID {{(pid=129322) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:40:11.461405 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-2e18acea-a22f-4769-926d-68052506eff7 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:40:11.461852 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-2e18acea-a22f-4769-926d-68052506eff7 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:40:11.462713 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-2e18acea-a22f-4769-926d-68052506eff7 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:40:11.463147 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-2e18acea-a22f-4769-926d-68052506eff7 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:40:11.594179 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.policy [None req-2e18acea-a22f-4769-926d-68052506eff7 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0431b1f25497443ba483b3c440669080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e36ab03283d4ce6a2fed5e111e03d34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129322) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:40:11.601764 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: INFO nova.api.openstack.requestlog [None req-2e18acea-a22f-4769-926d-68052506eff7 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] 10.222.0.75 "GET /compute/v2.1/servers/605b9171-aa87-432a-b179-c552640e73dd" status: 200 len: 1522 microversion: 2.1 time: 0.151530 May 26 12:40:11.602324 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: [pid: 129322|app: 0|req: 141/273] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 26 12:40:11 2022] GET /compute/v2.1/servers/605b9171-aa87-432a-b179-c552640e73dd => generated 1522 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:40:12.619993 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi [None req-e41689e0-82fb-4f62-9ca6-1c2110a04270 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Calling method '>' {{(pid=129321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:40:12.620543 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.compute.api [None req-e41689e0-82fb-4f62-9ca6-1c2110a04270 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] [instance: 605b9171-aa87-432a-b179-c552640e73dd] Fetching instance by UUID {{(pid=129321) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:40:12.626924 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-e41689e0-82fb-4f62-9ca6-1c2110a04270 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:40:12.627373 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-e41689e0-82fb-4f62-9ca6-1c2110a04270 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:40:12.628164 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-e41689e0-82fb-4f62-9ca6-1c2110a04270 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:40:12.628595 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-e41689e0-82fb-4f62-9ca6-1c2110a04270 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:40:12.772427 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.policy [None req-e41689e0-82fb-4f62-9ca6-1c2110a04270 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0431b1f25497443ba483b3c440669080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e36ab03283d4ce6a2fed5e111e03d34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129321) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:40:12.780747 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: INFO nova.api.openstack.requestlog [None req-e41689e0-82fb-4f62-9ca6-1c2110a04270 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] 10.222.0.75 "GET /compute/v2.1/servers/605b9171-aa87-432a-b179-c552640e73dd" status: 200 len: 1522 microversion: 2.1 time: 0.165371 May 26 12:40:12.781323 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: [pid: 129321|app: 0|req: 133/274] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 26 12:40:12 2022] GET /compute/v2.1/servers/605b9171-aa87-432a-b179-c552640e73dd => generated 1522 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:40:13.799074 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi [None req-23b15d5d-0e97-41f9-8e3d-b7dbda1f9749 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Calling method '>' {{(pid=129322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:40:13.799892 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.compute.api [None req-23b15d5d-0e97-41f9-8e3d-b7dbda1f9749 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] [instance: 605b9171-aa87-432a-b179-c552640e73dd] Fetching instance by UUID {{(pid=129322) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:40:13.806565 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-23b15d5d-0e97-41f9-8e3d-b7dbda1f9749 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:40:13.807020 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-23b15d5d-0e97-41f9-8e3d-b7dbda1f9749 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:40:13.807826 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-23b15d5d-0e97-41f9-8e3d-b7dbda1f9749 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:40:13.808427 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-23b15d5d-0e97-41f9-8e3d-b7dbda1f9749 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:40:13.942520 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.policy [None req-23b15d5d-0e97-41f9-8e3d-b7dbda1f9749 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0431b1f25497443ba483b3c440669080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e36ab03283d4ce6a2fed5e111e03d34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129322) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:40:13.950128 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: INFO nova.api.openstack.requestlog [None req-23b15d5d-0e97-41f9-8e3d-b7dbda1f9749 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] 10.222.0.75 "GET /compute/v2.1/servers/605b9171-aa87-432a-b179-c552640e73dd" status: 200 len: 1522 microversion: 2.1 time: 0.154954 May 26 12:40:13.950966 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: [pid: 129322|app: 0|req: 142/275] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 26 12:40:13 2022] GET /compute/v2.1/servers/605b9171-aa87-432a-b179-c552640e73dd => generated 1522 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:40:14.967087 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi [None req-305dd34d-8668-4c92-a2a2-9b6af6bf7591 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Calling method '>' {{(pid=129321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:40:14.967724 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.compute.api [None req-305dd34d-8668-4c92-a2a2-9b6af6bf7591 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] [instance: 605b9171-aa87-432a-b179-c552640e73dd] Fetching instance by UUID {{(pid=129321) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:40:14.974487 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-305dd34d-8668-4c92-a2a2-9b6af6bf7591 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:40:14.974934 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-305dd34d-8668-4c92-a2a2-9b6af6bf7591 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:40:14.975784 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-305dd34d-8668-4c92-a2a2-9b6af6bf7591 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:40:14.976200 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-305dd34d-8668-4c92-a2a2-9b6af6bf7591 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:40:15.133188 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.policy [None req-305dd34d-8668-4c92-a2a2-9b6af6bf7591 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0431b1f25497443ba483b3c440669080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e36ab03283d4ce6a2fed5e111e03d34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129321) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:40:15.141287 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: INFO nova.api.openstack.requestlog [None req-305dd34d-8668-4c92-a2a2-9b6af6bf7591 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] 10.222.0.75 "GET /compute/v2.1/servers/605b9171-aa87-432a-b179-c552640e73dd" status: 200 len: 1522 microversion: 2.1 time: 0.178121 May 26 12:40:15.142177 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: [pid: 129321|app: 0|req: 134/276] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 26 12:40:14 2022] GET /compute/v2.1/servers/605b9171-aa87-432a-b179-c552640e73dd => generated 1522 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:40:16.158843 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi [None req-d8f9a803-2260-4f2e-925f-a210c09d41b8 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Calling method '>' {{(pid=129322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:40:16.159460 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.compute.api [None req-d8f9a803-2260-4f2e-925f-a210c09d41b8 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] [instance: 605b9171-aa87-432a-b179-c552640e73dd] Fetching instance by UUID {{(pid=129322) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:40:16.166463 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-d8f9a803-2260-4f2e-925f-a210c09d41b8 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:40:16.166910 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-d8f9a803-2260-4f2e-925f-a210c09d41b8 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:40:16.167830 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-d8f9a803-2260-4f2e-925f-a210c09d41b8 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:40:16.168429 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-d8f9a803-2260-4f2e-925f-a210c09d41b8 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:40:16.303436 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.policy [None req-d8f9a803-2260-4f2e-925f-a210c09d41b8 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0431b1f25497443ba483b3c440669080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e36ab03283d4ce6a2fed5e111e03d34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129322) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:40:16.311091 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: INFO nova.api.openstack.requestlog [None req-d8f9a803-2260-4f2e-925f-a210c09d41b8 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] 10.222.0.75 "GET /compute/v2.1/servers/605b9171-aa87-432a-b179-c552640e73dd" status: 200 len: 1522 microversion: 2.1 time: 0.156703 May 26 12:40:16.311680 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: [pid: 129322|app: 0|req: 143/277] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 26 12:40:16 2022] GET /compute/v2.1/servers/605b9171-aa87-432a-b179-c552640e73dd => generated 1522 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:40:17.328470 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi [None req-050b7e57-d70a-42a3-bc4a-b4cbe2536b1b tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Calling method '>' {{(pid=129321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:40:17.329147 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.compute.api [None req-050b7e57-d70a-42a3-bc4a-b4cbe2536b1b tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] [instance: 605b9171-aa87-432a-b179-c552640e73dd] Fetching instance by UUID {{(pid=129321) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:40:17.335847 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-050b7e57-d70a-42a3-bc4a-b4cbe2536b1b tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:40:17.336269 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-050b7e57-d70a-42a3-bc4a-b4cbe2536b1b tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:40:17.337043 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-050b7e57-d70a-42a3-bc4a-b4cbe2536b1b tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:40:17.337478 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-050b7e57-d70a-42a3-bc4a-b4cbe2536b1b tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:40:17.474837 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.policy [None req-050b7e57-d70a-42a3-bc4a-b4cbe2536b1b tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0431b1f25497443ba483b3c440669080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e36ab03283d4ce6a2fed5e111e03d34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129321) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:40:17.482800 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: INFO nova.api.openstack.requestlog [None req-050b7e57-d70a-42a3-bc4a-b4cbe2536b1b tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] 10.222.0.75 "GET /compute/v2.1/servers/605b9171-aa87-432a-b179-c552640e73dd" status: 200 len: 1522 microversion: 2.1 time: 0.158339 May 26 12:40:17.483368 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: [pid: 129321|app: 0|req: 135/278] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 26 12:40:17 2022] GET /compute/v2.1/servers/605b9171-aa87-432a-b179-c552640e73dd => generated 1522 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:40:18.499743 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi [None req-b5ed2f2f-33e5-4048-9373-1cdcd4d1bed3 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Calling method '>' {{(pid=129322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:40:18.500942 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.compute.api [None req-b5ed2f2f-33e5-4048-9373-1cdcd4d1bed3 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] [instance: 605b9171-aa87-432a-b179-c552640e73dd] Fetching instance by UUID {{(pid=129322) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:40:18.510588 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-b5ed2f2f-33e5-4048-9373-1cdcd4d1bed3 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:40:18.511029 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-b5ed2f2f-33e5-4048-9373-1cdcd4d1bed3 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:40:18.511823 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-b5ed2f2f-33e5-4048-9373-1cdcd4d1bed3 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:40:18.512250 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-b5ed2f2f-33e5-4048-9373-1cdcd4d1bed3 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:40:18.651571 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.policy [None req-b5ed2f2f-33e5-4048-9373-1cdcd4d1bed3 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0431b1f25497443ba483b3c440669080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e36ab03283d4ce6a2fed5e111e03d34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129322) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:40:18.658023 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: INFO nova.api.openstack.requestlog [None req-b5ed2f2f-33e5-4048-9373-1cdcd4d1bed3 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] 10.222.0.75 "GET /compute/v2.1/servers/605b9171-aa87-432a-b179-c552640e73dd" status: 200 len: 1522 microversion: 2.1 time: 0.162838 May 26 12:40:18.658603 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: [pid: 129322|app: 0|req: 144/279] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 26 12:40:18 2022] GET /compute/v2.1/servers/605b9171-aa87-432a-b179-c552640e73dd => generated 1522 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:40:19.674383 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi [None req-87e56261-2e6b-4817-ace6-23990eb20791 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Calling method '>' {{(pid=129321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:40:19.675030 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.compute.api [None req-87e56261-2e6b-4817-ace6-23990eb20791 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] [instance: 605b9171-aa87-432a-b179-c552640e73dd] Fetching instance by UUID {{(pid=129321) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:40:19.681281 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-87e56261-2e6b-4817-ace6-23990eb20791 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:40:19.681740 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-87e56261-2e6b-4817-ace6-23990eb20791 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:40:19.682524 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-87e56261-2e6b-4817-ace6-23990eb20791 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:40:19.682953 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-87e56261-2e6b-4817-ace6-23990eb20791 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:40:19.820634 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.policy [None req-87e56261-2e6b-4817-ace6-23990eb20791 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0431b1f25497443ba483b3c440669080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e36ab03283d4ce6a2fed5e111e03d34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129321) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:40:19.829486 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: INFO nova.api.openstack.requestlog [None req-87e56261-2e6b-4817-ace6-23990eb20791 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] 10.222.0.75 "GET /compute/v2.1/servers/605b9171-aa87-432a-b179-c552640e73dd" status: 200 len: 1522 microversion: 2.1 time: 0.158712 May 26 12:40:19.830074 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: [pid: 129321|app: 0|req: 136/280] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 26 12:40:19 2022] GET /compute/v2.1/servers/605b9171-aa87-432a-b179-c552640e73dd => generated 1522 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:40:20.846735 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi [None req-4f1b408c-1351-4d5d-8a22-16bf630c7486 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Calling method '>' {{(pid=129322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:40:20.848026 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.compute.api [None req-4f1b408c-1351-4d5d-8a22-16bf630c7486 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] [instance: 605b9171-aa87-432a-b179-c552640e73dd] Fetching instance by UUID {{(pid=129322) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:40:20.856072 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-4f1b408c-1351-4d5d-8a22-16bf630c7486 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:40:20.856720 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-4f1b408c-1351-4d5d-8a22-16bf630c7486 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:40:20.857831 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-4f1b408c-1351-4d5d-8a22-16bf630c7486 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:40:20.858616 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-4f1b408c-1351-4d5d-8a22-16bf630c7486 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:40:21.016116 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.policy [None req-4f1b408c-1351-4d5d-8a22-16bf630c7486 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0431b1f25497443ba483b3c440669080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e36ab03283d4ce6a2fed5e111e03d34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129322) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:40:21.027142 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: INFO nova.api.openstack.requestlog [None req-4f1b408c-1351-4d5d-8a22-16bf630c7486 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] 10.222.0.75 "GET /compute/v2.1/servers/605b9171-aa87-432a-b179-c552640e73dd" status: 200 len: 1522 microversion: 2.1 time: 0.184366 May 26 12:40:21.028476 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: [pid: 129322|app: 0|req: 145/281] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 26 12:40:20 2022] GET /compute/v2.1/servers/605b9171-aa87-432a-b179-c552640e73dd => generated 1522 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:40:22.044628 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi [None req-3014fd80-29a6-4e3a-a44e-bf8610fa1ccf tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Calling method '>' {{(pid=129321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:40:22.045840 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.compute.api [None req-3014fd80-29a6-4e3a-a44e-bf8610fa1ccf tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] [instance: 605b9171-aa87-432a-b179-c552640e73dd] Fetching instance by UUID {{(pid=129321) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:40:22.053600 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-3014fd80-29a6-4e3a-a44e-bf8610fa1ccf tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:40:22.054040 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-3014fd80-29a6-4e3a-a44e-bf8610fa1ccf tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:40:22.055182 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-3014fd80-29a6-4e3a-a44e-bf8610fa1ccf tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:40:22.055631 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-3014fd80-29a6-4e3a-a44e-bf8610fa1ccf tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:40:22.195417 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.policy [None req-3014fd80-29a6-4e3a-a44e-bf8610fa1ccf tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0431b1f25497443ba483b3c440669080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e36ab03283d4ce6a2fed5e111e03d34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129321) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:40:22.204507 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: INFO nova.api.openstack.requestlog [None req-3014fd80-29a6-4e3a-a44e-bf8610fa1ccf tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] 10.222.0.75 "GET /compute/v2.1/servers/605b9171-aa87-432a-b179-c552640e73dd" status: 200 len: 1502 microversion: 2.1 time: 0.163841 May 26 12:40:22.205245 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: [pid: 129321|app: 0|req: 137/282] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 26 12:40:22 2022] GET /compute/v2.1/servers/605b9171-aa87-432a-b179-c552640e73dd => generated 1502 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:40:22.222026 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi [None req-296192dd-7785-4fb7-8a3c-21ebce2fd872 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Calling method '>' {{(pid=129322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:40:22.222637 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.compute.api [None req-296192dd-7785-4fb7-8a3c-21ebce2fd872 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] [instance: f9200aab-6f49-4e6f-812b-93b2f3e1edd9] Fetching instance by UUID {{(pid=129322) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:40:22.229283 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-296192dd-7785-4fb7-8a3c-21ebce2fd872 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:40:22.229738 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-296192dd-7785-4fb7-8a3c-21ebce2fd872 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:40:22.230509 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-296192dd-7785-4fb7-8a3c-21ebce2fd872 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:40:22.230958 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-296192dd-7785-4fb7-8a3c-21ebce2fd872 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:40:22.374299 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.policy [None req-296192dd-7785-4fb7-8a3c-21ebce2fd872 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0431b1f25497443ba483b3c440669080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e36ab03283d4ce6a2fed5e111e03d34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129322) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:40:22.382303 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: INFO nova.api.openstack.requestlog [None req-296192dd-7785-4fb7-8a3c-21ebce2fd872 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] 10.222.0.75 "GET /compute/v2.1/servers/f9200aab-6f49-4e6f-812b-93b2f3e1edd9" status: 200 len: 1515 microversion: 2.1 time: 0.164793 May 26 12:40:22.382945 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: [pid: 129322|app: 0|req: 146/283] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 26 12:40:22 2022] GET /compute/v2.1/servers/f9200aab-6f49-4e6f-812b-93b2f3e1edd9 => generated 1515 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:40:36.430430 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi [None req-62c0f3e7-d2bf-47ce-bf9a-3aa566adc762 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=129321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 12:40:36.431869 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.compute.api [None req-62c0f3e7-d2bf-47ce-bf9a-3aa566adc762 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] [instance: f9200aab-6f49-4e6f-812b-93b2f3e1edd9] Fetching instance by UUID {{(pid=129321) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:40:36.436383 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG dbcounter [-] [129321] Writing DB stats nova_api:SELECT=19 {{(pid=129321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:40:36.438238 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG dbcounter [-] [129321] Writing DB stats nova_cell1:SELECT=58 {{(pid=129321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:40:36.449254 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-62c0f3e7-d2bf-47ce-bf9a-3aa566adc762 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:40:36.449770 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-62c0f3e7-d2bf-47ce-bf9a-3aa566adc762 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:40:36.450509 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-62c0f3e7-d2bf-47ce-bf9a-3aa566adc762 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:40:36.450937 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-62c0f3e7-d2bf-47ce-bf9a-3aa566adc762 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:40:36.477279 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.objects.instance [None req-62c0f3e7-d2bf-47ce-bf9a-3aa566adc762 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lazy-loading 'flavor' on Instance uuid f9200aab-6f49-4e6f-812b-93b2f3e1edd9 {{(pid=129321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 26 12:40:36.554688 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: INFO nova.api.openstack.requestlog [None req-62c0f3e7-d2bf-47ce-bf9a-3aa566adc762 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] 10.222.0.75 "POST /compute/v2.1/servers/f9200aab-6f49-4e6f-812b-93b2f3e1edd9/action" status: 200 len: 32 microversion: 2.1 time: 0.131124 May 26 12:40:36.555312 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: [pid: 129321|app: 0|req: 138/284] 10.222.0.75 () {60 vars in 1277 bytes} [Thu May 26 12:40:36 2022] POST /compute/v2.1/servers/f9200aab-6f49-4e6f-812b-93b2f3e1edd9/action => generated 32 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 26 12:40:36.565124 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi [None req-29627c3d-3f7e-4280-a73d-af4a0711ca65 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Calling method '>' {{(pid=129322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:40:36.565728 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.compute.api [None req-29627c3d-3f7e-4280-a73d-af4a0711ca65 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] [instance: f9200aab-6f49-4e6f-812b-93b2f3e1edd9] Fetching instance by UUID {{(pid=129322) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:40:36.567802 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG dbcounter [-] [129322] Writing DB stats nova_api:SELECT=23 {{(pid=129322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:40:36.568450 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG dbcounter [-] [129322] Writing DB stats nova_cell1:SELECT=64 {{(pid=129322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:40:36.574399 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-29627c3d-3f7e-4280-a73d-af4a0711ca65 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:40:36.574922 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-29627c3d-3f7e-4280-a73d-af4a0711ca65 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:40:36.575750 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-29627c3d-3f7e-4280-a73d-af4a0711ca65 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:40:36.576400 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-29627c3d-3f7e-4280-a73d-af4a0711ca65 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:40:36.727836 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.policy [None req-29627c3d-3f7e-4280-a73d-af4a0711ca65 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0431b1f25497443ba483b3c440669080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e36ab03283d4ce6a2fed5e111e03d34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129322) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:40:36.735914 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: INFO nova.api.openstack.requestlog [None req-29627c3d-3f7e-4280-a73d-af4a0711ca65 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] 10.222.0.75 "GET /compute/v2.1/servers/f9200aab-6f49-4e6f-812b-93b2f3e1edd9" status: 200 len: 1521 microversion: 2.1 time: 0.174857 May 26 12:40:36.736489 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: [pid: 129322|app: 0|req: 147/285] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 26 12:40:36 2022] GET /compute/v2.1/servers/f9200aab-6f49-4e6f-812b-93b2f3e1edd9 => generated 1521 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 12:40:37.758074 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi [None req-835a86d9-2f58-4d65-8d34-843589a42903 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Calling method '>' {{(pid=129321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:40:37.759036 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.compute.api [None req-835a86d9-2f58-4d65-8d34-843589a42903 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] [instance: f9200aab-6f49-4e6f-812b-93b2f3e1edd9] Fetching instance by UUID {{(pid=129321) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:40:37.766729 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-835a86d9-2f58-4d65-8d34-843589a42903 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:40:37.767226 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-835a86d9-2f58-4d65-8d34-843589a42903 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:40:37.768027 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-835a86d9-2f58-4d65-8d34-843589a42903 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:40:37.768454 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-835a86d9-2f58-4d65-8d34-843589a42903 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:40:37.904178 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.policy [None req-835a86d9-2f58-4d65-8d34-843589a42903 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0431b1f25497443ba483b3c440669080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e36ab03283d4ce6a2fed5e111e03d34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129321) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:40:37.911877 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: INFO nova.api.openstack.requestlog [None req-835a86d9-2f58-4d65-8d34-843589a42903 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] 10.222.0.75 "GET /compute/v2.1/servers/f9200aab-6f49-4e6f-812b-93b2f3e1edd9" status: 200 len: 1521 microversion: 2.1 time: 0.160998 May 26 12:40:37.912447 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: [pid: 129321|app: 0|req: 139/286] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 26 12:40:37 2022] GET /compute/v2.1/servers/f9200aab-6f49-4e6f-812b-93b2f3e1edd9 => generated 1521 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:40:38.933237 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi [None req-1370d82f-4d16-4fdf-a329-d83533cda362 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Calling method '>' {{(pid=129322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:40:38.934016 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.compute.api [None req-1370d82f-4d16-4fdf-a329-d83533cda362 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] [instance: f9200aab-6f49-4e6f-812b-93b2f3e1edd9] Fetching instance by UUID {{(pid=129322) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:40:38.941288 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-1370d82f-4d16-4fdf-a329-d83533cda362 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:40:38.941767 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-1370d82f-4d16-4fdf-a329-d83533cda362 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:40:38.942566 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-1370d82f-4d16-4fdf-a329-d83533cda362 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:40:38.943021 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-1370d82f-4d16-4fdf-a329-d83533cda362 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:40:39.074857 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.policy [None req-1370d82f-4d16-4fdf-a329-d83533cda362 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0431b1f25497443ba483b3c440669080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e36ab03283d4ce6a2fed5e111e03d34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129322) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:40:39.082546 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: INFO nova.api.openstack.requestlog [None req-1370d82f-4d16-4fdf-a329-d83533cda362 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] 10.222.0.75 "GET /compute/v2.1/servers/f9200aab-6f49-4e6f-812b-93b2f3e1edd9" status: 200 len: 1521 microversion: 2.1 time: 0.156021 May 26 12:40:39.083120 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: [pid: 129322|app: 0|req: 148/287] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 26 12:40:38 2022] GET /compute/v2.1/servers/f9200aab-6f49-4e6f-812b-93b2f3e1edd9 => generated 1521 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:40:40.099170 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi [None req-12073251-3752-495d-8d16-9513c22e757f tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Calling method '>' {{(pid=129321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:40:40.099823 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.compute.api [None req-12073251-3752-495d-8d16-9513c22e757f tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] [instance: f9200aab-6f49-4e6f-812b-93b2f3e1edd9] Fetching instance by UUID {{(pid=129321) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:40:40.106364 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-12073251-3752-495d-8d16-9513c22e757f tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:40:40.106808 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-12073251-3752-495d-8d16-9513c22e757f tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:40:40.107572 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-12073251-3752-495d-8d16-9513c22e757f tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:40:40.108106 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-12073251-3752-495d-8d16-9513c22e757f tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:40:40.241275 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.policy [None req-12073251-3752-495d-8d16-9513c22e757f tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0431b1f25497443ba483b3c440669080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e36ab03283d4ce6a2fed5e111e03d34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129321) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:40:40.249159 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: INFO nova.api.openstack.requestlog [None req-12073251-3752-495d-8d16-9513c22e757f tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] 10.222.0.75 "GET /compute/v2.1/servers/f9200aab-6f49-4e6f-812b-93b2f3e1edd9" status: 200 len: 1521 microversion: 2.1 time: 0.153858 May 26 12:40:40.249736 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: [pid: 129321|app: 0|req: 140/288] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 26 12:40:40 2022] GET /compute/v2.1/servers/f9200aab-6f49-4e6f-812b-93b2f3e1edd9 => generated 1521 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:40:41.271041 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi [None req-9559f2dd-109f-4e8b-b21b-0e1202ac5b03 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Calling method '>' {{(pid=129322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:40:41.272478 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.compute.api [None req-9559f2dd-109f-4e8b-b21b-0e1202ac5b03 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] [instance: f9200aab-6f49-4e6f-812b-93b2f3e1edd9] Fetching instance by UUID {{(pid=129322) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:40:41.283618 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-9559f2dd-109f-4e8b-b21b-0e1202ac5b03 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:40:41.284418 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-9559f2dd-109f-4e8b-b21b-0e1202ac5b03 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:40:41.285666 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-9559f2dd-109f-4e8b-b21b-0e1202ac5b03 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:40:41.286386 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-9559f2dd-109f-4e8b-b21b-0e1202ac5b03 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:40:41.422871 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.policy [None req-9559f2dd-109f-4e8b-b21b-0e1202ac5b03 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0431b1f25497443ba483b3c440669080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e36ab03283d4ce6a2fed5e111e03d34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129322) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:40:41.434124 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: INFO nova.api.openstack.requestlog [None req-9559f2dd-109f-4e8b-b21b-0e1202ac5b03 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] 10.222.0.75 "GET /compute/v2.1/servers/f9200aab-6f49-4e6f-812b-93b2f3e1edd9" status: 200 len: 1521 microversion: 2.1 time: 0.169923 May 26 12:40:41.434880 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: [pid: 129322|app: 0|req: 149/289] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 26 12:40:41 2022] GET /compute/v2.1/servers/f9200aab-6f49-4e6f-812b-93b2f3e1edd9 => generated 1521 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:40:42.457045 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi [None req-63c2fda5-4ef8-4557-a100-d27eefdc2be4 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Calling method '>' {{(pid=129321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:40:42.457674 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.compute.api [None req-63c2fda5-4ef8-4557-a100-d27eefdc2be4 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] [instance: f9200aab-6f49-4e6f-812b-93b2f3e1edd9] Fetching instance by UUID {{(pid=129321) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:40:42.464041 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-63c2fda5-4ef8-4557-a100-d27eefdc2be4 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:40:42.464484 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-63c2fda5-4ef8-4557-a100-d27eefdc2be4 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:40:42.465227 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-63c2fda5-4ef8-4557-a100-d27eefdc2be4 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:40:42.465716 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-63c2fda5-4ef8-4557-a100-d27eefdc2be4 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:40:42.602375 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.policy [None req-63c2fda5-4ef8-4557-a100-d27eefdc2be4 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0431b1f25497443ba483b3c440669080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e36ab03283d4ce6a2fed5e111e03d34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129321) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:40:42.610199 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: INFO nova.api.openstack.requestlog [None req-63c2fda5-4ef8-4557-a100-d27eefdc2be4 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] 10.222.0.75 "GET /compute/v2.1/servers/f9200aab-6f49-4e6f-812b-93b2f3e1edd9" status: 200 len: 1521 microversion: 2.1 time: 0.157022 May 26 12:40:42.610750 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: [pid: 129321|app: 0|req: 141/290] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 26 12:40:42 2022] GET /compute/v2.1/servers/f9200aab-6f49-4e6f-812b-93b2f3e1edd9 => generated 1521 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:40:43.626604 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi [None req-2a85e299-3770-40ae-bd4d-39b47c95cfba tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Calling method '>' {{(pid=129322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:40:43.627098 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.compute.api [None req-2a85e299-3770-40ae-bd4d-39b47c95cfba tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] [instance: f9200aab-6f49-4e6f-812b-93b2f3e1edd9] Fetching instance by UUID {{(pid=129322) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:40:43.634067 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-2a85e299-3770-40ae-bd4d-39b47c95cfba tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:40:43.634520 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-2a85e299-3770-40ae-bd4d-39b47c95cfba tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:40:43.635428 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-2a85e299-3770-40ae-bd4d-39b47c95cfba tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:40:43.636019 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-2a85e299-3770-40ae-bd4d-39b47c95cfba tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:40:43.770289 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.policy [None req-2a85e299-3770-40ae-bd4d-39b47c95cfba tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0431b1f25497443ba483b3c440669080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e36ab03283d4ce6a2fed5e111e03d34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129322) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:40:43.778678 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: INFO nova.api.openstack.requestlog [None req-2a85e299-3770-40ae-bd4d-39b47c95cfba tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] 10.222.0.75 "GET /compute/v2.1/servers/f9200aab-6f49-4e6f-812b-93b2f3e1edd9" status: 200 len: 1521 microversion: 2.1 time: 0.156404 May 26 12:40:43.779667 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: [pid: 129322|app: 0|req: 150/291] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 26 12:40:43 2022] GET /compute/v2.1/servers/f9200aab-6f49-4e6f-812b-93b2f3e1edd9 => generated 1521 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:40:44.794633 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi [None req-14cd4468-3512-4247-b56a-0a8b11e3cfcd tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Calling method '>' {{(pid=129321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:40:44.795236 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.compute.api [None req-14cd4468-3512-4247-b56a-0a8b11e3cfcd tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] [instance: f9200aab-6f49-4e6f-812b-93b2f3e1edd9] Fetching instance by UUID {{(pid=129321) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:40:44.801905 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-14cd4468-3512-4247-b56a-0a8b11e3cfcd tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:40:44.802544 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-14cd4468-3512-4247-b56a-0a8b11e3cfcd tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:40:44.803377 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-14cd4468-3512-4247-b56a-0a8b11e3cfcd tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:40:44.804050 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-14cd4468-3512-4247-b56a-0a8b11e3cfcd tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:40:44.994047 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.policy [None req-14cd4468-3512-4247-b56a-0a8b11e3cfcd tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0431b1f25497443ba483b3c440669080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e36ab03283d4ce6a2fed5e111e03d34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129321) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:40:45.005130 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: INFO nova.api.openstack.requestlog [None req-14cd4468-3512-4247-b56a-0a8b11e3cfcd tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] 10.222.0.75 "GET /compute/v2.1/servers/f9200aab-6f49-4e6f-812b-93b2f3e1edd9" status: 200 len: 1521 microversion: 2.1 time: 0.214249 May 26 12:40:45.005807 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: [pid: 129321|app: 0|req: 142/292] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 26 12:40:44 2022] GET /compute/v2.1/servers/f9200aab-6f49-4e6f-812b-93b2f3e1edd9 => generated 1521 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:40:46.023152 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi [None req-3c61ade9-a47a-4aeb-a525-5aee58fe302e tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Calling method '>' {{(pid=129322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:40:46.024665 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.compute.api [None req-3c61ade9-a47a-4aeb-a525-5aee58fe302e tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] [instance: f9200aab-6f49-4e6f-812b-93b2f3e1edd9] Fetching instance by UUID {{(pid=129322) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:40:46.032629 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-3c61ade9-a47a-4aeb-a525-5aee58fe302e tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:40:46.033073 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-3c61ade9-a47a-4aeb-a525-5aee58fe302e tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:40:46.033833 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-3c61ade9-a47a-4aeb-a525-5aee58fe302e tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:40:46.034265 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-3c61ade9-a47a-4aeb-a525-5aee58fe302e tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:40:46.191987 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.policy [None req-3c61ade9-a47a-4aeb-a525-5aee58fe302e tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0431b1f25497443ba483b3c440669080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e36ab03283d4ce6a2fed5e111e03d34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129322) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:40:46.200224 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: INFO nova.api.openstack.requestlog [None req-3c61ade9-a47a-4aeb-a525-5aee58fe302e tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] 10.222.0.75 "GET /compute/v2.1/servers/f9200aab-6f49-4e6f-812b-93b2f3e1edd9" status: 200 len: 1521 microversion: 2.1 time: 0.182765 May 26 12:40:46.200971 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: [pid: 129322|app: 0|req: 151/293] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 26 12:40:46 2022] GET /compute/v2.1/servers/f9200aab-6f49-4e6f-812b-93b2f3e1edd9 => generated 1521 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:40:47.220543 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi [None req-d9260c7f-56e0-45e0-b21d-68964621fbd7 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Calling method '>' {{(pid=129321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:40:47.221135 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.compute.api [None req-d9260c7f-56e0-45e0-b21d-68964621fbd7 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] [instance: f9200aab-6f49-4e6f-812b-93b2f3e1edd9] Fetching instance by UUID {{(pid=129321) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:40:47.230495 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-d9260c7f-56e0-45e0-b21d-68964621fbd7 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:40:47.231238 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-d9260c7f-56e0-45e0-b21d-68964621fbd7 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:40:47.232369 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-d9260c7f-56e0-45e0-b21d-68964621fbd7 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:40:47.232793 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-d9260c7f-56e0-45e0-b21d-68964621fbd7 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:40:47.392897 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.policy [None req-d9260c7f-56e0-45e0-b21d-68964621fbd7 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0431b1f25497443ba483b3c440669080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e36ab03283d4ce6a2fed5e111e03d34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129321) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:40:47.405224 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: INFO nova.api.openstack.requestlog [None req-d9260c7f-56e0-45e0-b21d-68964621fbd7 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] 10.222.0.75 "GET /compute/v2.1/servers/f9200aab-6f49-4e6f-812b-93b2f3e1edd9" status: 200 len: 1521 microversion: 2.1 time: 0.189611 May 26 12:40:47.406161 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: [pid: 129321|app: 0|req: 143/294] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 26 12:40:47 2022] GET /compute/v2.1/servers/f9200aab-6f49-4e6f-812b-93b2f3e1edd9 => generated 1521 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:40:48.428806 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi [None req-16c86f38-c066-4613-ad63-56e904cfc5db tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Calling method '>' {{(pid=129322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:40:48.429498 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.compute.api [None req-16c86f38-c066-4613-ad63-56e904cfc5db tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] [instance: f9200aab-6f49-4e6f-812b-93b2f3e1edd9] Fetching instance by UUID {{(pid=129322) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:40:48.438462 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-16c86f38-c066-4613-ad63-56e904cfc5db tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:40:48.438905 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-16c86f38-c066-4613-ad63-56e904cfc5db tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:40:48.439709 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-16c86f38-c066-4613-ad63-56e904cfc5db tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:40:48.440138 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-16c86f38-c066-4613-ad63-56e904cfc5db tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:40:48.580615 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.policy [None req-16c86f38-c066-4613-ad63-56e904cfc5db tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0431b1f25497443ba483b3c440669080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e36ab03283d4ce6a2fed5e111e03d34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129322) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:40:48.592765 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: INFO nova.api.openstack.requestlog [None req-16c86f38-c066-4613-ad63-56e904cfc5db tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] 10.222.0.75 "GET /compute/v2.1/servers/f9200aab-6f49-4e6f-812b-93b2f3e1edd9" status: 200 len: 1521 microversion: 2.1 time: 0.170058 May 26 12:40:48.593342 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: [pid: 129322|app: 0|req: 152/295] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 26 12:40:48 2022] GET /compute/v2.1/servers/f9200aab-6f49-4e6f-812b-93b2f3e1edd9 => generated 1521 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:40:49.610068 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi [None req-49b8623e-f3f5-47d7-8c2f-2f7d1ad2cbe6 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Calling method '>' {{(pid=129321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:40:49.610640 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.compute.api [None req-49b8623e-f3f5-47d7-8c2f-2f7d1ad2cbe6 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] [instance: f9200aab-6f49-4e6f-812b-93b2f3e1edd9] Fetching instance by UUID {{(pid=129321) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:40:49.616846 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-49b8623e-f3f5-47d7-8c2f-2f7d1ad2cbe6 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:40:49.617286 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-49b8623e-f3f5-47d7-8c2f-2f7d1ad2cbe6 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:40:49.618032 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-49b8623e-f3f5-47d7-8c2f-2f7d1ad2cbe6 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:40:49.618458 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-49b8623e-f3f5-47d7-8c2f-2f7d1ad2cbe6 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:40:49.748125 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.policy [None req-49b8623e-f3f5-47d7-8c2f-2f7d1ad2cbe6 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0431b1f25497443ba483b3c440669080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e36ab03283d4ce6a2fed5e111e03d34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129321) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:40:49.755679 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: INFO nova.api.openstack.requestlog [None req-49b8623e-f3f5-47d7-8c2f-2f7d1ad2cbe6 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] 10.222.0.75 "GET /compute/v2.1/servers/f9200aab-6f49-4e6f-812b-93b2f3e1edd9" status: 200 len: 1521 microversion: 2.1 time: 0.149765 May 26 12:40:49.756253 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: [pid: 129321|app: 0|req: 144/296] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 26 12:40:49 2022] GET /compute/v2.1/servers/f9200aab-6f49-4e6f-812b-93b2f3e1edd9 => generated 1521 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:40:50.777398 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi [None req-bd93c429-b490-45dc-850e-274cd26b6edf tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Calling method '>' {{(pid=129322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:40:50.778292 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.compute.api [None req-bd93c429-b490-45dc-850e-274cd26b6edf tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] [instance: f9200aab-6f49-4e6f-812b-93b2f3e1edd9] Fetching instance by UUID {{(pid=129322) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:40:50.786121 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-bd93c429-b490-45dc-850e-274cd26b6edf tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:40:50.786571 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-bd93c429-b490-45dc-850e-274cd26b6edf tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:40:50.787359 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-bd93c429-b490-45dc-850e-274cd26b6edf tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:40:50.787828 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-bd93c429-b490-45dc-850e-274cd26b6edf tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:40:50.929088 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.policy [None req-bd93c429-b490-45dc-850e-274cd26b6edf tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0431b1f25497443ba483b3c440669080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e36ab03283d4ce6a2fed5e111e03d34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129322) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:40:50.937221 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: INFO nova.api.openstack.requestlog [None req-bd93c429-b490-45dc-850e-274cd26b6edf tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] 10.222.0.75 "GET /compute/v2.1/servers/f9200aab-6f49-4e6f-812b-93b2f3e1edd9" status: 200 len: 1521 microversion: 2.1 time: 0.166865 May 26 12:40:50.937797 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: [pid: 129322|app: 0|req: 153/297] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 26 12:40:50 2022] GET /compute/v2.1/servers/f9200aab-6f49-4e6f-812b-93b2f3e1edd9 => generated 1521 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:40:51.954803 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi [None req-d20a5842-f92f-46fd-a039-b997f8d2011b tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Calling method '>' {{(pid=129321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:40:51.955417 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.compute.api [None req-d20a5842-f92f-46fd-a039-b997f8d2011b tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] [instance: f9200aab-6f49-4e6f-812b-93b2f3e1edd9] Fetching instance by UUID {{(pid=129321) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:40:51.962032 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-d20a5842-f92f-46fd-a039-b997f8d2011b tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:40:51.962470 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-d20a5842-f92f-46fd-a039-b997f8d2011b tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:40:51.963245 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-d20a5842-f92f-46fd-a039-b997f8d2011b tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:40:51.963710 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-d20a5842-f92f-46fd-a039-b997f8d2011b tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:40:52.116361 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.policy [None req-d20a5842-f92f-46fd-a039-b997f8d2011b tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0431b1f25497443ba483b3c440669080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e36ab03283d4ce6a2fed5e111e03d34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129321) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:40:52.128526 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: INFO nova.api.openstack.requestlog [None req-d20a5842-f92f-46fd-a039-b997f8d2011b tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] 10.222.0.75 "GET /compute/v2.1/servers/f9200aab-6f49-4e6f-812b-93b2f3e1edd9" status: 200 len: 1521 microversion: 2.1 time: 0.177927 May 26 12:40:52.137755 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: [pid: 129321|app: 0|req: 145/298] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 26 12:40:51 2022] GET /compute/v2.1/servers/f9200aab-6f49-4e6f-812b-93b2f3e1edd9 => generated 1521 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:40:53.146243 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi [None req-1a670756-c333-4c97-9678-afbccf46b5f0 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Calling method '>' {{(pid=129322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:40:53.147310 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.compute.api [None req-1a670756-c333-4c97-9678-afbccf46b5f0 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] [instance: f9200aab-6f49-4e6f-812b-93b2f3e1edd9] Fetching instance by UUID {{(pid=129322) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:40:53.154087 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-1a670756-c333-4c97-9678-afbccf46b5f0 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:40:53.155006 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-1a670756-c333-4c97-9678-afbccf46b5f0 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:40:53.155860 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-1a670756-c333-4c97-9678-afbccf46b5f0 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:40:53.156287 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-1a670756-c333-4c97-9678-afbccf46b5f0 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:40:53.289889 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.policy [None req-1a670756-c333-4c97-9678-afbccf46b5f0 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0431b1f25497443ba483b3c440669080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e36ab03283d4ce6a2fed5e111e03d34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129322) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:40:53.297648 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: INFO nova.api.openstack.requestlog [None req-1a670756-c333-4c97-9678-afbccf46b5f0 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] 10.222.0.75 "GET /compute/v2.1/servers/f9200aab-6f49-4e6f-812b-93b2f3e1edd9" status: 200 len: 1521 microversion: 2.1 time: 0.156026 May 26 12:40:53.298220 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: [pid: 129322|app: 0|req: 154/299] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 26 12:40:53 2022] GET /compute/v2.1/servers/f9200aab-6f49-4e6f-812b-93b2f3e1edd9 => generated 1521 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:40:54.314862 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi [None req-edc096f4-46a1-4e0a-9c42-205d00355190 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Calling method '>' {{(pid=129321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:40:54.315471 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.compute.api [None req-edc096f4-46a1-4e0a-9c42-205d00355190 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] [instance: f9200aab-6f49-4e6f-812b-93b2f3e1edd9] Fetching instance by UUID {{(pid=129321) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:40:54.322047 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-edc096f4-46a1-4e0a-9c42-205d00355190 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:40:54.322487 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-edc096f4-46a1-4e0a-9c42-205d00355190 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:40:54.323231 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-edc096f4-46a1-4e0a-9c42-205d00355190 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:40:54.323692 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-edc096f4-46a1-4e0a-9c42-205d00355190 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:40:54.464900 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.policy [None req-edc096f4-46a1-4e0a-9c42-205d00355190 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0431b1f25497443ba483b3c440669080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e36ab03283d4ce6a2fed5e111e03d34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129321) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:40:54.473586 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: INFO nova.api.openstack.requestlog [None req-edc096f4-46a1-4e0a-9c42-205d00355190 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] 10.222.0.75 "GET /compute/v2.1/servers/f9200aab-6f49-4e6f-812b-93b2f3e1edd9" status: 200 len: 1521 microversion: 2.1 time: 0.163117 May 26 12:40:54.474198 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: [pid: 129321|app: 0|req: 146/300] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 26 12:40:54 2022] GET /compute/v2.1/servers/f9200aab-6f49-4e6f-812b-93b2f3e1edd9 => generated 1521 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:40:55.498423 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi [None req-0fe3dd97-29da-4f0a-bb97-ee78fd04eede tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Calling method '>' {{(pid=129322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:40:55.498988 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.compute.api [None req-0fe3dd97-29da-4f0a-bb97-ee78fd04eede tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] [instance: f9200aab-6f49-4e6f-812b-93b2f3e1edd9] Fetching instance by UUID {{(pid=129322) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:40:55.505797 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-0fe3dd97-29da-4f0a-bb97-ee78fd04eede tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:40:55.506236 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-0fe3dd97-29da-4f0a-bb97-ee78fd04eede tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:40:55.506993 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-0fe3dd97-29da-4f0a-bb97-ee78fd04eede tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:40:55.507419 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-0fe3dd97-29da-4f0a-bb97-ee78fd04eede tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:40:55.655873 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.policy [None req-0fe3dd97-29da-4f0a-bb97-ee78fd04eede tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0431b1f25497443ba483b3c440669080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e36ab03283d4ce6a2fed5e111e03d34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129322) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:40:55.667780 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: INFO nova.api.openstack.requestlog [None req-0fe3dd97-29da-4f0a-bb97-ee78fd04eede tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] 10.222.0.75 "GET /compute/v2.1/servers/f9200aab-6f49-4e6f-812b-93b2f3e1edd9" status: 200 len: 1521 microversion: 2.1 time: 0.173053 May 26 12:40:55.668543 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: [pid: 129322|app: 0|req: 155/301] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 26 12:40:55 2022] GET /compute/v2.1/servers/f9200aab-6f49-4e6f-812b-93b2f3e1edd9 => generated 1521 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:40:56.686409 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi [None req-f697a58c-b52c-4f7f-aaf8-adf8ad20f129 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Calling method '>' {{(pid=129321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:40:56.686991 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.compute.api [None req-f697a58c-b52c-4f7f-aaf8-adf8ad20f129 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] [instance: f9200aab-6f49-4e6f-812b-93b2f3e1edd9] Fetching instance by UUID {{(pid=129321) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:40:56.693710 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-f697a58c-b52c-4f7f-aaf8-adf8ad20f129 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:40:56.694179 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-f697a58c-b52c-4f7f-aaf8-adf8ad20f129 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:40:56.694962 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-f697a58c-b52c-4f7f-aaf8-adf8ad20f129 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:40:56.695405 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-f697a58c-b52c-4f7f-aaf8-adf8ad20f129 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:40:56.827994 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.policy [None req-f697a58c-b52c-4f7f-aaf8-adf8ad20f129 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0431b1f25497443ba483b3c440669080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e36ab03283d4ce6a2fed5e111e03d34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129321) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:40:56.835884 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: INFO nova.api.openstack.requestlog [None req-f697a58c-b52c-4f7f-aaf8-adf8ad20f129 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] 10.222.0.75 "GET /compute/v2.1/servers/f9200aab-6f49-4e6f-812b-93b2f3e1edd9" status: 200 len: 1521 microversion: 2.1 time: 0.153544 May 26 12:40:56.836476 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: [pid: 129321|app: 0|req: 147/302] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 26 12:40:56 2022] GET /compute/v2.1/servers/f9200aab-6f49-4e6f-812b-93b2f3e1edd9 => generated 1521 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:40:57.853690 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi [None req-618d106f-7a1c-4c0c-9dec-a8efbd9613b1 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Calling method '>' {{(pid=129322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:40:57.854251 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.compute.api [None req-618d106f-7a1c-4c0c-9dec-a8efbd9613b1 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] [instance: f9200aab-6f49-4e6f-812b-93b2f3e1edd9] Fetching instance by UUID {{(pid=129322) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:40:57.861429 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-618d106f-7a1c-4c0c-9dec-a8efbd9613b1 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:40:57.861874 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-618d106f-7a1c-4c0c-9dec-a8efbd9613b1 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:40:57.862623 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-618d106f-7a1c-4c0c-9dec-a8efbd9613b1 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:40:57.863048 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-618d106f-7a1c-4c0c-9dec-a8efbd9613b1 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:40:58.005618 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.policy [None req-618d106f-7a1c-4c0c-9dec-a8efbd9613b1 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0431b1f25497443ba483b3c440669080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e36ab03283d4ce6a2fed5e111e03d34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129322) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:40:58.016626 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: INFO nova.api.openstack.requestlog [None req-618d106f-7a1c-4c0c-9dec-a8efbd9613b1 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] 10.222.0.75 "GET /compute/v2.1/servers/f9200aab-6f49-4e6f-812b-93b2f3e1edd9" status: 200 len: 1521 microversion: 2.1 time: 0.166754 May 26 12:40:58.017456 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: [pid: 129322|app: 0|req: 156/303] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 26 12:40:57 2022] GET /compute/v2.1/servers/f9200aab-6f49-4e6f-812b-93b2f3e1edd9 => generated 1521 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:40:59.035166 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi [None req-42c74e0c-9d46-4475-aa30-76594a2e7deb tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Calling method '>' {{(pid=129321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:40:59.035875 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.compute.api [None req-42c74e0c-9d46-4475-aa30-76594a2e7deb tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] [instance: f9200aab-6f49-4e6f-812b-93b2f3e1edd9] Fetching instance by UUID {{(pid=129321) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:40:59.043230 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-42c74e0c-9d46-4475-aa30-76594a2e7deb tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:40:59.043734 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-42c74e0c-9d46-4475-aa30-76594a2e7deb tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:40:59.044522 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-42c74e0c-9d46-4475-aa30-76594a2e7deb tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:40:59.044962 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-42c74e0c-9d46-4475-aa30-76594a2e7deb tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:40:59.201350 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.policy [None req-42c74e0c-9d46-4475-aa30-76594a2e7deb tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0431b1f25497443ba483b3c440669080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e36ab03283d4ce6a2fed5e111e03d34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129321) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:40:59.210635 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: INFO nova.api.openstack.requestlog [None req-42c74e0c-9d46-4475-aa30-76594a2e7deb tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] 10.222.0.75 "GET /compute/v2.1/servers/f9200aab-6f49-4e6f-812b-93b2f3e1edd9" status: 200 len: 1521 microversion: 2.1 time: 0.179884 May 26 12:40:59.211225 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: [pid: 129321|app: 0|req: 148/304] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 26 12:40:59 2022] GET /compute/v2.1/servers/f9200aab-6f49-4e6f-812b-93b2f3e1edd9 => generated 1521 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:41:00.228714 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi [None req-7d438eb8-b8b6-4040-8038-09f4e42587e4 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Calling method '>' {{(pid=129322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:41:00.229453 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.compute.api [None req-7d438eb8-b8b6-4040-8038-09f4e42587e4 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] [instance: f9200aab-6f49-4e6f-812b-93b2f3e1edd9] Fetching instance by UUID {{(pid=129322) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:41:00.235928 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-7d438eb8-b8b6-4040-8038-09f4e42587e4 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:41:00.236368 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-7d438eb8-b8b6-4040-8038-09f4e42587e4 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:41:00.237127 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-7d438eb8-b8b6-4040-8038-09f4e42587e4 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:41:00.237555 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-7d438eb8-b8b6-4040-8038-09f4e42587e4 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:41:00.383910 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.policy [None req-7d438eb8-b8b6-4040-8038-09f4e42587e4 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0431b1f25497443ba483b3c440669080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e36ab03283d4ce6a2fed5e111e03d34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129322) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:41:00.391940 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: INFO nova.api.openstack.requestlog [None req-7d438eb8-b8b6-4040-8038-09f4e42587e4 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] 10.222.0.75 "GET /compute/v2.1/servers/f9200aab-6f49-4e6f-812b-93b2f3e1edd9" status: 200 len: 1521 microversion: 2.1 time: 0.167274 May 26 12:41:00.392731 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: [pid: 129322|app: 0|req: 157/305] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 26 12:41:00 2022] GET /compute/v2.1/servers/f9200aab-6f49-4e6f-812b-93b2f3e1edd9 => generated 1521 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:41:01.412458 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi [None req-bee2cb3f-9c9d-4c7c-8605-b0d79328bc74 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Calling method '>' {{(pid=129321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:41:01.413367 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.compute.api [None req-bee2cb3f-9c9d-4c7c-8605-b0d79328bc74 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] [instance: f9200aab-6f49-4e6f-812b-93b2f3e1edd9] Fetching instance by UUID {{(pid=129321) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:41:01.422124 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-bee2cb3f-9c9d-4c7c-8605-b0d79328bc74 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:41:01.422731 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-bee2cb3f-9c9d-4c7c-8605-b0d79328bc74 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:41:01.423489 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-bee2cb3f-9c9d-4c7c-8605-b0d79328bc74 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:41:01.423948 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-bee2cb3f-9c9d-4c7c-8605-b0d79328bc74 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:41:01.553458 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.policy [None req-bee2cb3f-9c9d-4c7c-8605-b0d79328bc74 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0431b1f25497443ba483b3c440669080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e36ab03283d4ce6a2fed5e111e03d34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129321) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:41:01.561340 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: INFO nova.api.openstack.requestlog [None req-bee2cb3f-9c9d-4c7c-8605-b0d79328bc74 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] 10.222.0.75 "GET /compute/v2.1/servers/f9200aab-6f49-4e6f-812b-93b2f3e1edd9" status: 200 len: 1521 microversion: 2.1 time: 0.155544 May 26 12:41:01.561932 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: [pid: 129321|app: 0|req: 149/306] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 26 12:41:01 2022] GET /compute/v2.1/servers/f9200aab-6f49-4e6f-812b-93b2f3e1edd9 => generated 1521 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:41:02.580996 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi [None req-9cb11007-ef6a-42b8-b747-41fea0a3b63c tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Calling method '>' {{(pid=129322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:41:02.581607 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.compute.api [None req-9cb11007-ef6a-42b8-b747-41fea0a3b63c tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] [instance: f9200aab-6f49-4e6f-812b-93b2f3e1edd9] Fetching instance by UUID {{(pid=129322) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:41:02.588993 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-9cb11007-ef6a-42b8-b747-41fea0a3b63c tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:41:02.589431 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-9cb11007-ef6a-42b8-b747-41fea0a3b63c tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:41:02.590192 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-9cb11007-ef6a-42b8-b747-41fea0a3b63c tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:41:02.590635 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-9cb11007-ef6a-42b8-b747-41fea0a3b63c tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:41:02.729995 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.policy [None req-9cb11007-ef6a-42b8-b747-41fea0a3b63c tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0431b1f25497443ba483b3c440669080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e36ab03283d4ce6a2fed5e111e03d34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129322) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:41:02.742957 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: INFO nova.api.openstack.requestlog [None req-9cb11007-ef6a-42b8-b747-41fea0a3b63c tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] 10.222.0.75 "GET /compute/v2.1/servers/f9200aab-6f49-4e6f-812b-93b2f3e1edd9" status: 200 len: 1521 microversion: 2.1 time: 0.165249 May 26 12:41:02.743561 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: [pid: 129322|app: 0|req: 158/307] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 26 12:41:02 2022] GET /compute/v2.1/servers/f9200aab-6f49-4e6f-812b-93b2f3e1edd9 => generated 1521 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:41:03.761153 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi [None req-2ef07ff2-ca92-4ef3-8521-519770f3d476 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Calling method '>' {{(pid=129321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:41:03.761735 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.compute.api [None req-2ef07ff2-ca92-4ef3-8521-519770f3d476 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] [instance: f9200aab-6f49-4e6f-812b-93b2f3e1edd9] Fetching instance by UUID {{(pid=129321) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:41:03.768194 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-2ef07ff2-ca92-4ef3-8521-519770f3d476 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:41:03.768646 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-2ef07ff2-ca92-4ef3-8521-519770f3d476 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:41:03.769396 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-2ef07ff2-ca92-4ef3-8521-519770f3d476 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:41:03.769827 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-2ef07ff2-ca92-4ef3-8521-519770f3d476 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:41:03.914309 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.policy [None req-2ef07ff2-ca92-4ef3-8521-519770f3d476 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0431b1f25497443ba483b3c440669080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e36ab03283d4ce6a2fed5e111e03d34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129321) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:41:03.922030 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: INFO nova.api.openstack.requestlog [None req-2ef07ff2-ca92-4ef3-8521-519770f3d476 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] 10.222.0.75 "GET /compute/v2.1/servers/f9200aab-6f49-4e6f-812b-93b2f3e1edd9" status: 200 len: 1521 microversion: 2.1 time: 0.164812 May 26 12:41:03.922596 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: [pid: 129321|app: 0|req: 150/308] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 26 12:41:03 2022] GET /compute/v2.1/servers/f9200aab-6f49-4e6f-812b-93b2f3e1edd9 => generated 1521 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:41:04.938273 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi [None req-65ab3178-349b-4c9c-a02d-72d3d9e80519 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Calling method '>' {{(pid=129322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:41:04.939653 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.compute.api [None req-65ab3178-349b-4c9c-a02d-72d3d9e80519 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] [instance: f9200aab-6f49-4e6f-812b-93b2f3e1edd9] Fetching instance by UUID {{(pid=129322) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:41:04.945912 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-65ab3178-349b-4c9c-a02d-72d3d9e80519 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:41:04.946521 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-65ab3178-349b-4c9c-a02d-72d3d9e80519 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:41:04.947368 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-65ab3178-349b-4c9c-a02d-72d3d9e80519 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:41:04.947831 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-65ab3178-349b-4c9c-a02d-72d3d9e80519 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:41:05.076318 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.policy [None req-65ab3178-349b-4c9c-a02d-72d3d9e80519 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0431b1f25497443ba483b3c440669080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e36ab03283d4ce6a2fed5e111e03d34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129322) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:41:05.084206 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: INFO nova.api.openstack.requestlog [None req-65ab3178-349b-4c9c-a02d-72d3d9e80519 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] 10.222.0.75 "GET /compute/v2.1/servers/f9200aab-6f49-4e6f-812b-93b2f3e1edd9" status: 200 len: 1521 microversion: 2.1 time: 0.149839 May 26 12:41:05.084758 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: [pid: 129322|app: 0|req: 159/309] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 26 12:41:04 2022] GET /compute/v2.1/servers/f9200aab-6f49-4e6f-812b-93b2f3e1edd9 => generated 1521 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:41:06.102777 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi [None req-e7a777f7-ce60-4257-992c-558c5878b09c tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Calling method '>' {{(pid=129321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:41:06.103349 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.compute.api [None req-e7a777f7-ce60-4257-992c-558c5878b09c tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] [instance: f9200aab-6f49-4e6f-812b-93b2f3e1edd9] Fetching instance by UUID {{(pid=129321) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:41:06.109997 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-e7a777f7-ce60-4257-992c-558c5878b09c tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:41:06.110446 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-e7a777f7-ce60-4257-992c-558c5878b09c tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:41:06.111320 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-e7a777f7-ce60-4257-992c-558c5878b09c tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:41:06.111799 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-e7a777f7-ce60-4257-992c-558c5878b09c tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:41:06.258353 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.policy [None req-e7a777f7-ce60-4257-992c-558c5878b09c tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0431b1f25497443ba483b3c440669080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e36ab03283d4ce6a2fed5e111e03d34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129321) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:41:06.266267 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: INFO nova.api.openstack.requestlog [None req-e7a777f7-ce60-4257-992c-558c5878b09c tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] 10.222.0.75 "GET /compute/v2.1/servers/f9200aab-6f49-4e6f-812b-93b2f3e1edd9" status: 200 len: 1521 microversion: 2.1 time: 0.167470 May 26 12:41:06.266852 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: [pid: 129321|app: 0|req: 151/310] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 26 12:41:06 2022] GET /compute/v2.1/servers/f9200aab-6f49-4e6f-812b-93b2f3e1edd9 => generated 1521 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:41:07.288036 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi [None req-ce3f15c8-e2bf-4568-a03e-4759ea7a687c tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Calling method '>' {{(pid=129322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:41:07.289052 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.compute.api [None req-ce3f15c8-e2bf-4568-a03e-4759ea7a687c tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] [instance: f9200aab-6f49-4e6f-812b-93b2f3e1edd9] Fetching instance by UUID {{(pid=129322) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:41:07.292991 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG dbcounter [-] [129322] Writing DB stats nova_api:SELECT=27 {{(pid=129322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:41:07.302041 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-ce3f15c8-e2bf-4568-a03e-4759ea7a687c tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:41:07.302800 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-ce3f15c8-e2bf-4568-a03e-4759ea7a687c tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:41:07.304155 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-ce3f15c8-e2bf-4568-a03e-4759ea7a687c tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:41:07.304822 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-ce3f15c8-e2bf-4568-a03e-4759ea7a687c tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:41:07.311934 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG dbcounter [-] [129322] Writing DB stats nova_cell1:SELECT=79 {{(pid=129322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:41:07.505173 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.policy [None req-ce3f15c8-e2bf-4568-a03e-4759ea7a687c tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0431b1f25497443ba483b3c440669080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e36ab03283d4ce6a2fed5e111e03d34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129322) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:41:07.518476 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: INFO nova.api.openstack.requestlog [None req-ce3f15c8-e2bf-4568-a03e-4759ea7a687c tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] 10.222.0.75 "GET /compute/v2.1/servers/f9200aab-6f49-4e6f-812b-93b2f3e1edd9" status: 200 len: 1521 microversion: 2.1 time: 0.236713 May 26 12:41:07.519453 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: [pid: 129322|app: 0|req: 160/311] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 26 12:41:07 2022] GET /compute/v2.1/servers/f9200aab-6f49-4e6f-812b-93b2f3e1edd9 => generated 1521 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:41:08.543886 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi [None req-29a86138-fd83-47be-9347-48e5eb171b21 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Calling method '>' {{(pid=129321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:41:08.544580 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.compute.api [None req-29a86138-fd83-47be-9347-48e5eb171b21 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] [instance: f9200aab-6f49-4e6f-812b-93b2f3e1edd9] Fetching instance by UUID {{(pid=129321) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:41:08.546856 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG dbcounter [-] [129321] Writing DB stats nova_api:SELECT=29 {{(pid=129321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:41:08.552644 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-29a86138-fd83-47be-9347-48e5eb171b21 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:41:08.553085 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-29a86138-fd83-47be-9347-48e5eb171b21 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:41:08.553858 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-29a86138-fd83-47be-9347-48e5eb171b21 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:41:08.554285 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-29a86138-fd83-47be-9347-48e5eb171b21 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:41:08.557232 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG dbcounter [-] [129321] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=129321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:41:08.694829 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.policy [None req-29a86138-fd83-47be-9347-48e5eb171b21 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0431b1f25497443ba483b3c440669080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e36ab03283d4ce6a2fed5e111e03d34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129321) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:41:08.705406 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: INFO nova.api.openstack.requestlog [None req-29a86138-fd83-47be-9347-48e5eb171b21 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] 10.222.0.75 "GET /compute/v2.1/servers/f9200aab-6f49-4e6f-812b-93b2f3e1edd9" status: 200 len: 1521 microversion: 2.1 time: 0.165526 May 26 12:41:08.706315 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: [pid: 129321|app: 0|req: 152/312] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 26 12:41:08 2022] GET /compute/v2.1/servers/f9200aab-6f49-4e6f-812b-93b2f3e1edd9 => generated 1521 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:41:09.729515 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi [None req-3e537e07-af2c-4a04-8218-9852c449241f tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Calling method '>' {{(pid=129322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:41:09.730137 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.compute.api [None req-3e537e07-af2c-4a04-8218-9852c449241f tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] [instance: f9200aab-6f49-4e6f-812b-93b2f3e1edd9] Fetching instance by UUID {{(pid=129322) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:41:09.736822 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-3e537e07-af2c-4a04-8218-9852c449241f tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:41:09.737399 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-3e537e07-af2c-4a04-8218-9852c449241f tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:41:09.738110 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-3e537e07-af2c-4a04-8218-9852c449241f tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:41:09.738542 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-3e537e07-af2c-4a04-8218-9852c449241f tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:41:09.887502 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.policy [None req-3e537e07-af2c-4a04-8218-9852c449241f tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0431b1f25497443ba483b3c440669080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e36ab03283d4ce6a2fed5e111e03d34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129322) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:41:09.896511 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: INFO nova.api.openstack.requestlog [None req-3e537e07-af2c-4a04-8218-9852c449241f tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] 10.222.0.75 "GET /compute/v2.1/servers/f9200aab-6f49-4e6f-812b-93b2f3e1edd9" status: 200 len: 1521 microversion: 2.1 time: 0.170759 May 26 12:41:09.897463 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: [pid: 129322|app: 0|req: 161/313] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 26 12:41:09 2022] GET /compute/v2.1/servers/f9200aab-6f49-4e6f-812b-93b2f3e1edd9 => generated 1521 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:41:10.914320 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi [None req-dbd6aa57-7831-4d9f-a1d6-6362d2fa7bfa tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Calling method '>' {{(pid=129321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:41:10.914913 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.compute.api [None req-dbd6aa57-7831-4d9f-a1d6-6362d2fa7bfa tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] [instance: f9200aab-6f49-4e6f-812b-93b2f3e1edd9] Fetching instance by UUID {{(pid=129321) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:41:10.921308 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-dbd6aa57-7831-4d9f-a1d6-6362d2fa7bfa tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:41:10.921747 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-dbd6aa57-7831-4d9f-a1d6-6362d2fa7bfa tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:41:10.922499 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-dbd6aa57-7831-4d9f-a1d6-6362d2fa7bfa tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:41:10.922922 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-dbd6aa57-7831-4d9f-a1d6-6362d2fa7bfa tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:41:11.055958 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.policy [None req-dbd6aa57-7831-4d9f-a1d6-6362d2fa7bfa tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0431b1f25497443ba483b3c440669080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e36ab03283d4ce6a2fed5e111e03d34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129321) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:41:11.064121 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: INFO nova.api.openstack.requestlog [None req-dbd6aa57-7831-4d9f-a1d6-6362d2fa7bfa tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] 10.222.0.75 "GET /compute/v2.1/servers/f9200aab-6f49-4e6f-812b-93b2f3e1edd9" status: 200 len: 1521 microversion: 2.1 time: 0.153805 May 26 12:41:11.064626 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: [pid: 129321|app: 0|req: 153/314] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 26 12:41:10 2022] GET /compute/v2.1/servers/f9200aab-6f49-4e6f-812b-93b2f3e1edd9 => generated 1521 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:41:12.080855 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi [None req-9869f095-4800-41df-966e-b0e0c782b50c tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Calling method '>' {{(pid=129322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:41:12.081616 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.compute.api [None req-9869f095-4800-41df-966e-b0e0c782b50c tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] [instance: f9200aab-6f49-4e6f-812b-93b2f3e1edd9] Fetching instance by UUID {{(pid=129322) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:41:12.089111 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-9869f095-4800-41df-966e-b0e0c782b50c tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:41:12.089554 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-9869f095-4800-41df-966e-b0e0c782b50c tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:41:12.090320 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-9869f095-4800-41df-966e-b0e0c782b50c tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:41:12.090748 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-9869f095-4800-41df-966e-b0e0c782b50c tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:41:12.227615 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.policy [None req-9869f095-4800-41df-966e-b0e0c782b50c tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0431b1f25497443ba483b3c440669080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e36ab03283d4ce6a2fed5e111e03d34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129322) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:41:12.235387 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: INFO nova.api.openstack.requestlog [None req-9869f095-4800-41df-966e-b0e0c782b50c tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] 10.222.0.75 "GET /compute/v2.1/servers/f9200aab-6f49-4e6f-812b-93b2f3e1edd9" status: 200 len: 1521 microversion: 2.1 time: 0.158459 May 26 12:41:12.236031 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: [pid: 129322|app: 0|req: 162/315] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 26 12:41:12 2022] GET /compute/v2.1/servers/f9200aab-6f49-4e6f-812b-93b2f3e1edd9 => generated 1521 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:41:13.252542 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi [None req-afd45be1-b169-4808-bf6c-024762dbb61d tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Calling method '>' {{(pid=129321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:41:13.253261 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.compute.api [None req-afd45be1-b169-4808-bf6c-024762dbb61d tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] [instance: f9200aab-6f49-4e6f-812b-93b2f3e1edd9] Fetching instance by UUID {{(pid=129321) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:41:13.259875 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-afd45be1-b169-4808-bf6c-024762dbb61d tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:41:13.260316 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-afd45be1-b169-4808-bf6c-024762dbb61d tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:41:13.261058 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-afd45be1-b169-4808-bf6c-024762dbb61d tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:41:13.261477 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-afd45be1-b169-4808-bf6c-024762dbb61d tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:41:13.394543 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.policy [None req-afd45be1-b169-4808-bf6c-024762dbb61d tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0431b1f25497443ba483b3c440669080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e36ab03283d4ce6a2fed5e111e03d34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129321) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:41:13.403731 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: INFO nova.api.openstack.requestlog [None req-afd45be1-b169-4808-bf6c-024762dbb61d tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] 10.222.0.75 "GET /compute/v2.1/servers/f9200aab-6f49-4e6f-812b-93b2f3e1edd9" status: 200 len: 1521 microversion: 2.1 time: 0.155013 May 26 12:41:13.404376 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: [pid: 129321|app: 0|req: 154/316] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 26 12:41:13 2022] GET /compute/v2.1/servers/f9200aab-6f49-4e6f-812b-93b2f3e1edd9 => generated 1521 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:41:14.424997 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi [None req-8c9a2622-e146-4ac9-9f98-fb64e32e95b8 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Calling method '>' {{(pid=129322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:41:14.426174 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.compute.api [None req-8c9a2622-e146-4ac9-9f98-fb64e32e95b8 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] [instance: f9200aab-6f49-4e6f-812b-93b2f3e1edd9] Fetching instance by UUID {{(pid=129322) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:41:14.433040 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-8c9a2622-e146-4ac9-9f98-fb64e32e95b8 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:41:14.433491 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-8c9a2622-e146-4ac9-9f98-fb64e32e95b8 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:41:14.434269 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-8c9a2622-e146-4ac9-9f98-fb64e32e95b8 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:41:14.434700 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-8c9a2622-e146-4ac9-9f98-fb64e32e95b8 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:41:14.572439 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.policy [None req-8c9a2622-e146-4ac9-9f98-fb64e32e95b8 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0431b1f25497443ba483b3c440669080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e36ab03283d4ce6a2fed5e111e03d34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129322) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:41:14.580111 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: INFO nova.api.openstack.requestlog [None req-8c9a2622-e146-4ac9-9f98-fb64e32e95b8 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] 10.222.0.75 "GET /compute/v2.1/servers/f9200aab-6f49-4e6f-812b-93b2f3e1edd9" status: 200 len: 1501 microversion: 2.1 time: 0.159716 May 26 12:41:14.580685 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: [pid: 129322|app: 0|req: 163/317] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 26 12:41:14 2022] GET /compute/v2.1/servers/f9200aab-6f49-4e6f-812b-93b2f3e1edd9 => generated 1501 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:41:14.597183 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi [None req-e7ed6cd6-b53e-41e8-a80f-34f1c0ba2bc1 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "103e201d-01a8-4178-a2b0-0e8c3c3accd5"}} {{(pid=129321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 12:41:14.598279 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.compute.api [None req-e7ed6cd6-b53e-41e8-a80f-34f1c0ba2bc1 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] [instance: f9200aab-6f49-4e6f-812b-93b2f3e1edd9] Fetching instance by UUID {{(pid=129321) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:41:14.604828 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-e7ed6cd6-b53e-41e8-a80f-34f1c0ba2bc1 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:41:14.605270 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-e7ed6cd6-b53e-41e8-a80f-34f1c0ba2bc1 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:41:14.606022 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-e7ed6cd6-b53e-41e8-a80f-34f1c0ba2bc1 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:41:14.606442 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-e7ed6cd6-b53e-41e8-a80f-34f1c0ba2bc1 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:41:14.630006 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: INFO nova.api.openstack.wsgi [None req-e7ed6cd6-b53e-41e8-a80f-34f1c0ba2bc1 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] HTTP exception thrown: Cannot 'attach_volume' instance f9200aab-6f49-4e6f-812b-93b2f3e1edd9 while it is in vm_state rescued May 26 12:41:14.631744 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi [None req-e7ed6cd6-b53e-41e8-a80f-34f1c0ba2bc1 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Request method failure captured: May 26 12:41:14.631744 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: request: POST /compute/v2.1/servers/f9200aab-6f49-4e6f-812b-93b2f3e1edd9/os-volume_attachments HTTP/1.1 May 26 12:41:14.631744 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: Accept: application/json May 26 12:41:14.631744 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: Accept-Encoding: identity May 26 12:41:14.631744 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: Connection: close May 26 12:41:14.631744 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: Content-Length: 74 May 26 12:41:14.631744 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: Content-Type: application/json May 26 12:41:14.631744 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: Host: 10.222.0.75 May 26 12:41:14.631744 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: Openstack-System-Scope: None May 26 12:41:14.631744 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: User-Agent: python-urllib3/1.26.9 May 26 12:41:14.631744 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: X-Auth-Token: gAAAAABij3S0WbtMcFtLpl5UW4FUUirUww6kWxRFtP_FyC7fCIkKgIa10qp1d64SXO8XGZoWAnH5qdlCU3B3TdVumzT0bkV7P07uLiWhB_0UPHRg81du51UJgft-JAW7F3hpRjJiDiRCUUj2q5hZ29CV8Ux0gDDTwJGidVvj6aJ5fGBZ3S5YWD8 May 26 12:41:14.631744 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: X-Domain-Id: None May 26 12:41:14.631744 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: X-Domain-Name: None May 26 12:41:14.631744 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: X-Identity-Status: Confirmed May 26 12:41:14.631744 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: X-Is-Admin-Project: True May 26 12:41:14.631744 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: X-Project-Domain-Id: default May 26 12:41:14.631744 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: X-Project-Domain-Name: Default May 26 12:41:14.631744 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: X-Project-Id: 9e36ab03283d4ce6a2fed5e111e03d34 May 26 12:41:14.631744 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-547315860 May 26 12:41:14.631744 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: X-Role: member,reader May 26 12:41:14.631744 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: X-Roles: member,reader May 26 12:41:14.633264 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/9e36ab03283d4ce6a2fed5e111e03d34"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.75:8080", "publicURL": "http://10.222.0.75:8080/v1/AUTH_9e36ab03283d4ce6a2fed5e111e03d34"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2/9e36ab03283d4ce6a2fed5e111e03d34"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/9e36ab03283d4ce6a2fed5e111e03d34"}]}] May 26 12:41:14.633264 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: X-Tenant: tempest-ServerRescueNegativeTestJSON-547315860 May 26 12:41:14.633264 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: X-Tenant-Id: 9e36ab03283d4ce6a2fed5e111e03d34 May 26 12:41:14.633264 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-547315860 May 26 12:41:14.633264 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: X-User: tempest-ServerRescueNegativeTestJSON-547315860-project May 26 12:41:14.633264 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: X-User-Domain-Id: default May 26 12:41:14.633264 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: X-User-Domain-Name: Default May 26 12:41:14.633264 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: X-User-Id: 0431b1f25497443ba483b3c440669080 May 26 12:41:14.633264 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: X-User-Name: tempest-ServerRescueNegativeTestJSON-547315860-project May 26 12:41:14.633264 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: May 26 12:41:14.633264 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: {"volumeAttachment": {"volumeId": "103e201d-01a8-4178-a2b0-0e8c3c3accd5"}} May 26 12:41:14.633264 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: method: > May 26 12:41:14.634277 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: exception: Cannot 'attach_volume' instance f9200aab-6f49-4e6f-812b-93b2f3e1edd9 while it is in vm_state rescued May 26 12:41:14.634277 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: action_args: {'server_id': 'f9200aab-6f49-4e6f-812b-93b2f3e1edd9', 'body': {'volumeAttachment': {'volumeId': '103e201d-01a8-4178-a2b0-0e8c3c3accd5'}}} May 26 12:41:14.634277 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: {{(pid=129321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 12:41:14.634277 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 12:41:14.634277 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create May 26 12:41:14.634277 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( May 26 12:41:14.634277 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner May 26 12:41:14.634277 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 26 12:41:14.634277 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner May 26 12:41:14.634277 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( May 26 12:41:14.634277 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance f9200aab-6f49-4e6f-812b-93b2f3e1edd9 in vm_state rescued. Cannot attach_volume while the instance is in this state. May 26 12:41:14.634277 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi May 26 12:41:14.634277 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 12:41:14.634277 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi May 26 12:41:14.634277 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 12:41:14.634277 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 12:41:14.634277 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 12:41:14.634277 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 12:41:14.634277 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 12:41:14.635667 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 12:41:14.635667 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 12:41:14.635667 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 26 12:41:14.635667 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 26 12:41:14.635667 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 26 12:41:14.635667 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 26 12:41:14.635667 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 26 12:41:14.635667 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 26 12:41:14.635667 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create May 26 12:41:14.635667 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, May 26 12:41:14.635667 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state May 26 12:41:14.635667 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) May 26 12:41:14.635667 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance f9200aab-6f49-4e6f-812b-93b2f3e1edd9 while it is in vm_state rescued May 26 12:41:14.635667 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi May 26 12:41:14.635667 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 12:41:14.635667 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi May 26 12:41:14.635667 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 12:41:14.635667 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 12:41:14.635667 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 12:41:14.637269 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 12:41:14.637269 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 12:41:14.637269 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance f9200aab-6f49-4e6f-812b-93b2f3e1edd9 while it is in vm_state rescued May 26 12:41:14.637269 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi May 26 12:41:14.637269 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi [None req-e7ed6cd6-b53e-41e8-a80f-34f1c0ba2bc1 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Returning 409 to user: Cannot 'attach_volume' instance f9200aab-6f49-4e6f-812b-93b2f3e1edd9 while it is in vm_state rescued {{(pid=129321) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 12:41:14.637269 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: INFO nova.api.openstack.requestlog [None req-e7ed6cd6-b53e-41e8-a80f-34f1c0ba2bc1 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] 10.222.0.75 "POST /compute/v2.1/servers/f9200aab-6f49-4e6f-812b-93b2f3e1edd9/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.040159 May 26 12:41:14.637269 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: [pid: 129321|app: 0|req: 155/318] 10.222.0.75 () {60 vars in 1322 bytes} [Thu May 26 12:41:14 2022] POST /compute/v2.1/servers/f9200aab-6f49-4e6f-812b-93b2f3e1edd9/os-volume_attachments => generated 152 bytes in 41 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) May 26 12:41:14.642639 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi [None req-7f84a0cf-107c-4a8d-bd57-30ac35f6cf7d tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=129322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 12:41:14.643312 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.compute.api [None req-7f84a0cf-107c-4a8d-bd57-30ac35f6cf7d tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] [instance: f9200aab-6f49-4e6f-812b-93b2f3e1edd9] Fetching instance by UUID {{(pid=129322) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:41:14.650408 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-7f84a0cf-107c-4a8d-bd57-30ac35f6cf7d tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:41:14.650861 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-7f84a0cf-107c-4a8d-bd57-30ac35f6cf7d tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:41:14.651702 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-7f84a0cf-107c-4a8d-bd57-30ac35f6cf7d tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:41:14.652133 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-7f84a0cf-107c-4a8d-bd57-30ac35f6cf7d tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:41:14.724805 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: INFO nova.api.openstack.requestlog [None req-7f84a0cf-107c-4a8d-bd57-30ac35f6cf7d tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] 10.222.0.75 "POST /compute/v2.1/servers/f9200aab-6f49-4e6f-812b-93b2f3e1edd9/action" status: 202 len: 0 microversion: 2.1 time: 0.085969 May 26 12:41:14.725599 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: [pid: 129322|app: 0|req: 164/319] 10.222.0.75 () {60 vars in 1277 bytes} [Thu May 26 12:41:14 2022] POST /compute/v2.1/servers/f9200aab-6f49-4e6f-812b-93b2f3e1edd9/action => generated 0 bytes in 87 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 26 12:41:14.733850 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi [None req-fff20e15-085e-4910-8a29-ad2127e1657f tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Calling method '>' {{(pid=129321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:41:14.734460 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.compute.api [None req-fff20e15-085e-4910-8a29-ad2127e1657f tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] [instance: f9200aab-6f49-4e6f-812b-93b2f3e1edd9] Fetching instance by UUID {{(pid=129321) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:41:14.741424 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-fff20e15-085e-4910-8a29-ad2127e1657f tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:41:14.741874 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-fff20e15-085e-4910-8a29-ad2127e1657f tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:41:14.742639 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-fff20e15-085e-4910-8a29-ad2127e1657f tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:41:14.743114 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-fff20e15-085e-4910-8a29-ad2127e1657f tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:41:14.878039 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.policy [None req-fff20e15-085e-4910-8a29-ad2127e1657f tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0431b1f25497443ba483b3c440669080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e36ab03283d4ce6a2fed5e111e03d34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129321) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:41:14.886047 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: INFO nova.api.openstack.requestlog [None req-fff20e15-085e-4910-8a29-ad2127e1657f tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] 10.222.0.75 "GET /compute/v2.1/servers/f9200aab-6f49-4e6f-812b-93b2f3e1edd9" status: 200 len: 1509 microversion: 2.1 time: 0.156116 May 26 12:41:14.886597 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: [pid: 129321|app: 0|req: 156/320] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 26 12:41:14 2022] GET /compute/v2.1/servers/f9200aab-6f49-4e6f-812b-93b2f3e1edd9 => generated 1509 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 12:41:15.904587 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi [None req-a4ddb602-cf41-46f6-836b-1cca4148d6f9 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Calling method '>' {{(pid=129322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:41:15.905281 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.compute.api [None req-a4ddb602-cf41-46f6-836b-1cca4148d6f9 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] [instance: f9200aab-6f49-4e6f-812b-93b2f3e1edd9] Fetching instance by UUID {{(pid=129322) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:41:15.913198 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-a4ddb602-cf41-46f6-836b-1cca4148d6f9 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:41:15.913645 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-a4ddb602-cf41-46f6-836b-1cca4148d6f9 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:41:15.914424 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-a4ddb602-cf41-46f6-836b-1cca4148d6f9 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:41:15.914866 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-a4ddb602-cf41-46f6-836b-1cca4148d6f9 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:41:16.051382 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.policy [None req-a4ddb602-cf41-46f6-836b-1cca4148d6f9 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0431b1f25497443ba483b3c440669080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e36ab03283d4ce6a2fed5e111e03d34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129322) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:41:16.059881 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: INFO nova.api.openstack.requestlog [None req-a4ddb602-cf41-46f6-836b-1cca4148d6f9 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] 10.222.0.75 "GET /compute/v2.1/servers/f9200aab-6f49-4e6f-812b-93b2f3e1edd9" status: 200 len: 1509 microversion: 2.1 time: 0.159512 May 26 12:41:16.060719 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: [pid: 129322|app: 0|req: 165/321] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 26 12:41:15 2022] GET /compute/v2.1/servers/f9200aab-6f49-4e6f-812b-93b2f3e1edd9 => generated 1509 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:41:17.077934 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi [None req-242008a6-0437-4069-b5dc-197a64ee3e22 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Calling method '>' {{(pid=129321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:41:17.078550 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.compute.api [None req-242008a6-0437-4069-b5dc-197a64ee3e22 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] [instance: f9200aab-6f49-4e6f-812b-93b2f3e1edd9] Fetching instance by UUID {{(pid=129321) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:41:17.085092 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-242008a6-0437-4069-b5dc-197a64ee3e22 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:41:17.085552 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-242008a6-0437-4069-b5dc-197a64ee3e22 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:41:17.086281 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-242008a6-0437-4069-b5dc-197a64ee3e22 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:41:17.086700 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-242008a6-0437-4069-b5dc-197a64ee3e22 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:41:17.225425 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.policy [None req-242008a6-0437-4069-b5dc-197a64ee3e22 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0431b1f25497443ba483b3c440669080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e36ab03283d4ce6a2fed5e111e03d34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129321) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:41:17.233402 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: INFO nova.api.openstack.requestlog [None req-242008a6-0437-4069-b5dc-197a64ee3e22 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] 10.222.0.75 "GET /compute/v2.1/servers/f9200aab-6f49-4e6f-812b-93b2f3e1edd9" status: 200 len: 1509 microversion: 2.1 time: 0.159477 May 26 12:41:17.233940 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: [pid: 129321|app: 0|req: 157/322] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 26 12:41:17 2022] GET /compute/v2.1/servers/f9200aab-6f49-4e6f-812b-93b2f3e1edd9 => generated 1509 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 12:41:18.251051 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi [None req-71342bb2-1fc9-4cf5-bf4f-d22b4ef243ee tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Calling method '>' {{(pid=129322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:41:18.251697 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.compute.api [None req-71342bb2-1fc9-4cf5-bf4f-d22b4ef243ee tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] [instance: f9200aab-6f49-4e6f-812b-93b2f3e1edd9] Fetching instance by UUID {{(pid=129322) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:41:18.259265 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-71342bb2-1fc9-4cf5-bf4f-d22b4ef243ee tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:41:18.259730 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-71342bb2-1fc9-4cf5-bf4f-d22b4ef243ee tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:41:18.260505 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-71342bb2-1fc9-4cf5-bf4f-d22b4ef243ee tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:41:18.260941 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-71342bb2-1fc9-4cf5-bf4f-d22b4ef243ee tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:41:18.404292 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.policy [None req-71342bb2-1fc9-4cf5-bf4f-d22b4ef243ee tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0431b1f25497443ba483b3c440669080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e36ab03283d4ce6a2fed5e111e03d34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129322) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:41:18.412452 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: INFO nova.api.openstack.requestlog [None req-71342bb2-1fc9-4cf5-bf4f-d22b4ef243ee tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] 10.222.0.75 "GET /compute/v2.1/servers/f9200aab-6f49-4e6f-812b-93b2f3e1edd9" status: 200 len: 1509 microversion: 2.1 time: 0.165353 May 26 12:41:18.413029 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: [pid: 129322|app: 0|req: 166/323] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 26 12:41:18 2022] GET /compute/v2.1/servers/f9200aab-6f49-4e6f-812b-93b2f3e1edd9 => generated 1509 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:41:18.515379 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi [None req-d4333b8a-b4cd-4491-8806-ad7a6cf98c67 tempest-VolumesSnapshotTestJSON-1904508205 tempest-VolumesSnapshotTestJSON-1904508205-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "21fa7315-0f91-4f23-abab-73b75d1374ee", "device": "/dev/sdb"}} {{(pid=129321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 12:41:18.517078 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.compute.api [None req-d4333b8a-b4cd-4491-8806-ad7a6cf98c67 tempest-VolumesSnapshotTestJSON-1904508205 tempest-VolumesSnapshotTestJSON-1904508205-project] [instance: f392ba2b-2b88-4b1a-be61-0cf28ed1443a] Fetching instance by UUID {{(pid=129321) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:41:18.524147 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-d4333b8a-b4cd-4491-8806-ad7a6cf98c67 tempest-VolumesSnapshotTestJSON-1904508205 tempest-VolumesSnapshotTestJSON-1904508205-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:41:18.524599 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-d4333b8a-b4cd-4491-8806-ad7a6cf98c67 tempest-VolumesSnapshotTestJSON-1904508205 tempest-VolumesSnapshotTestJSON-1904508205-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:41:18.525350 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-d4333b8a-b4cd-4491-8806-ad7a6cf98c67 tempest-VolumesSnapshotTestJSON-1904508205 tempest-VolumesSnapshotTestJSON-1904508205-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:41:18.525781 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-d4333b8a-b4cd-4491-8806-ad7a6cf98c67 tempest-VolumesSnapshotTestJSON-1904508205 tempest-VolumesSnapshotTestJSON-1904508205-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:41:19.354382 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: INFO nova.api.openstack.requestlog [None req-d4333b8a-b4cd-4491-8806-ad7a6cf98c67 tempest-VolumesSnapshotTestJSON-1904508205 tempest-VolumesSnapshotTestJSON-1904508205-project] 10.222.0.75 "POST /compute/v2.1/servers/f392ba2b-2b88-4b1a-be61-0cf28ed1443a/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.843032 May 26 12:41:19.355042 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: [pid: 129321|app: 0|req: 158/324] 10.222.0.75 () {60 vars in 1322 bytes} [Thu May 26 12:41:18 2022] POST /compute/v2.1/servers/f392ba2b-2b88-4b1a-be61-0cf28ed1443a/os-volume_attachments => generated 194 bytes in 845 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 12:41:19.430113 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi [None req-4e40f113-6ea3-4829-bdac-6159e3cfdf33 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Calling method '>' {{(pid=129322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:41:19.430776 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.compute.api [None req-4e40f113-6ea3-4829-bdac-6159e3cfdf33 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] [instance: f9200aab-6f49-4e6f-812b-93b2f3e1edd9] Fetching instance by UUID {{(pid=129322) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:41:19.438079 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-4e40f113-6ea3-4829-bdac-6159e3cfdf33 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:41:19.438195 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-4e40f113-6ea3-4829-bdac-6159e3cfdf33 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:41:19.438928 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-4e40f113-6ea3-4829-bdac-6159e3cfdf33 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:41:19.439354 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-4e40f113-6ea3-4829-bdac-6159e3cfdf33 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:41:19.576029 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.policy [None req-4e40f113-6ea3-4829-bdac-6159e3cfdf33 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0431b1f25497443ba483b3c440669080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e36ab03283d4ce6a2fed5e111e03d34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129322) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:41:19.590550 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: INFO nova.api.openstack.requestlog [None req-4e40f113-6ea3-4829-bdac-6159e3cfdf33 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] 10.222.0.75 "GET /compute/v2.1/servers/f9200aab-6f49-4e6f-812b-93b2f3e1edd9" status: 200 len: 1515 microversion: 2.1 time: 0.164318 May 26 12:41:19.591171 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: [pid: 129322|app: 0|req: 167/325] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 26 12:41:19 2022] GET /compute/v2.1/servers/f9200aab-6f49-4e6f-812b-93b2f3e1edd9 => generated 1515 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:41:27.289272 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 26 12:41:27.290025 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: Thu May 26 12:41:27 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 26 12:41:28.301931 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi [None req-cc8a821b-3a1c-4c4d-97dd-d3eb3f307215 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Action: 'create', calling method: .version_select at 0x7f8308a8f790>, body: {"keypair": {"name": "tempest-keypair-1228551541", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA/pbAKR8mqEk2i41qgvK/Y9z2wK6DJ+1HPiKG1j8kY/fyhI+euBl/Konrx61QtYxCU5XnPpSjTld+JYhe+ipH+5wOqCTP7QjKvDWuNxwz0BhK43eyBUfOMYycYAVAuGsA=="}} {{(pid=129321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 12:41:28.322126 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.quota [None req-cc8a821b-3a1c-4c4d-97dd-d3eb3f307215 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Getting quotas for project 9e36ab03283d4ce6a2fed5e111e03d34. Resources: {'key_pairs'} {{(pid=129321) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 26 12:41:28.326113 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.quota [None req-cc8a821b-3a1c-4c4d-97dd-d3eb3f307215 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Getting quotas for user 0431b1f25497443ba483b3c440669080 and project 9e36ab03283d4ce6a2fed5e111e03d34. Resources: {'key_pairs'} {{(pid=129321) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 26 12:41:28.364269 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: INFO nova.api.openstack.requestlog [None req-cc8a821b-3a1c-4c4d-97dd-d3eb3f307215 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] 10.222.0.75 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.067034 May 26 12:41:28.364854 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: [pid: 129321|app: 0|req: 159/326] 10.222.0.75 () {60 vars in 1158 bytes} [Thu May 26 12:41:28 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 12:41:29.969125 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi [None req-4509dd5b-7893-428d-8066-2c763759f670 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1423210955", "imageRef": "1e3c323d-d797-4e6d-bd9a-482d90084b0c", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "2f3dce3a-69e6-47f2-9db3-0b2713db2bee"}], "security_groups": [{"name": "tempest-securitygroup--2021475203"}], "key_name": "tempest-keypair-1228551541", "user_data": "}} {{(pid=129322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 12:41:29.977749 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG dbcounter [-] [129322] Writing DB stats nova_api:SELECT=15 {{(pid=129322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:41:29.978408 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG dbcounter [-] [129322] Writing DB stats nova_cell1:SELECT=51,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:41:30.121685 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.network.neutron [None req-4509dd5b-7893-428d-8066-2c763759f670 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] validate_networks() for [('2f3dce3a-69e6-47f2-9db3-0b2713db2bee', None, None, None, None, None)] {{(pid=129322) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 26 12:41:30.590317 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.virt.hardware [None req-4509dd5b-7893-428d-8066-2c763759f670 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Flavor limits 0:0:0 {{(pid=129322) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 26 12:41:30.590844 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.virt.hardware [None req-4509dd5b-7893-428d-8066-2c763759f670 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Image limits 0:0:0 {{(pid=129322) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 26 12:41:30.591416 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.virt.hardware [None req-4509dd5b-7893-428d-8066-2c763759f670 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Flavor pref 0:0:0 {{(pid=129322) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 26 12:41:30.592346 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.virt.hardware [None req-4509dd5b-7893-428d-8066-2c763759f670 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Image pref 0:0:0 {{(pid=129322) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 26 12:41:30.592887 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.virt.hardware [None req-4509dd5b-7893-428d-8066-2c763759f670 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129322) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 26 12:41:30.614818 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-4509dd5b-7893-428d-8066-2c763759f670 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:41:30.617126 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-4509dd5b-7893-428d-8066-2c763759f670 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:41:30.618067 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-4509dd5b-7893-428d-8066-2c763759f670 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:41:30.618539 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-4509dd5b-7893-428d-8066-2c763759f670 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:41:30.636118 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.quota [None req-4509dd5b-7893-428d-8066-2c763759f670 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Getting quotas for project 9e36ab03283d4ce6a2fed5e111e03d34. Resources: {'instances', 'cores', 'ram'} {{(pid=129322) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 26 12:41:30.640541 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.quota [None req-4509dd5b-7893-428d-8066-2c763759f670 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Getting quotas for user 0431b1f25497443ba483b3c440669080 and project 9e36ab03283d4ce6a2fed5e111e03d34. Resources: {'instances', 'cores', 'ram'} {{(pid=129322) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 26 12:41:30.654272 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.compute.api [None req-4509dd5b-7893-428d-8066-2c763759f670 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Going to run 1 instances... {{(pid=129322) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 26 12:41:30.656880 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.compute.api [None req-4509dd5b-7893-428d-8066-2c763759f670 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] [instance: e911acec-b583-42eb-b5de-dee9573bad6c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1e3c323d-d797-4e6d-bd9a-482d90084b0c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129322) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 26 12:41:30.709109 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: INFO nova.api.openstack.requestlog [None req-4509dd5b-7893-428d-8066-2c763759f670 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] 10.222.0.75 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 0.744193 May 26 12:41:30.710244 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: [pid: 129322|app: 0|req: 168/327] 10.222.0.75 () {60 vars in 1146 bytes} [Thu May 26 12:41:29 2022] POST /compute/v2.1/servers => generated 409 bytes in 746 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 26 12:41:30.720968 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi [None req-3fb2bffd-60fd-4142-ac7a-7f3b341bc3c8 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Calling method '>' {{(pid=129321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:41:30.722783 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.compute.api [None req-3fb2bffd-60fd-4142-ac7a-7f3b341bc3c8 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] [instance: e911acec-b583-42eb-b5de-dee9573bad6c] Fetching instance by UUID {{(pid=129321) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:41:30.734297 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG dbcounter [-] [129321] Writing DB stats nova_cell1:SELECT=44,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=129321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:41:30.753232 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 26 12:41:30.753556 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: Thu May 26 12:41:30 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 26 12:41:30.796605 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.policy [None req-3fb2bffd-60fd-4142-ac7a-7f3b341bc3c8 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0431b1f25497443ba483b3c440669080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e36ab03283d4ce6a2fed5e111e03d34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129321) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:41:30.804359 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: INFO nova.api.openstack.requestlog [None req-3fb2bffd-60fd-4142-ac7a-7f3b341bc3c8 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] 10.222.0.75 "GET /compute/v2.1/servers/e911acec-b583-42eb-b5de-dee9573bad6c" status: 200 len: 1246 microversion: 2.1 time: 0.088041 May 26 12:41:30.804949 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: [pid: 129321|app: 0|req: 160/328] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 26 12:41:30 2022] GET /compute/v2.1/servers/e911acec-b583-42eb-b5de-dee9573bad6c => generated 1246 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:41:31.822616 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi [None req-cbc71887-3ef5-4677-a4aa-0ea21a3f5281 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Calling method '>' {{(pid=129322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:41:31.823281 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.compute.api [None req-cbc71887-3ef5-4677-a4aa-0ea21a3f5281 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] [instance: e911acec-b583-42eb-b5de-dee9573bad6c] Fetching instance by UUID {{(pid=129322) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:41:31.915589 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.policy [None req-cbc71887-3ef5-4677-a4aa-0ea21a3f5281 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0431b1f25497443ba483b3c440669080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e36ab03283d4ce6a2fed5e111e03d34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129322) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:41:31.922373 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: INFO nova.api.openstack.requestlog [None req-cbc71887-3ef5-4677-a4aa-0ea21a3f5281 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] 10.222.0.75 "GET /compute/v2.1/servers/e911acec-b583-42eb-b5de-dee9573bad6c" status: 200 len: 1246 microversion: 2.1 time: 0.104456 May 26 12:41:31.922952 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: [pid: 129322|app: 0|req: 169/329] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 26 12:41:31 2022] GET /compute/v2.1/servers/e911acec-b583-42eb-b5de-dee9573bad6c => generated 1246 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 12:41:32.949408 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi [None req-e06a4e3e-c2d4-493a-aa4a-f6da2cf2f5e7 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Calling method '>' {{(pid=129321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:41:32.950752 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.compute.api [None req-e06a4e3e-c2d4-493a-aa4a-f6da2cf2f5e7 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] [instance: e911acec-b583-42eb-b5de-dee9573bad6c] Fetching instance by UUID {{(pid=129321) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:41:33.110770 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.policy [None req-e06a4e3e-c2d4-493a-aa4a-f6da2cf2f5e7 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0431b1f25497443ba483b3c440669080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e36ab03283d4ce6a2fed5e111e03d34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129321) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:41:33.135065 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: INFO nova.api.openstack.requestlog [None req-e06a4e3e-c2d4-493a-aa4a-f6da2cf2f5e7 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] 10.222.0.75 "GET /compute/v2.1/servers/e911acec-b583-42eb-b5de-dee9573bad6c" status: 200 len: 1246 microversion: 2.1 time: 0.182935 May 26 12:41:33.147792 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: [pid: 129321|app: 0|req: 161/330] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 26 12:41:32 2022] GET /compute/v2.1/servers/e911acec-b583-42eb-b5de-dee9573bad6c => generated 1246 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:41:34.154641 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi [None req-576b6b16-9ebd-41e0-9846-9d513d05a977 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Calling method '>' {{(pid=129322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:41:34.155350 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.compute.api [None req-576b6b16-9ebd-41e0-9846-9d513d05a977 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] [instance: e911acec-b583-42eb-b5de-dee9573bad6c] Fetching instance by UUID {{(pid=129322) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:41:34.253088 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.policy [None req-576b6b16-9ebd-41e0-9846-9d513d05a977 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0431b1f25497443ba483b3c440669080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e36ab03283d4ce6a2fed5e111e03d34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129322) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:41:34.262732 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: INFO nova.api.openstack.requestlog [None req-576b6b16-9ebd-41e0-9846-9d513d05a977 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] 10.222.0.75 "GET /compute/v2.1/servers/e911acec-b583-42eb-b5de-dee9573bad6c" status: 200 len: 1246 microversion: 2.1 time: 0.112054 May 26 12:41:34.265587 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: [pid: 129322|app: 0|req: 170/331] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 26 12:41:34 2022] GET /compute/v2.1/servers/e911acec-b583-42eb-b5de-dee9573bad6c => generated 1246 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:41:35.282579 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi [None req-7546ab25-136f-4c60-bc55-5d69df55d29e tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Calling method '>' {{(pid=129321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:41:35.283357 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.compute.api [None req-7546ab25-136f-4c60-bc55-5d69df55d29e tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] [instance: e911acec-b583-42eb-b5de-dee9573bad6c] Fetching instance by UUID {{(pid=129321) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:41:35.298498 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-7546ab25-136f-4c60-bc55-5d69df55d29e tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:41:35.299134 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-7546ab25-136f-4c60-bc55-5d69df55d29e tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:41:35.300019 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-7546ab25-136f-4c60-bc55-5d69df55d29e tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:41:35.301702 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-7546ab25-136f-4c60-bc55-5d69df55d29e tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:41:35.481354 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.policy [None req-7546ab25-136f-4c60-bc55-5d69df55d29e tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0431b1f25497443ba483b3c440669080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e36ab03283d4ce6a2fed5e111e03d34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129321) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:41:35.496006 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: INFO nova.api.openstack.requestlog [None req-7546ab25-136f-4c60-bc55-5d69df55d29e tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] 10.222.0.75 "GET /compute/v2.1/servers/e911acec-b583-42eb-b5de-dee9573bad6c" status: 200 len: 1250 microversion: 2.1 time: 0.212605 May 26 12:41:35.508052 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: [pid: 129321|app: 0|req: 162/332] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 26 12:41:35 2022] GET /compute/v2.1/servers/e911acec-b583-42eb-b5de-dee9573bad6c => generated 1250 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:41:36.519093 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi [None req-8e3da38b-32ff-4343-b34c-41f8aa6d2167 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Calling method '>' {{(pid=129322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:41:36.520536 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.compute.api [None req-8e3da38b-32ff-4343-b34c-41f8aa6d2167 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] [instance: e911acec-b583-42eb-b5de-dee9573bad6c] Fetching instance by UUID {{(pid=129322) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:41:36.541541 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-8e3da38b-32ff-4343-b34c-41f8aa6d2167 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:41:36.541996 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-8e3da38b-32ff-4343-b34c-41f8aa6d2167 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:41:36.543777 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-8e3da38b-32ff-4343-b34c-41f8aa6d2167 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:41:36.545966 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-8e3da38b-32ff-4343-b34c-41f8aa6d2167 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:41:36.703048 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.policy [None req-8e3da38b-32ff-4343-b34c-41f8aa6d2167 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0431b1f25497443ba483b3c440669080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e36ab03283d4ce6a2fed5e111e03d34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129322) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:41:36.713228 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: INFO nova.api.openstack.requestlog [None req-8e3da38b-32ff-4343-b34c-41f8aa6d2167 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] 10.222.0.75 "GET /compute/v2.1/servers/e911acec-b583-42eb-b5de-dee9573bad6c" status: 200 len: 1250 microversion: 2.1 time: 0.202208 May 26 12:41:36.715685 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: [pid: 129322|app: 0|req: 171/333] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 26 12:41:36 2022] GET /compute/v2.1/servers/e911acec-b583-42eb-b5de-dee9573bad6c => generated 1250 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:41:37.732459 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi [None req-87f1d754-9fd9-4159-a081-33a6611e4d7e tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Calling method '>' {{(pid=129321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:41:37.733515 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.compute.api [None req-87f1d754-9fd9-4159-a081-33a6611e4d7e tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] [instance: e911acec-b583-42eb-b5de-dee9573bad6c] Fetching instance by UUID {{(pid=129321) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:41:37.747502 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-87f1d754-9fd9-4159-a081-33a6611e4d7e tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:41:37.748207 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-87f1d754-9fd9-4159-a081-33a6611e4d7e tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:41:37.749685 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-87f1d754-9fd9-4159-a081-33a6611e4d7e tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:41:37.750202 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-87f1d754-9fd9-4159-a081-33a6611e4d7e tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:41:37.889167 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.policy [None req-87f1d754-9fd9-4159-a081-33a6611e4d7e tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0431b1f25497443ba483b3c440669080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e36ab03283d4ce6a2fed5e111e03d34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129321) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:41:37.899181 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: INFO nova.api.openstack.requestlog [None req-87f1d754-9fd9-4159-a081-33a6611e4d7e tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] 10.222.0.75 "GET /compute/v2.1/servers/e911acec-b583-42eb-b5de-dee9573bad6c" status: 200 len: 1250 microversion: 2.1 time: 0.170428 May 26 12:41:37.900378 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: [pid: 129321|app: 0|req: 163/334] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 26 12:41:37 2022] GET /compute/v2.1/servers/e911acec-b583-42eb-b5de-dee9573bad6c => generated 1250 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:41:38.918494 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi [None req-90e43aa4-4401-4aea-9a8d-ac977008cd07 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Calling method '>' {{(pid=129322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:41:38.919126 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.compute.api [None req-90e43aa4-4401-4aea-9a8d-ac977008cd07 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] [instance: e911acec-b583-42eb-b5de-dee9573bad6c] Fetching instance by UUID {{(pid=129322) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:41:38.927357 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-90e43aa4-4401-4aea-9a8d-ac977008cd07 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:41:38.927740 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-90e43aa4-4401-4aea-9a8d-ac977008cd07 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:41:38.929320 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-90e43aa4-4401-4aea-9a8d-ac977008cd07 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:41:38.929808 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-90e43aa4-4401-4aea-9a8d-ac977008cd07 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:41:39.131589 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.policy [None req-90e43aa4-4401-4aea-9a8d-ac977008cd07 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0431b1f25497443ba483b3c440669080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e36ab03283d4ce6a2fed5e111e03d34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129322) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:41:39.143179 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: INFO nova.api.openstack.requestlog [None req-90e43aa4-4401-4aea-9a8d-ac977008cd07 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] 10.222.0.75 "GET /compute/v2.1/servers/e911acec-b583-42eb-b5de-dee9573bad6c" status: 200 len: 1250 microversion: 2.1 time: 0.229220 May 26 12:41:39.143369 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: [pid: 129322|app: 0|req: 172/335] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 26 12:41:38 2022] GET /compute/v2.1/servers/e911acec-b583-42eb-b5de-dee9573bad6c => generated 1250 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:41:40.160867 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi [None req-b9951156-441e-4b79-afbb-4db34467e58e tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Calling method '>' {{(pid=129321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:41:40.161389 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.compute.api [None req-b9951156-441e-4b79-afbb-4db34467e58e tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] [instance: e911acec-b583-42eb-b5de-dee9573bad6c] Fetching instance by UUID {{(pid=129321) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:41:40.167836 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG dbcounter [-] [129321] Writing DB stats nova_api:SELECT=37,nova_api:INSERT=1 {{(pid=129321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:41:40.170084 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-b9951156-441e-4b79-afbb-4db34467e58e tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:41:40.170731 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-b9951156-441e-4b79-afbb-4db34467e58e tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:41:40.172517 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-b9951156-441e-4b79-afbb-4db34467e58e tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:41:40.173295 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-b9951156-441e-4b79-afbb-4db34467e58e tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:41:40.251513 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.policy [None req-b9951156-441e-4b79-afbb-4db34467e58e tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0431b1f25497443ba483b3c440669080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e36ab03283d4ce6a2fed5e111e03d34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129321) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:41:40.259780 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: INFO nova.api.openstack.requestlog [None req-b9951156-441e-4b79-afbb-4db34467e58e tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] 10.222.0.75 "GET /compute/v2.1/servers/e911acec-b583-42eb-b5de-dee9573bad6c" status: 200 len: 1250 microversion: 2.1 time: 0.103202 May 26 12:41:40.270148 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: [pid: 129321|app: 0|req: 164/336] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 26 12:41:40 2022] GET /compute/v2.1/servers/e911acec-b583-42eb-b5de-dee9573bad6c => generated 1250 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:41:41.278897 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi [None req-c9c5f180-6eb1-46d6-b20c-765d8990617a tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Calling method '>' {{(pid=129322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:41:41.279513 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.compute.api [None req-c9c5f180-6eb1-46d6-b20c-765d8990617a tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] [instance: e911acec-b583-42eb-b5de-dee9573bad6c] Fetching instance by UUID {{(pid=129322) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:41:41.283311 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG dbcounter [-] [129322] Writing DB stats nova_cell0:SELECT=2 {{(pid=129322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:41:41.300222 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-c9c5f180-6eb1-46d6-b20c-765d8990617a tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:41:41.302223 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-c9c5f180-6eb1-46d6-b20c-765d8990617a tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:41:41.303128 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-c9c5f180-6eb1-46d6-b20c-765d8990617a tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:41:41.303596 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-c9c5f180-6eb1-46d6-b20c-765d8990617a tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:41:41.486234 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.policy [None req-c9c5f180-6eb1-46d6-b20c-765d8990617a tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0431b1f25497443ba483b3c440669080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e36ab03283d4ce6a2fed5e111e03d34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129322) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:41:41.505870 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: INFO nova.api.openstack.requestlog [None req-c9c5f180-6eb1-46d6-b20c-765d8990617a tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] 10.222.0.75 "GET /compute/v2.1/servers/e911acec-b583-42eb-b5de-dee9573bad6c" status: 200 len: 1250 microversion: 2.1 time: 0.231657 May 26 12:41:41.506792 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: [pid: 129322|app: 0|req: 173/337] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 26 12:41:41 2022] GET /compute/v2.1/servers/e911acec-b583-42eb-b5de-dee9573bad6c => generated 1250 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:41:42.523877 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi [None req-b3e9ce35-93ab-4ded-a521-5426140f886a tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Calling method '>' {{(pid=129321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:41:42.524639 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.compute.api [None req-b3e9ce35-93ab-4ded-a521-5426140f886a tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] [instance: e911acec-b583-42eb-b5de-dee9573bad6c] Fetching instance by UUID {{(pid=129321) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:41:42.538132 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-b3e9ce35-93ab-4ded-a521-5426140f886a tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:41:42.538668 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-b3e9ce35-93ab-4ded-a521-5426140f886a tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:41:42.539502 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-b3e9ce35-93ab-4ded-a521-5426140f886a tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:41:42.539969 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-b3e9ce35-93ab-4ded-a521-5426140f886a tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:41:42.675854 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.policy [None req-b3e9ce35-93ab-4ded-a521-5426140f886a tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0431b1f25497443ba483b3c440669080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e36ab03283d4ce6a2fed5e111e03d34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129321) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:41:42.686605 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: INFO nova.api.openstack.requestlog [None req-b3e9ce35-93ab-4ded-a521-5426140f886a tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] 10.222.0.75 "GET /compute/v2.1/servers/e911acec-b583-42eb-b5de-dee9573bad6c" status: 200 len: 1250 microversion: 2.1 time: 0.167291 May 26 12:41:42.696171 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: [pid: 129321|app: 0|req: 165/338] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 26 12:41:42 2022] GET /compute/v2.1/servers/e911acec-b583-42eb-b5de-dee9573bad6c => generated 1250 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:41:43.715042 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi [None req-b3a81a3a-cc3e-4a25-9b7e-91ed684d30fc tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Calling method '>' {{(pid=129322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:41:43.715965 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.compute.api [None req-b3a81a3a-cc3e-4a25-9b7e-91ed684d30fc tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] [instance: e911acec-b583-42eb-b5de-dee9573bad6c] Fetching instance by UUID {{(pid=129322) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:41:43.734366 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-b3a81a3a-cc3e-4a25-9b7e-91ed684d30fc tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:41:43.736433 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-b3a81a3a-cc3e-4a25-9b7e-91ed684d30fc tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:41:43.742416 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-b3a81a3a-cc3e-4a25-9b7e-91ed684d30fc tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:41:43.744696 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-b3a81a3a-cc3e-4a25-9b7e-91ed684d30fc tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:41:44.205082 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.policy [None req-b3a81a3a-cc3e-4a25-9b7e-91ed684d30fc tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0431b1f25497443ba483b3c440669080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e36ab03283d4ce6a2fed5e111e03d34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129322) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:41:44.238326 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: INFO nova.api.openstack.requestlog [None req-b3a81a3a-cc3e-4a25-9b7e-91ed684d30fc tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] 10.222.0.75 "GET /compute/v2.1/servers/e911acec-b583-42eb-b5de-dee9573bad6c" status: 200 len: 1242 microversion: 2.1 time: 0.528192 May 26 12:41:44.249426 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: [pid: 129322|app: 0|req: 174/339] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 26 12:41:43 2022] GET /compute/v2.1/servers/e911acec-b583-42eb-b5de-dee9573bad6c => generated 1242 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:41:44.397395 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi [None req-b1b5d3d7-095b-4d81-afa1-17b74cca5b06 tempest-VolumesActionsTest-731506124 tempest-VolumesActionsTest-731506124-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1752273516", "imageRef": "1e3c323d-d797-4e6d-bd9a-482d90084b0c", "flavorRef": "452", "networks": [{"uuid": "83770523-1304-41d2-9774-40ab1498ec55"}]}} {{(pid=129321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 12:41:44.417703 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG dbcounter [-] [129321] Writing DB stats nova_cell0:SELECT=8 {{(pid=129321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:41:44.502547 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.network.neutron [None req-b1b5d3d7-095b-4d81-afa1-17b74cca5b06 tempest-VolumesActionsTest-731506124 tempest-VolumesActionsTest-731506124-project] validate_networks() for [('83770523-1304-41d2-9774-40ab1498ec55', None, None, None, None, None)] {{(pid=129321) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 26 12:41:45.269564 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi [None req-28722414-0e25-4902-9586-246336616536 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Calling method '>' {{(pid=129322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:41:45.270837 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.compute.api [None req-28722414-0e25-4902-9586-246336616536 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] [instance: e911acec-b583-42eb-b5de-dee9573bad6c] Fetching instance by UUID {{(pid=129322) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:41:45.274603 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG dbcounter [-] [129322] Writing DB stats nova_cell0:SELECT=10 {{(pid=129322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:41:45.305097 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-28722414-0e25-4902-9586-246336616536 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:41:45.308034 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-28722414-0e25-4902-9586-246336616536 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:41:45.312084 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-28722414-0e25-4902-9586-246336616536 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:41:45.321246 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-28722414-0e25-4902-9586-246336616536 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:41:45.858623 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.policy [None req-28722414-0e25-4902-9586-246336616536 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0431b1f25497443ba483b3c440669080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e36ab03283d4ce6a2fed5e111e03d34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129322) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:41:45.866818 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: INFO nova.api.openstack.requestlog [None req-28722414-0e25-4902-9586-246336616536 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] 10.222.0.75 "GET /compute/v2.1/servers/e911acec-b583-42eb-b5de-dee9573bad6c" status: 200 len: 1306 microversion: 2.1 time: 0.609367 May 26 12:41:45.867710 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: [pid: 129322|app: 0|req: 175/340] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 26 12:41:45 2022] GET /compute/v2.1/servers/e911acec-b583-42eb-b5de-dee9573bad6c => generated 1306 bytes in 611 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:41:46.013707 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.virt.hardware [None req-b1b5d3d7-095b-4d81-afa1-17b74cca5b06 tempest-VolumesActionsTest-731506124 tempest-VolumesActionsTest-731506124-project] Flavor limits 0:0:0 {{(pid=129321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 26 12:41:46.016210 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.virt.hardware [None req-b1b5d3d7-095b-4d81-afa1-17b74cca5b06 tempest-VolumesActionsTest-731506124 tempest-VolumesActionsTest-731506124-project] Image limits 0:0:0 {{(pid=129321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 26 12:41:46.016975 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.virt.hardware [None req-b1b5d3d7-095b-4d81-afa1-17b74cca5b06 tempest-VolumesActionsTest-731506124 tempest-VolumesActionsTest-731506124-project] Flavor pref 0:0:0 {{(pid=129321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 26 12:41:46.017607 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.virt.hardware [None req-b1b5d3d7-095b-4d81-afa1-17b74cca5b06 tempest-VolumesActionsTest-731506124 tempest-VolumesActionsTest-731506124-project] Image pref 0:0:0 {{(pid=129321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 26 12:41:46.018587 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.virt.hardware [None req-b1b5d3d7-095b-4d81-afa1-17b74cca5b06 tempest-VolumesActionsTest-731506124 tempest-VolumesActionsTest-731506124-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 26 12:41:46.032979 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-b1b5d3d7-095b-4d81-afa1-17b74cca5b06 tempest-VolumesActionsTest-731506124 tempest-VolumesActionsTest-731506124-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:41:46.033944 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-b1b5d3d7-095b-4d81-afa1-17b74cca5b06 tempest-VolumesActionsTest-731506124 tempest-VolumesActionsTest-731506124-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:41:46.036543 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-b1b5d3d7-095b-4d81-afa1-17b74cca5b06 tempest-VolumesActionsTest-731506124 tempest-VolumesActionsTest-731506124-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:41:46.037239 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-b1b5d3d7-095b-4d81-afa1-17b74cca5b06 tempest-VolumesActionsTest-731506124 tempest-VolumesActionsTest-731506124-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:41:46.067471 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.quota [None req-b1b5d3d7-095b-4d81-afa1-17b74cca5b06 tempest-VolumesActionsTest-731506124 tempest-VolumesActionsTest-731506124-project] Getting quotas for project ffa93879e60e470185e8dd71efaaf1a9. Resources: {'instances', 'cores', 'ram'} {{(pid=129321) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 26 12:41:46.072701 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.quota [None req-b1b5d3d7-095b-4d81-afa1-17b74cca5b06 tempest-VolumesActionsTest-731506124 tempest-VolumesActionsTest-731506124-project] Getting quotas for user f39e076a9e6b401db6de9a2846519591 and project ffa93879e60e470185e8dd71efaaf1a9. Resources: {'instances', 'cores', 'ram'} {{(pid=129321) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 26 12:41:46.090795 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.compute.api [None req-b1b5d3d7-095b-4d81-afa1-17b74cca5b06 tempest-VolumesActionsTest-731506124 tempest-VolumesActionsTest-731506124-project] Going to run 1 instances... {{(pid=129321) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 26 12:41:46.095570 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.compute.api [None req-b1b5d3d7-095b-4d81-afa1-17b74cca5b06 tempest-VolumesActionsTest-731506124 tempest-VolumesActionsTest-731506124-project] [instance: 2be10a9b-0300-40be-96eb-602b1ad4b05c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1e3c323d-d797-4e6d-bd9a-482d90084b0c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129321) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 26 12:41:46.169902 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: INFO nova.api.openstack.requestlog [None req-b1b5d3d7-095b-4d81-afa1-17b74cca5b06 tempest-VolumesActionsTest-731506124 tempest-VolumesActionsTest-731506124-project] 10.222.0.75 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.776788 May 26 12:41:46.171016 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: [pid: 129321|app: 0|req: 166/341] 10.222.0.75 () {60 vars in 1146 bytes} [Thu May 26 12:41:44 2022] POST /compute/v2.1/servers => generated 380 bytes in 1779 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 26 12:41:46.184405 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi [None req-3373bc78-a09f-47aa-9738-d5564d582d87 tempest-VolumesActionsTest-731506124 tempest-VolumesActionsTest-731506124-project] Calling method '>' {{(pid=129322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:41:46.185941 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.compute.api [None req-3373bc78-a09f-47aa-9738-d5564d582d87 tempest-VolumesActionsTest-731506124 tempest-VolumesActionsTest-731506124-project] [instance: 2be10a9b-0300-40be-96eb-602b1ad4b05c] Fetching instance by UUID {{(pid=129322) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:41:46.267039 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.policy [None req-3373bc78-a09f-47aa-9738-d5564d582d87 tempest-VolumesActionsTest-731506124 tempest-VolumesActionsTest-731506124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f39e076a9e6b401db6de9a2846519591', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa93879e60e470185e8dd71efaaf1a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129322) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:41:46.276218 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: INFO nova.api.openstack.requestlog [None req-3373bc78-a09f-47aa-9738-d5564d582d87 tempest-VolumesActionsTest-731506124 tempest-VolumesActionsTest-731506124-project] 10.222.0.75 "GET /compute/v2.1/servers/2be10a9b-0300-40be-96eb-602b1ad4b05c" status: 200 len: 1214 microversion: 2.1 time: 0.096564 May 26 12:41:46.278116 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: [pid: 129322|app: 0|req: 176/342] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 26 12:41:46 2022] GET /compute/v2.1/servers/2be10a9b-0300-40be-96eb-602b1ad4b05c => generated 1214 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:41:46.885846 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi [None req-0d0f3e95-23a3-4489-baba-fe61815adbfe tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Calling method '>' {{(pid=129321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:41:46.886517 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.compute.api [None req-0d0f3e95-23a3-4489-baba-fe61815adbfe tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] [instance: e911acec-b583-42eb-b5de-dee9573bad6c] Fetching instance by UUID {{(pid=129321) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:41:46.905134 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-0d0f3e95-23a3-4489-baba-fe61815adbfe tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:41:46.905605 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-0d0f3e95-23a3-4489-baba-fe61815adbfe tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:41:46.907713 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-0d0f3e95-23a3-4489-baba-fe61815adbfe tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:41:46.908411 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-0d0f3e95-23a3-4489-baba-fe61815adbfe tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:41:47.213704 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.policy [None req-0d0f3e95-23a3-4489-baba-fe61815adbfe tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0431b1f25497443ba483b3c440669080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e36ab03283d4ce6a2fed5e111e03d34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129321) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:41:47.225408 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: INFO nova.api.openstack.requestlog [None req-0d0f3e95-23a3-4489-baba-fe61815adbfe tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] 10.222.0.75 "GET /compute/v2.1/servers/e911acec-b583-42eb-b5de-dee9573bad6c" status: 200 len: 1372 microversion: 2.1 time: 0.343839 May 26 12:41:47.227406 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: [pid: 129321|app: 0|req: 167/343] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 26 12:41:46 2022] GET /compute/v2.1/servers/e911acec-b583-42eb-b5de-dee9573bad6c => generated 1372 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:41:47.297928 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi [None req-bb69f972-70e0-4c9b-aac0-66ba5020bb09 tempest-VolumesActionsTest-731506124 tempest-VolumesActionsTest-731506124-project] Calling method '>' {{(pid=129322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:41:47.298980 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.compute.api [None req-bb69f972-70e0-4c9b-aac0-66ba5020bb09 tempest-VolumesActionsTest-731506124 tempest-VolumesActionsTest-731506124-project] [instance: 2be10a9b-0300-40be-96eb-602b1ad4b05c] Fetching instance by UUID {{(pid=129322) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:41:47.308585 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-bb69f972-70e0-4c9b-aac0-66ba5020bb09 tempest-VolumesActionsTest-731506124 tempest-VolumesActionsTest-731506124-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:41:47.309186 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-bb69f972-70e0-4c9b-aac0-66ba5020bb09 tempest-VolumesActionsTest-731506124 tempest-VolumesActionsTest-731506124-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:41:47.310102 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-bb69f972-70e0-4c9b-aac0-66ba5020bb09 tempest-VolumesActionsTest-731506124 tempest-VolumesActionsTest-731506124-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:41:47.310505 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-bb69f972-70e0-4c9b-aac0-66ba5020bb09 tempest-VolumesActionsTest-731506124 tempest-VolumesActionsTest-731506124-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:41:47.403000 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.policy [None req-bb69f972-70e0-4c9b-aac0-66ba5020bb09 tempest-VolumesActionsTest-731506124 tempest-VolumesActionsTest-731506124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f39e076a9e6b401db6de9a2846519591', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa93879e60e470185e8dd71efaaf1a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129322) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:41:47.417071 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: INFO nova.api.openstack.requestlog [None req-bb69f972-70e0-4c9b-aac0-66ba5020bb09 tempest-VolumesActionsTest-731506124 tempest-VolumesActionsTest-731506124-project] 10.222.0.75 "GET /compute/v2.1/servers/2be10a9b-0300-40be-96eb-602b1ad4b05c" status: 200 len: 1218 microversion: 2.1 time: 0.125754 May 26 12:41:47.418103 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: [pid: 129322|app: 0|req: 177/344] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 26 12:41:47 2022] GET /compute/v2.1/servers/2be10a9b-0300-40be-96eb-602b1ad4b05c => generated 1218 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:41:48.245144 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi [None req-ac522a77-61de-496d-8aeb-8dbd6e358d72 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Calling method '>' {{(pid=129321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:41:48.247195 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.compute.api [None req-ac522a77-61de-496d-8aeb-8dbd6e358d72 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] [instance: e911acec-b583-42eb-b5de-dee9573bad6c] Fetching instance by UUID {{(pid=129321) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:41:48.263664 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-ac522a77-61de-496d-8aeb-8dbd6e358d72 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:41:48.265633 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-ac522a77-61de-496d-8aeb-8dbd6e358d72 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:41:48.266725 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-ac522a77-61de-496d-8aeb-8dbd6e358d72 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:41:48.268955 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-ac522a77-61de-496d-8aeb-8dbd6e358d72 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:41:48.435470 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi [None req-1a025199-f9a0-4769-a63b-f98baf0417ca tempest-VolumesActionsTest-731506124 tempest-VolumesActionsTest-731506124-project] Calling method '>' {{(pid=129322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:41:48.437186 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.compute.api [None req-1a025199-f9a0-4769-a63b-f98baf0417ca tempest-VolumesActionsTest-731506124 tempest-VolumesActionsTest-731506124-project] [instance: 2be10a9b-0300-40be-96eb-602b1ad4b05c] Fetching instance by UUID {{(pid=129322) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:41:48.457636 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-1a025199-f9a0-4769-a63b-f98baf0417ca tempest-VolumesActionsTest-731506124 tempest-VolumesActionsTest-731506124-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:41:48.457900 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-1a025199-f9a0-4769-a63b-f98baf0417ca tempest-VolumesActionsTest-731506124 tempest-VolumesActionsTest-731506124-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:41:48.461363 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-1a025199-f9a0-4769-a63b-f98baf0417ca tempest-VolumesActionsTest-731506124 tempest-VolumesActionsTest-731506124-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:41:48.462224 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-1a025199-f9a0-4769-a63b-f98baf0417ca tempest-VolumesActionsTest-731506124 tempest-VolumesActionsTest-731506124-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:41:48.566455 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.policy [None req-1a025199-f9a0-4769-a63b-f98baf0417ca tempest-VolumesActionsTest-731506124 tempest-VolumesActionsTest-731506124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f39e076a9e6b401db6de9a2846519591', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa93879e60e470185e8dd71efaaf1a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129322) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:41:48.581937 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.policy [None req-ac522a77-61de-496d-8aeb-8dbd6e358d72 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0431b1f25497443ba483b3c440669080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e36ab03283d4ce6a2fed5e111e03d34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129321) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:41:48.602688 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: INFO nova.api.openstack.requestlog [None req-1a025199-f9a0-4769-a63b-f98baf0417ca tempest-VolumesActionsTest-731506124 tempest-VolumesActionsTest-731506124-project] 10.222.0.75 "GET /compute/v2.1/servers/2be10a9b-0300-40be-96eb-602b1ad4b05c" status: 200 len: 1218 microversion: 2.1 time: 0.171444 May 26 12:41:48.622741 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: INFO nova.api.openstack.requestlog [None req-ac522a77-61de-496d-8aeb-8dbd6e358d72 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] 10.222.0.75 "GET /compute/v2.1/servers/e911acec-b583-42eb-b5de-dee9573bad6c" status: 200 len: 1372 microversion: 2.1 time: 0.376931 May 26 12:41:48.623856 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: [pid: 129322|app: 0|req: 178/345] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 26 12:41:48 2022] GET /compute/v2.1/servers/2be10a9b-0300-40be-96eb-602b1ad4b05c => generated 1218 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:41:48.625057 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: [pid: 129321|app: 0|req: 168/346] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 26 12:41:48 2022] GET /compute/v2.1/servers/e911acec-b583-42eb-b5de-dee9573bad6c => generated 1372 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:41:49.631311 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi [None req-f5c4273c-48ef-4f56-af41-f5439a99cc2e tempest-VolumesActionsTest-731506124 tempest-VolumesActionsTest-731506124-project] Calling method '>' {{(pid=129322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:41:49.632110 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.compute.api [None req-f5c4273c-48ef-4f56-af41-f5439a99cc2e tempest-VolumesActionsTest-731506124 tempest-VolumesActionsTest-731506124-project] [instance: 2be10a9b-0300-40be-96eb-602b1ad4b05c] Fetching instance by UUID {{(pid=129322) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:41:49.650731 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi [None req-bd653920-43e0-4538-96a4-18b1acab9cb1 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Calling method '>' {{(pid=129321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:41:49.651708 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.compute.api [None req-bd653920-43e0-4538-96a4-18b1acab9cb1 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] [instance: e911acec-b583-42eb-b5de-dee9573bad6c] Fetching instance by UUID {{(pid=129321) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:41:49.667078 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-bd653920-43e0-4538-96a4-18b1acab9cb1 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:41:49.669256 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-f5c4273c-48ef-4f56-af41-f5439a99cc2e tempest-VolumesActionsTest-731506124 tempest-VolumesActionsTest-731506124-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:41:49.675748 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-f5c4273c-48ef-4f56-af41-f5439a99cc2e tempest-VolumesActionsTest-731506124 tempest-VolumesActionsTest-731506124-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:41:49.677327 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-bd653920-43e0-4538-96a4-18b1acab9cb1 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:41:49.678397 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-f5c4273c-48ef-4f56-af41-f5439a99cc2e tempest-VolumesActionsTest-731506124 tempest-VolumesActionsTest-731506124-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:41:49.679441 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-bd653920-43e0-4538-96a4-18b1acab9cb1 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:41:49.680312 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-f5c4273c-48ef-4f56-af41-f5439a99cc2e tempest-VolumesActionsTest-731506124 tempest-VolumesActionsTest-731506124-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:41:49.683298 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-bd653920-43e0-4538-96a4-18b1acab9cb1 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:41:49.831139 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.policy [None req-f5c4273c-48ef-4f56-af41-f5439a99cc2e tempest-VolumesActionsTest-731506124 tempest-VolumesActionsTest-731506124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f39e076a9e6b401db6de9a2846519591', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa93879e60e470185e8dd71efaaf1a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129322) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:41:49.843967 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: INFO nova.api.openstack.requestlog [None req-f5c4273c-48ef-4f56-af41-f5439a99cc2e tempest-VolumesActionsTest-731506124 tempest-VolumesActionsTest-731506124-project] 10.222.0.75 "GET /compute/v2.1/servers/2be10a9b-0300-40be-96eb-602b1ad4b05c" status: 200 len: 1218 microversion: 2.1 time: 0.217336 May 26 12:41:49.855982 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: [pid: 129322|app: 0|req: 179/347] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 26 12:41:49 2022] GET /compute/v2.1/servers/2be10a9b-0300-40be-96eb-602b1ad4b05c => generated 1218 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:41:50.057366 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.policy [None req-bd653920-43e0-4538-96a4-18b1acab9cb1 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0431b1f25497443ba483b3c440669080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e36ab03283d4ce6a2fed5e111e03d34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129321) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:41:50.074051 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: INFO nova.api.openstack.requestlog [None req-bd653920-43e0-4538-96a4-18b1acab9cb1 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] 10.222.0.75 "GET /compute/v2.1/servers/e911acec-b583-42eb-b5de-dee9573bad6c" status: 200 len: 1372 microversion: 2.1 time: 0.435545 May 26 12:41:50.078054 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: [pid: 129321|app: 0|req: 169/348] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 26 12:41:49 2022] GET /compute/v2.1/servers/e911acec-b583-42eb-b5de-dee9573bad6c => generated 1372 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:41:50.863997 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi [None req-8f112b9c-51f0-40a8-8dfa-166b0c1b5ea7 tempest-VolumesActionsTest-731506124 tempest-VolumesActionsTest-731506124-project] Calling method '>' {{(pid=129322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:41:50.865497 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.compute.api [None req-8f112b9c-51f0-40a8-8dfa-166b0c1b5ea7 tempest-VolumesActionsTest-731506124 tempest-VolumesActionsTest-731506124-project] [instance: 2be10a9b-0300-40be-96eb-602b1ad4b05c] Fetching instance by UUID {{(pid=129322) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:41:50.895203 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-8f112b9c-51f0-40a8-8dfa-166b0c1b5ea7 tempest-VolumesActionsTest-731506124 tempest-VolumesActionsTest-731506124-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:41:50.898604 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-8f112b9c-51f0-40a8-8dfa-166b0c1b5ea7 tempest-VolumesActionsTest-731506124 tempest-VolumesActionsTest-731506124-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:41:50.900882 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-8f112b9c-51f0-40a8-8dfa-166b0c1b5ea7 tempest-VolumesActionsTest-731506124 tempest-VolumesActionsTest-731506124-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:41:50.902310 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-8f112b9c-51f0-40a8-8dfa-166b0c1b5ea7 tempest-VolumesActionsTest-731506124 tempest-VolumesActionsTest-731506124-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:41:51.034526 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.policy [None req-8f112b9c-51f0-40a8-8dfa-166b0c1b5ea7 tempest-VolumesActionsTest-731506124 tempest-VolumesActionsTest-731506124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f39e076a9e6b401db6de9a2846519591', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa93879e60e470185e8dd71efaaf1a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129322) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:41:51.051865 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: INFO nova.api.openstack.requestlog [None req-8f112b9c-51f0-40a8-8dfa-166b0c1b5ea7 tempest-VolumesActionsTest-731506124 tempest-VolumesActionsTest-731506124-project] 10.222.0.75 "GET /compute/v2.1/servers/2be10a9b-0300-40be-96eb-602b1ad4b05c" status: 200 len: 1274 microversion: 2.1 time: 0.189622 May 26 12:41:51.053402 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: [pid: 129322|app: 0|req: 180/349] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 26 12:41:50 2022] GET /compute/v2.1/servers/2be10a9b-0300-40be-96eb-602b1ad4b05c => generated 1274 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:41:51.097084 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi [None req-48b839de-6b75-4543-b0ac-1777a54ba80b tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Calling method '>' {{(pid=129321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:41:51.097746 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.compute.api [None req-48b839de-6b75-4543-b0ac-1777a54ba80b tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] [instance: e911acec-b583-42eb-b5de-dee9573bad6c] Fetching instance by UUID {{(pid=129321) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:41:51.118075 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-48b839de-6b75-4543-b0ac-1777a54ba80b tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:41:51.119921 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-48b839de-6b75-4543-b0ac-1777a54ba80b tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:41:51.122538 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-48b839de-6b75-4543-b0ac-1777a54ba80b tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:41:51.123077 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-48b839de-6b75-4543-b0ac-1777a54ba80b tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:41:51.655876 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.policy [None req-48b839de-6b75-4543-b0ac-1777a54ba80b tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0431b1f25497443ba483b3c440669080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e36ab03283d4ce6a2fed5e111e03d34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129321) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:41:51.665674 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: INFO nova.api.openstack.requestlog [None req-48b839de-6b75-4543-b0ac-1777a54ba80b tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] 10.222.0.75 "GET /compute/v2.1/servers/e911acec-b583-42eb-b5de-dee9573bad6c" status: 200 len: 1372 microversion: 2.1 time: 0.574992 May 26 12:41:51.674677 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: [pid: 129321|app: 0|req: 170/350] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 26 12:41:51 2022] GET /compute/v2.1/servers/e911acec-b583-42eb-b5de-dee9573bad6c => generated 1372 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:41:51.910745 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi [req-cdb7c736-dce0-48b0-bab0-6f437260db1f req-b8060b88-d32d-4e1c-9669-432fc073a7c6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e911acec-b583-42eb-b5de-dee9573bad6c", "tag": "fc5a0b73-9cdf-4e1b-8b93-f12bfc2ac6a4"}]} {{(pid=129322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 12:41:51.930004 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [req-cdb7c736-dce0-48b0-bab0-6f437260db1f req-b8060b88-d32d-4e1c-9669-432fc073a7c6 service nova] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:41:51.931158 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [req-cdb7c736-dce0-48b0-bab0-6f437260db1f req-b8060b88-d32d-4e1c-9669-432fc073a7c6 service nova] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:41:51.978723 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: INFO nova.api.openstack.compute.server_external_events [req-cdb7c736-dce0-48b0-bab0-6f437260db1f req-b8060b88-d32d-4e1c-9669-432fc073a7c6 service nova] Creating event network-changed:fc5a0b73-9cdf-4e1b-8b93-f12bfc2ac6a4 for instance e911acec-b583-42eb-b5de-dee9573bad6c on hv-cinder-81966 May 26 12:41:51.996191 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: INFO nova.api.openstack.requestlog [req-cdb7c736-dce0-48b0-bab0-6f437260db1f req-b8060b88-d32d-4e1c-9669-432fc073a7c6 service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.088262 May 26 12:41:51.997235 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: [pid: 129322|app: 0|req: 181/351] 10.222.0.75 () {64 vars in 1317 bytes} [Thu May 26 12:41:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 12:41:52.075869 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi [None req-a954102e-9ab7-42c9-a5ce-f9e54a572106 tempest-VolumesActionsTest-731506124 tempest-VolumesActionsTest-731506124-project] Calling method '>' {{(pid=129321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:41:52.078964 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.compute.api [None req-a954102e-9ab7-42c9-a5ce-f9e54a572106 tempest-VolumesActionsTest-731506124 tempest-VolumesActionsTest-731506124-project] [instance: 2be10a9b-0300-40be-96eb-602b1ad4b05c] Fetching instance by UUID {{(pid=129321) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:41:52.113771 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-a954102e-9ab7-42c9-a5ce-f9e54a572106 tempest-VolumesActionsTest-731506124 tempest-VolumesActionsTest-731506124-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:41:52.118159 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-a954102e-9ab7-42c9-a5ce-f9e54a572106 tempest-VolumesActionsTest-731506124 tempest-VolumesActionsTest-731506124-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:41:52.121970 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-a954102e-9ab7-42c9-a5ce-f9e54a572106 tempest-VolumesActionsTest-731506124 tempest-VolumesActionsTest-731506124-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:41:52.123256 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-a954102e-9ab7-42c9-a5ce-f9e54a572106 tempest-VolumesActionsTest-731506124 tempest-VolumesActionsTest-731506124-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:41:52.318233 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.policy [None req-a954102e-9ab7-42c9-a5ce-f9e54a572106 tempest-VolumesActionsTest-731506124 tempest-VolumesActionsTest-731506124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f39e076a9e6b401db6de9a2846519591', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa93879e60e470185e8dd71efaaf1a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129321) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:41:52.330734 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: INFO nova.api.openstack.requestlog [None req-a954102e-9ab7-42c9-a5ce-f9e54a572106 tempest-VolumesActionsTest-731506124 tempest-VolumesActionsTest-731506124-project] 10.222.0.75 "GET /compute/v2.1/servers/2be10a9b-0300-40be-96eb-602b1ad4b05c" status: 200 len: 1272 microversion: 2.1 time: 0.260701 May 26 12:41:52.333395 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: [pid: 129321|app: 0|req: 171/352] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 26 12:41:52 2022] GET /compute/v2.1/servers/2be10a9b-0300-40be-96eb-602b1ad4b05c => generated 1272 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 12:41:52.691784 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi [None req-f8e51a51-86ce-4fe5-9262-0243c2b78fcc tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Calling method '>' {{(pid=129322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:41:52.693542 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.compute.api [None req-f8e51a51-86ce-4fe5-9262-0243c2b78fcc tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] [instance: e911acec-b583-42eb-b5de-dee9573bad6c] Fetching instance by UUID {{(pid=129322) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:41:52.717792 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-f8e51a51-86ce-4fe5-9262-0243c2b78fcc tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:41:52.718813 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-f8e51a51-86ce-4fe5-9262-0243c2b78fcc tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:41:52.725879 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-f8e51a51-86ce-4fe5-9262-0243c2b78fcc tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:41:52.726871 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-f8e51a51-86ce-4fe5-9262-0243c2b78fcc tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:41:53.103965 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.policy [None req-f8e51a51-86ce-4fe5-9262-0243c2b78fcc tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0431b1f25497443ba483b3c440669080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e36ab03283d4ce6a2fed5e111e03d34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129322) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:41:53.138601 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: INFO nova.api.openstack.requestlog [None req-f8e51a51-86ce-4fe5-9262-0243c2b78fcc tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] 10.222.0.75 "GET /compute/v2.1/servers/e911acec-b583-42eb-b5de-dee9573bad6c" status: 200 len: 1372 microversion: 2.1 time: 0.451379 May 26 12:41:53.151569 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: [pid: 129322|app: 0|req: 182/353] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 26 12:41:52 2022] GET /compute/v2.1/servers/e911acec-b583-42eb-b5de-dee9573bad6c => generated 1372 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:41:53.361488 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi [None req-231a0ffa-7892-4c1c-9ec6-d31728d20e36 tempest-VolumesActionsTest-731506124 tempest-VolumesActionsTest-731506124-project] Calling method '>' {{(pid=129321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:41:53.362824 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.compute.api [None req-231a0ffa-7892-4c1c-9ec6-d31728d20e36 tempest-VolumesActionsTest-731506124 tempest-VolumesActionsTest-731506124-project] [instance: 2be10a9b-0300-40be-96eb-602b1ad4b05c] Fetching instance by UUID {{(pid=129321) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:41:53.373282 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-231a0ffa-7892-4c1c-9ec6-d31728d20e36 tempest-VolumesActionsTest-731506124 tempest-VolumesActionsTest-731506124-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:41:53.374522 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-231a0ffa-7892-4c1c-9ec6-d31728d20e36 tempest-VolumesActionsTest-731506124 tempest-VolumesActionsTest-731506124-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:41:53.376843 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-231a0ffa-7892-4c1c-9ec6-d31728d20e36 tempest-VolumesActionsTest-731506124 tempest-VolumesActionsTest-731506124-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:41:53.377536 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-231a0ffa-7892-4c1c-9ec6-d31728d20e36 tempest-VolumesActionsTest-731506124 tempest-VolumesActionsTest-731506124-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:41:54.163043 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.policy [None req-231a0ffa-7892-4c1c-9ec6-d31728d20e36 tempest-VolumesActionsTest-731506124 tempest-VolumesActionsTest-731506124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f39e076a9e6b401db6de9a2846519591', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa93879e60e470185e8dd71efaaf1a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129321) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:41:54.167830 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi [None req-5097e0ee-2b99-4cf3-bf2c-988f455b6d69 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Calling method '>' {{(pid=129322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:41:54.174725 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.compute.api [None req-5097e0ee-2b99-4cf3-bf2c-988f455b6d69 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] [instance: e911acec-b583-42eb-b5de-dee9573bad6c] Fetching instance by UUID {{(pid=129322) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:41:54.176612 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: INFO nova.api.openstack.requestlog [None req-231a0ffa-7892-4c1c-9ec6-d31728d20e36 tempest-VolumesActionsTest-731506124 tempest-VolumesActionsTest-731506124-project] 10.222.0.75 "GET /compute/v2.1/servers/2be10a9b-0300-40be-96eb-602b1ad4b05c" status: 200 len: 1314 microversion: 2.1 time: 0.817579 May 26 12:41:54.189784 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: [pid: 129321|app: 0|req: 172/354] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 26 12:41:53 2022] GET /compute/v2.1/servers/2be10a9b-0300-40be-96eb-602b1ad4b05c => generated 1314 bytes in 833 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 12:41:54.198106 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-5097e0ee-2b99-4cf3-bf2c-988f455b6d69 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:41:54.200373 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-5097e0ee-2b99-4cf3-bf2c-988f455b6d69 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:41:54.202274 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-5097e0ee-2b99-4cf3-bf2c-988f455b6d69 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:41:54.203881 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-5097e0ee-2b99-4cf3-bf2c-988f455b6d69 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:41:54.443308 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.policy [None req-5097e0ee-2b99-4cf3-bf2c-988f455b6d69 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0431b1f25497443ba483b3c440669080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e36ab03283d4ce6a2fed5e111e03d34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129322) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:41:54.455861 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: INFO nova.api.openstack.requestlog [None req-5097e0ee-2b99-4cf3-bf2c-988f455b6d69 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] 10.222.0.75 "GET /compute/v2.1/servers/e911acec-b583-42eb-b5de-dee9573bad6c" status: 200 len: 1372 microversion: 2.1 time: 0.293955 May 26 12:41:54.459708 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: [pid: 129322|app: 0|req: 183/355] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 26 12:41:54 2022] GET /compute/v2.1/servers/e911acec-b583-42eb-b5de-dee9573bad6c => generated 1372 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:41:55.201780 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi [None req-fd178168-b5e9-471e-97fc-87716f1be996 tempest-VolumesActionsTest-731506124 tempest-VolumesActionsTest-731506124-project] Calling method '>' {{(pid=129321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:41:55.202565 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.compute.api [None req-fd178168-b5e9-471e-97fc-87716f1be996 tempest-VolumesActionsTest-731506124 tempest-VolumesActionsTest-731506124-project] [instance: 2be10a9b-0300-40be-96eb-602b1ad4b05c] Fetching instance by UUID {{(pid=129321) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:41:55.217670 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-fd178168-b5e9-471e-97fc-87716f1be996 tempest-VolumesActionsTest-731506124 tempest-VolumesActionsTest-731506124-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:41:55.218799 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-fd178168-b5e9-471e-97fc-87716f1be996 tempest-VolumesActionsTest-731506124 tempest-VolumesActionsTest-731506124-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:41:55.221798 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-fd178168-b5e9-471e-97fc-87716f1be996 tempest-VolumesActionsTest-731506124 tempest-VolumesActionsTest-731506124-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:41:55.222504 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-fd178168-b5e9-471e-97fc-87716f1be996 tempest-VolumesActionsTest-731506124 tempest-VolumesActionsTest-731506124-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:41:55.480603 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi [None req-b29db273-4fd1-49aa-a8a4-fdc37643f490 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Calling method '>' {{(pid=129322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:41:55.482029 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.compute.api [None req-b29db273-4fd1-49aa-a8a4-fdc37643f490 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] [instance: e911acec-b583-42eb-b5de-dee9573bad6c] Fetching instance by UUID {{(pid=129322) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:41:55.492427 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-b29db273-4fd1-49aa-a8a4-fdc37643f490 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:41:55.492966 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-b29db273-4fd1-49aa-a8a4-fdc37643f490 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:41:55.493983 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-b29db273-4fd1-49aa-a8a4-fdc37643f490 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:41:55.494481 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-b29db273-4fd1-49aa-a8a4-fdc37643f490 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:41:55.550979 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.policy [None req-fd178168-b5e9-471e-97fc-87716f1be996 tempest-VolumesActionsTest-731506124 tempest-VolumesActionsTest-731506124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f39e076a9e6b401db6de9a2846519591', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa93879e60e470185e8dd71efaaf1a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129321) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:41:55.588263 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: INFO nova.api.openstack.requestlog [None req-fd178168-b5e9-471e-97fc-87716f1be996 tempest-VolumesActionsTest-731506124 tempest-VolumesActionsTest-731506124-project] 10.222.0.75 "GET /compute/v2.1/servers/2be10a9b-0300-40be-96eb-602b1ad4b05c" status: 200 len: 1314 microversion: 2.1 time: 0.392807 May 26 12:41:55.604301 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: [pid: 129321|app: 0|req: 173/356] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 26 12:41:55 2022] GET /compute/v2.1/servers/2be10a9b-0300-40be-96eb-602b1ad4b05c => generated 1314 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:41:55.749223 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.policy [None req-b29db273-4fd1-49aa-a8a4-fdc37643f490 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0431b1f25497443ba483b3c440669080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e36ab03283d4ce6a2fed5e111e03d34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129322) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:41:55.759738 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: INFO nova.api.openstack.requestlog [None req-b29db273-4fd1-49aa-a8a4-fdc37643f490 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] 10.222.0.75 "GET /compute/v2.1/servers/e911acec-b583-42eb-b5de-dee9573bad6c" status: 200 len: 1372 microversion: 2.1 time: 0.287851 May 26 12:41:55.761848 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: [pid: 129322|app: 0|req: 184/357] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 26 12:41:55 2022] GET /compute/v2.1/servers/e911acec-b583-42eb-b5de-dee9573bad6c => generated 1372 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 12:41:56.617456 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi [None req-810add44-d700-4297-8eaa-4e118f3dfafc tempest-VolumesActionsTest-731506124 tempest-VolumesActionsTest-731506124-project] Calling method '>' {{(pid=129321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:41:56.618324 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.compute.api [None req-810add44-d700-4297-8eaa-4e118f3dfafc tempest-VolumesActionsTest-731506124 tempest-VolumesActionsTest-731506124-project] [instance: 2be10a9b-0300-40be-96eb-602b1ad4b05c] Fetching instance by UUID {{(pid=129321) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:41:56.623489 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG dbcounter [-] [129321] Writing DB stats nova_cell0:SELECT=2 {{(pid=129321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:41:56.625920 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG dbcounter [-] [129321] Writing DB stats nova_cell0:SELECT=6 {{(pid=129321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:41:56.643910 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-810add44-d700-4297-8eaa-4e118f3dfafc tempest-VolumesActionsTest-731506124 tempest-VolumesActionsTest-731506124-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:41:56.646146 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-810add44-d700-4297-8eaa-4e118f3dfafc tempest-VolumesActionsTest-731506124 tempest-VolumesActionsTest-731506124-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:41:56.649273 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-810add44-d700-4297-8eaa-4e118f3dfafc tempest-VolumesActionsTest-731506124 tempest-VolumesActionsTest-731506124-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:41:56.650298 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-810add44-d700-4297-8eaa-4e118f3dfafc tempest-VolumesActionsTest-731506124 tempest-VolumesActionsTest-731506124-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:41:56.778854 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi [None req-adb7bc0c-f2cc-4d7e-bbfc-b2d544107160 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Calling method '>' {{(pid=129322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:41:56.779556 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.compute.api [None req-adb7bc0c-f2cc-4d7e-bbfc-b2d544107160 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] [instance: e911acec-b583-42eb-b5de-dee9573bad6c] Fetching instance by UUID {{(pid=129322) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:41:56.793138 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG dbcounter [-] [129322] Writing DB stats nova_cell0:SELECT=2 {{(pid=129322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:41:56.796723 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-adb7bc0c-f2cc-4d7e-bbfc-b2d544107160 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:41:56.797550 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-adb7bc0c-f2cc-4d7e-bbfc-b2d544107160 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:41:56.803320 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-adb7bc0c-f2cc-4d7e-bbfc-b2d544107160 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:41:56.806562 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-adb7bc0c-f2cc-4d7e-bbfc-b2d544107160 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:41:57.229806 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.policy [None req-adb7bc0c-f2cc-4d7e-bbfc-b2d544107160 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0431b1f25497443ba483b3c440669080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e36ab03283d4ce6a2fed5e111e03d34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129322) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:41:57.238159 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: INFO nova.api.openstack.requestlog [None req-adb7bc0c-f2cc-4d7e-bbfc-b2d544107160 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] 10.222.0.75 "GET /compute/v2.1/servers/e911acec-b583-42eb-b5de-dee9573bad6c" status: 200 len: 1372 microversion: 2.1 time: 0.463324 May 26 12:41:57.247473 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: [pid: 129322|app: 0|req: 185/358] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 26 12:41:56 2022] GET /compute/v2.1/servers/e911acec-b583-42eb-b5de-dee9573bad6c => generated 1372 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:41:57.263128 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.policy [None req-810add44-d700-4297-8eaa-4e118f3dfafc tempest-VolumesActionsTest-731506124 tempest-VolumesActionsTest-731506124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f39e076a9e6b401db6de9a2846519591', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa93879e60e470185e8dd71efaaf1a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129321) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:41:57.288930 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: INFO nova.api.openstack.requestlog [None req-810add44-d700-4297-8eaa-4e118f3dfafc tempest-VolumesActionsTest-731506124 tempest-VolumesActionsTest-731506124-project] 10.222.0.75 "GET /compute/v2.1/servers/2be10a9b-0300-40be-96eb-602b1ad4b05c" status: 200 len: 1314 microversion: 2.1 time: 0.676116 May 26 12:41:57.294096 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: [pid: 129321|app: 0|req: 174/359] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 26 12:41:56 2022] GET /compute/v2.1/servers/2be10a9b-0300-40be-96eb-602b1ad4b05c => generated 1314 bytes in 683 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:41:57.632633 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi [req-dd5d131c-b5aa-4550-acea-2197eb9378c2 req-ff9fff98-f31a-4a01-b7cb-f6a0513ac10f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2be10a9b-0300-40be-96eb-602b1ad4b05c", "tag": "e3e9d691-3b6e-416b-a1d1-d3fb6069ade1"}]} {{(pid=129322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 12:41:57.644918 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [req-dd5d131c-b5aa-4550-acea-2197eb9378c2 req-ff9fff98-f31a-4a01-b7cb-f6a0513ac10f service nova] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:41:57.646217 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [req-dd5d131c-b5aa-4550-acea-2197eb9378c2 req-ff9fff98-f31a-4a01-b7cb-f6a0513ac10f service nova] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:41:57.660521 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: INFO nova.api.openstack.compute.server_external_events [req-dd5d131c-b5aa-4550-acea-2197eb9378c2 req-ff9fff98-f31a-4a01-b7cb-f6a0513ac10f service nova] Creating event network-changed:e3e9d691-3b6e-416b-a1d1-d3fb6069ade1 for instance 2be10a9b-0300-40be-96eb-602b1ad4b05c on hv-cinder-81966 May 26 12:41:57.668359 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: INFO nova.api.openstack.requestlog [req-dd5d131c-b5aa-4550-acea-2197eb9378c2 req-ff9fff98-f31a-4a01-b7cb-f6a0513ac10f service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039689 May 26 12:41:57.674345 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: [pid: 129322|app: 0|req: 186/360] 10.222.0.75 () {64 vars in 1317 bytes} [Thu May 26 12:41:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 12:41:58.254872 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi [None req-0c4ef2ec-5ebf-4d25-a0dd-c2ab672022d7 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Calling method '>' {{(pid=129321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:41:58.255927 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.compute.api [None req-0c4ef2ec-5ebf-4d25-a0dd-c2ab672022d7 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] [instance: e911acec-b583-42eb-b5de-dee9573bad6c] Fetching instance by UUID {{(pid=129321) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:41:58.271056 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-0c4ef2ec-5ebf-4d25-a0dd-c2ab672022d7 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:41:58.271780 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-0c4ef2ec-5ebf-4d25-a0dd-c2ab672022d7 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:41:58.273296 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-0c4ef2ec-5ebf-4d25-a0dd-c2ab672022d7 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:41:58.274130 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-0c4ef2ec-5ebf-4d25-a0dd-c2ab672022d7 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:41:58.313221 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi [None req-93c5da1a-c9b7-42ee-bb7a-1457f0e7033a tempest-VolumesActionsTest-731506124 tempest-VolumesActionsTest-731506124-project] Calling method '>' {{(pid=129322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:41:58.317350 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.compute.api [None req-93c5da1a-c9b7-42ee-bb7a-1457f0e7033a tempest-VolumesActionsTest-731506124 tempest-VolumesActionsTest-731506124-project] [instance: 2be10a9b-0300-40be-96eb-602b1ad4b05c] Fetching instance by UUID {{(pid=129322) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:41:58.332183 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-93c5da1a-c9b7-42ee-bb7a-1457f0e7033a tempest-VolumesActionsTest-731506124 tempest-VolumesActionsTest-731506124-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:41:58.338195 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-93c5da1a-c9b7-42ee-bb7a-1457f0e7033a tempest-VolumesActionsTest-731506124 tempest-VolumesActionsTest-731506124-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:41:58.339297 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-93c5da1a-c9b7-42ee-bb7a-1457f0e7033a tempest-VolumesActionsTest-731506124 tempest-VolumesActionsTest-731506124-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:41:58.339924 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-93c5da1a-c9b7-42ee-bb7a-1457f0e7033a tempest-VolumesActionsTest-731506124 tempest-VolumesActionsTest-731506124-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:41:58.717500 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.policy [None req-93c5da1a-c9b7-42ee-bb7a-1457f0e7033a tempest-VolumesActionsTest-731506124 tempest-VolumesActionsTest-731506124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f39e076a9e6b401db6de9a2846519591', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa93879e60e470185e8dd71efaaf1a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129322) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:41:58.728642 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: INFO nova.api.openstack.requestlog [None req-93c5da1a-c9b7-42ee-bb7a-1457f0e7033a tempest-VolumesActionsTest-731506124 tempest-VolumesActionsTest-731506124-project] 10.222.0.75 "GET /compute/v2.1/servers/2be10a9b-0300-40be-96eb-602b1ad4b05c" status: 200 len: 1314 microversion: 2.1 time: 0.421310 May 26 12:41:58.732046 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: [pid: 129322|app: 0|req: 187/361] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 26 12:41:58 2022] GET /compute/v2.1/servers/2be10a9b-0300-40be-96eb-602b1ad4b05c => generated 1314 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:41:58.757523 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.policy [None req-0c4ef2ec-5ebf-4d25-a0dd-c2ab672022d7 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0431b1f25497443ba483b3c440669080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e36ab03283d4ce6a2fed5e111e03d34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129321) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:41:58.779104 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: INFO nova.api.openstack.requestlog [None req-0c4ef2ec-5ebf-4d25-a0dd-c2ab672022d7 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] 10.222.0.75 "GET /compute/v2.1/servers/e911acec-b583-42eb-b5de-dee9573bad6c" status: 200 len: 1372 microversion: 2.1 time: 0.525987 May 26 12:41:58.797137 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: [pid: 129321|app: 0|req: 175/362] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 26 12:41:58 2022] GET /compute/v2.1/servers/e911acec-b583-42eb-b5de-dee9573bad6c => generated 1372 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:41:59.752975 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi [None req-0deb8cf4-c683-40e3-9028-e824e4034eaf tempest-VolumesActionsTest-731506124 tempest-VolumesActionsTest-731506124-project] Calling method '>' {{(pid=129322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:41:59.754620 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.compute.api [None req-0deb8cf4-c683-40e3-9028-e824e4034eaf tempest-VolumesActionsTest-731506124 tempest-VolumesActionsTest-731506124-project] [instance: 2be10a9b-0300-40be-96eb-602b1ad4b05c] Fetching instance by UUID {{(pid=129322) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:41:59.775304 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-0deb8cf4-c683-40e3-9028-e824e4034eaf tempest-VolumesActionsTest-731506124 tempest-VolumesActionsTest-731506124-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:41:59.776075 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-0deb8cf4-c683-40e3-9028-e824e4034eaf tempest-VolumesActionsTest-731506124 tempest-VolumesActionsTest-731506124-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:41:59.777072 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-0deb8cf4-c683-40e3-9028-e824e4034eaf tempest-VolumesActionsTest-731506124 tempest-VolumesActionsTest-731506124-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:41:59.777671 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-0deb8cf4-c683-40e3-9028-e824e4034eaf tempest-VolumesActionsTest-731506124 tempest-VolumesActionsTest-731506124-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:41:59.798956 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi [None req-56c60574-8775-4f29-8129-de2daa92ac56 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Calling method '>' {{(pid=129321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:41:59.800354 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.compute.api [None req-56c60574-8775-4f29-8129-de2daa92ac56 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] [instance: e911acec-b583-42eb-b5de-dee9573bad6c] Fetching instance by UUID {{(pid=129321) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:41:59.810506 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-56c60574-8775-4f29-8129-de2daa92ac56 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:41:59.811746 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-56c60574-8775-4f29-8129-de2daa92ac56 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:41:59.812883 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-56c60574-8775-4f29-8129-de2daa92ac56 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:41:59.814058 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-56c60574-8775-4f29-8129-de2daa92ac56 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:42:00.089709 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.policy [None req-56c60574-8775-4f29-8129-de2daa92ac56 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0431b1f25497443ba483b3c440669080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e36ab03283d4ce6a2fed5e111e03d34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129321) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:42:00.105270 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: INFO nova.api.openstack.requestlog [None req-56c60574-8775-4f29-8129-de2daa92ac56 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] 10.222.0.75 "GET /compute/v2.1/servers/e911acec-b583-42eb-b5de-dee9573bad6c" status: 200 len: 1372 microversion: 2.1 time: 0.310974 May 26 12:42:00.120231 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: [pid: 129321|app: 0|req: 176/363] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 26 12:41:59 2022] GET /compute/v2.1/servers/e911acec-b583-42eb-b5de-dee9573bad6c => generated 1372 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 12:42:00.159299 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.policy [None req-0deb8cf4-c683-40e3-9028-e824e4034eaf tempest-VolumesActionsTest-731506124 tempest-VolumesActionsTest-731506124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f39e076a9e6b401db6de9a2846519591', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa93879e60e470185e8dd71efaaf1a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129322) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:42:00.163675 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG dbcounter [-] [129322] Writing DB stats nova_cell1:SELECT=95 {{(pid=129322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:42:00.184866 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: INFO nova.api.openstack.requestlog [None req-0deb8cf4-c683-40e3-9028-e824e4034eaf tempest-VolumesActionsTest-731506124 tempest-VolumesActionsTest-731506124-project] 10.222.0.75 "GET /compute/v2.1/servers/2be10a9b-0300-40be-96eb-602b1ad4b05c" status: 200 len: 1314 microversion: 2.1 time: 0.437394 May 26 12:42:00.208588 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: [pid: 129322|app: 0|req: 188/364] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 26 12:41:59 2022] GET /compute/v2.1/servers/2be10a9b-0300-40be-96eb-602b1ad4b05c => generated 1314 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:42:01.133239 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi [None req-56304515-4c89-40ab-8490-e863b8fe30a9 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Calling method '>' {{(pid=129321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:42:01.133943 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.compute.api [None req-56304515-4c89-40ab-8490-e863b8fe30a9 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] [instance: e911acec-b583-42eb-b5de-dee9573bad6c] Fetching instance by UUID {{(pid=129321) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:42:01.144412 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-56304515-4c89-40ab-8490-e863b8fe30a9 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:42:01.145057 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-56304515-4c89-40ab-8490-e863b8fe30a9 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:42:01.146305 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-56304515-4c89-40ab-8490-e863b8fe30a9 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:42:01.146914 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-56304515-4c89-40ab-8490-e863b8fe30a9 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:42:01.189186 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG dbcounter [-] [129321] Writing DB stats nova_cell1:SELECT=87 {{(pid=129321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:42:01.211811 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi [None req-7b8745ad-0e98-4268-8bd5-35f01d501670 tempest-VolumesActionsTest-731506124 tempest-VolumesActionsTest-731506124-project] Calling method '>' {{(pid=129322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:42:01.212455 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.compute.api [None req-7b8745ad-0e98-4268-8bd5-35f01d501670 tempest-VolumesActionsTest-731506124 tempest-VolumesActionsTest-731506124-project] [instance: 2be10a9b-0300-40be-96eb-602b1ad4b05c] Fetching instance by UUID {{(pid=129322) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:42:01.215483 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG dbcounter [-] [129322] Writing DB stats nova_api:SELECT=62,nova_api:INSERT=3 {{(pid=129322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:42:01.227436 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-7b8745ad-0e98-4268-8bd5-35f01d501670 tempest-VolumesActionsTest-731506124 tempest-VolumesActionsTest-731506124-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:42:01.227913 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-7b8745ad-0e98-4268-8bd5-35f01d501670 tempest-VolumesActionsTest-731506124 tempest-VolumesActionsTest-731506124-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:42:01.232333 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-7b8745ad-0e98-4268-8bd5-35f01d501670 tempest-VolumesActionsTest-731506124 tempest-VolumesActionsTest-731506124-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:42:01.238107 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-7b8745ad-0e98-4268-8bd5-35f01d501670 tempest-VolumesActionsTest-731506124 tempest-VolumesActionsTest-731506124-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:42:01.433213 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.policy [None req-56304515-4c89-40ab-8490-e863b8fe30a9 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0431b1f25497443ba483b3c440669080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e36ab03283d4ce6a2fed5e111e03d34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129321) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:42:01.443155 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: INFO nova.api.openstack.requestlog [None req-56304515-4c89-40ab-8490-e863b8fe30a9 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] 10.222.0.75 "GET /compute/v2.1/servers/e911acec-b583-42eb-b5de-dee9573bad6c" status: 200 len: 1372 microversion: 2.1 time: 0.314614 May 26 12:42:01.444179 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: [pid: 129321|app: 0|req: 177/365] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 26 12:42:01 2022] GET /compute/v2.1/servers/e911acec-b583-42eb-b5de-dee9573bad6c => generated 1372 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:42:01.522233 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.policy [None req-7b8745ad-0e98-4268-8bd5-35f01d501670 tempest-VolumesActionsTest-731506124 tempest-VolumesActionsTest-731506124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f39e076a9e6b401db6de9a2846519591', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa93879e60e470185e8dd71efaaf1a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129322) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:42:01.532491 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: INFO nova.api.openstack.requestlog [None req-7b8745ad-0e98-4268-8bd5-35f01d501670 tempest-VolumesActionsTest-731506124 tempest-VolumesActionsTest-731506124-project] 10.222.0.75 "GET /compute/v2.1/servers/2be10a9b-0300-40be-96eb-602b1ad4b05c" status: 200 len: 1314 microversion: 2.1 time: 0.325613 May 26 12:42:01.533106 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: [pid: 129322|app: 0|req: 189/366] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 26 12:42:01 2022] GET /compute/v2.1/servers/2be10a9b-0300-40be-96eb-602b1ad4b05c => generated 1314 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:42:02.487598 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi [None req-56f16406-264a-4de1-88b7-f9db448f2e61 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Calling method '>' {{(pid=129321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:42:02.489839 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.compute.api [None req-56f16406-264a-4de1-88b7-f9db448f2e61 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] [instance: e911acec-b583-42eb-b5de-dee9573bad6c] Fetching instance by UUID {{(pid=129321) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:42:02.527411 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-56f16406-264a-4de1-88b7-f9db448f2e61 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:42:02.528259 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-56f16406-264a-4de1-88b7-f9db448f2e61 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:42:02.529336 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-56f16406-264a-4de1-88b7-f9db448f2e61 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:42:02.529957 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-56f16406-264a-4de1-88b7-f9db448f2e61 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:42:02.557942 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi [None req-4c3d8619-1423-484a-96b5-495bc31ce038 tempest-VolumesActionsTest-731506124 tempest-VolumesActionsTest-731506124-project] Calling method '>' {{(pid=129322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:42:02.558778 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.compute.api [None req-4c3d8619-1423-484a-96b5-495bc31ce038 tempest-VolumesActionsTest-731506124 tempest-VolumesActionsTest-731506124-project] [instance: 2be10a9b-0300-40be-96eb-602b1ad4b05c] Fetching instance by UUID {{(pid=129322) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:42:02.609442 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-4c3d8619-1423-484a-96b5-495bc31ce038 tempest-VolumesActionsTest-731506124 tempest-VolumesActionsTest-731506124-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:42:02.609442 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-4c3d8619-1423-484a-96b5-495bc31ce038 tempest-VolumesActionsTest-731506124 tempest-VolumesActionsTest-731506124-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:42:02.609442 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-4c3d8619-1423-484a-96b5-495bc31ce038 tempest-VolumesActionsTest-731506124 tempest-VolumesActionsTest-731506124-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:42:02.609442 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-4c3d8619-1423-484a-96b5-495bc31ce038 tempest-VolumesActionsTest-731506124 tempest-VolumesActionsTest-731506124-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:42:02.813146 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.policy [None req-56f16406-264a-4de1-88b7-f9db448f2e61 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0431b1f25497443ba483b3c440669080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e36ab03283d4ce6a2fed5e111e03d34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129321) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:42:02.829162 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: INFO nova.api.openstack.requestlog [None req-56f16406-264a-4de1-88b7-f9db448f2e61 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] 10.222.0.75 "GET /compute/v2.1/servers/e911acec-b583-42eb-b5de-dee9573bad6c" status: 200 len: 1372 microversion: 2.1 time: 0.345511 May 26 12:42:02.830293 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: [pid: 129321|app: 0|req: 178/367] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 26 12:42:02 2022] GET /compute/v2.1/servers/e911acec-b583-42eb-b5de-dee9573bad6c => generated 1372 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 12:42:02.892816 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.policy [None req-4c3d8619-1423-484a-96b5-495bc31ce038 tempest-VolumesActionsTest-731506124 tempest-VolumesActionsTest-731506124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f39e076a9e6b401db6de9a2846519591', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa93879e60e470185e8dd71efaaf1a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129322) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:42:02.907267 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: INFO nova.api.openstack.requestlog [None req-4c3d8619-1423-484a-96b5-495bc31ce038 tempest-VolumesActionsTest-731506124 tempest-VolumesActionsTest-731506124-project] 10.222.0.75 "GET /compute/v2.1/servers/2be10a9b-0300-40be-96eb-602b1ad4b05c" status: 200 len: 1314 microversion: 2.1 time: 0.353604 May 26 12:42:02.928379 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: [pid: 129322|app: 0|req: 190/368] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 26 12:42:02 2022] GET /compute/v2.1/servers/2be10a9b-0300-40be-96eb-602b1ad4b05c => generated 1314 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:42:03.618557 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi [None req-e710a2de-b813-4093-9dd1-def85e0d3b41 tempest-TestMinimumBasicScenario-102576986 tempest-TestMinimumBasicScenario-102576986-project] Action: 'create', calling method: .version_select at 0x7f8308a03670>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-711313202", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFgMBONvtXhDCe9Y8xeSUQ2rMc0Of1LoghnkoAZXKbo+dtgcqXESu5on4Vl73csHShw1hHSgM3GfIOZvdTAnA2Crb7lY1mDH637WtPNQFhEx8yhvrSy5MMRCmtyMTdnYlg=="}} {{(pid=129321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 12:42:03.640171 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.quota [None req-e710a2de-b813-4093-9dd1-def85e0d3b41 tempest-TestMinimumBasicScenario-102576986 tempest-TestMinimumBasicScenario-102576986-project] Getting quotas for project 2fa2c4d6423444e487d259062656129b. Resources: {'key_pairs'} {{(pid=129321) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 26 12:42:03.644981 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.quota [None req-e710a2de-b813-4093-9dd1-def85e0d3b41 tempest-TestMinimumBasicScenario-102576986 tempest-TestMinimumBasicScenario-102576986-project] Getting quotas for user 0352a80bdc174b9a9df4eca60b81eba4 and project 2fa2c4d6423444e487d259062656129b. Resources: {'key_pairs'} {{(pid=129321) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 26 12:42:03.679085 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: INFO nova.api.openstack.requestlog [None req-e710a2de-b813-4093-9dd1-def85e0d3b41 tempest-TestMinimumBasicScenario-102576986 tempest-TestMinimumBasicScenario-102576986-project] 10.222.0.75 "POST /compute/v2.1/os-keypairs" status: 200 len: 402 microversion: 2.1 time: 0.065233 May 26 12:42:03.680623 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: [pid: 129321|app: 0|req: 179/369] 10.222.0.75 () {60 vars in 1158 bytes} [Thu May 26 12:42:03 2022] POST /compute/v2.1/os-keypairs => generated 402 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 26 12:42:03.850155 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi [None req-da8a2dfe-e7de-464b-88d1-de63d1257658 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Calling method '>' {{(pid=129322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:42:03.850932 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.compute.api [None req-da8a2dfe-e7de-464b-88d1-de63d1257658 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] [instance: e911acec-b583-42eb-b5de-dee9573bad6c] Fetching instance by UUID {{(pid=129322) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:42:03.867238 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi [None req-c38b9a0e-089b-419a-bb2d-45b74f9eded2 tempest-TestMinimumBasicScenario-102576986 tempest-TestMinimumBasicScenario-102576986-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-584801298", "imageRef": "99c85640-8d42-4b86-951c-f4f01da9911a", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-711313202", "networks": [{"uuid": "bcd74549-a667-4b81-a141-2257630c6399"}]}} {{(pid=129321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 12:42:03.878394 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-da8a2dfe-e7de-464b-88d1-de63d1257658 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:42:03.879427 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-da8a2dfe-e7de-464b-88d1-de63d1257658 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:42:03.882518 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-da8a2dfe-e7de-464b-88d1-de63d1257658 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:42:03.883458 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-da8a2dfe-e7de-464b-88d1-de63d1257658 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:42:03.936144 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.network.neutron [None req-c38b9a0e-089b-419a-bb2d-45b74f9eded2 tempest-TestMinimumBasicScenario-102576986 tempest-TestMinimumBasicScenario-102576986-project] validate_networks() for [('bcd74549-a667-4b81-a141-2257630c6399', None, None, None, None, None)] {{(pid=129321) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 26 12:42:04.094844 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.policy [None req-da8a2dfe-e7de-464b-88d1-de63d1257658 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0431b1f25497443ba483b3c440669080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e36ab03283d4ce6a2fed5e111e03d34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129322) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:42:04.103499 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: INFO nova.api.openstack.requestlog [None req-da8a2dfe-e7de-464b-88d1-de63d1257658 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] 10.222.0.75 "GET /compute/v2.1/servers/e911acec-b583-42eb-b5de-dee9573bad6c" status: 200 len: 1372 microversion: 2.1 time: 0.258053 May 26 12:42:04.115181 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: [pid: 129322|app: 0|req: 191/370] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 26 12:42:03 2022] GET /compute/v2.1/servers/e911acec-b583-42eb-b5de-dee9573bad6c => generated 1372 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:42:04.120439 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi [None req-5546afb8-b2a4-4fa9-a4fa-c91dcfeb7cd4 tempest-VolumesActionsTest-731506124 tempest-VolumesActionsTest-731506124-project] Calling method '>' {{(pid=129322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:42:04.121179 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.compute.api [None req-5546afb8-b2a4-4fa9-a4fa-c91dcfeb7cd4 tempest-VolumesActionsTest-731506124 tempest-VolumesActionsTest-731506124-project] [instance: 2be10a9b-0300-40be-96eb-602b1ad4b05c] Fetching instance by UUID {{(pid=129322) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:42:04.127877 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-5546afb8-b2a4-4fa9-a4fa-c91dcfeb7cd4 tempest-VolumesActionsTest-731506124 tempest-VolumesActionsTest-731506124-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:42:04.128092 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-5546afb8-b2a4-4fa9-a4fa-c91dcfeb7cd4 tempest-VolumesActionsTest-731506124 tempest-VolumesActionsTest-731506124-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:42:04.128922 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-5546afb8-b2a4-4fa9-a4fa-c91dcfeb7cd4 tempest-VolumesActionsTest-731506124 tempest-VolumesActionsTest-731506124-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:42:04.129504 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-5546afb8-b2a4-4fa9-a4fa-c91dcfeb7cd4 tempest-VolumesActionsTest-731506124 tempest-VolumesActionsTest-731506124-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:42:04.304389 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.policy [None req-5546afb8-b2a4-4fa9-a4fa-c91dcfeb7cd4 tempest-VolumesActionsTest-731506124 tempest-VolumesActionsTest-731506124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f39e076a9e6b401db6de9a2846519591', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa93879e60e470185e8dd71efaaf1a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129322) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:42:04.314581 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: INFO nova.api.openstack.requestlog [None req-5546afb8-b2a4-4fa9-a4fa-c91dcfeb7cd4 tempest-VolumesActionsTest-731506124 tempest-VolumesActionsTest-731506124-project] 10.222.0.75 "GET /compute/v2.1/servers/2be10a9b-0300-40be-96eb-602b1ad4b05c" status: 200 len: 1314 microversion: 2.1 time: 0.196134 May 26 12:42:04.315197 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: [pid: 129322|app: 0|req: 192/371] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 26 12:42:04 2022] GET /compute/v2.1/servers/2be10a9b-0300-40be-96eb-602b1ad4b05c => generated 1314 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:42:05.124235 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi [None req-20d88fba-df50-4e82-8b22-6316ce0fbc9a tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Calling method '>' {{(pid=129322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:42:05.125979 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.compute.api [None req-20d88fba-df50-4e82-8b22-6316ce0fbc9a tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] [instance: e911acec-b583-42eb-b5de-dee9573bad6c] Fetching instance by UUID {{(pid=129322) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:42:05.138985 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-20d88fba-df50-4e82-8b22-6316ce0fbc9a tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:42:05.143893 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-20d88fba-df50-4e82-8b22-6316ce0fbc9a tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:42:05.147048 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-20d88fba-df50-4e82-8b22-6316ce0fbc9a tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:42:05.153607 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-20d88fba-df50-4e82-8b22-6316ce0fbc9a tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:42:05.387589 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.policy [None req-20d88fba-df50-4e82-8b22-6316ce0fbc9a tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0431b1f25497443ba483b3c440669080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e36ab03283d4ce6a2fed5e111e03d34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129322) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:42:05.396150 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: INFO nova.api.openstack.requestlog [None req-20d88fba-df50-4e82-8b22-6316ce0fbc9a tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] 10.222.0.75 "GET /compute/v2.1/servers/e911acec-b583-42eb-b5de-dee9573bad6c" status: 200 len: 1372 microversion: 2.1 time: 0.277744 May 26 12:42:05.406172 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: [pid: 129322|app: 0|req: 193/372] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 26 12:42:05 2022] GET /compute/v2.1/servers/e911acec-b583-42eb-b5de-dee9573bad6c => generated 1372 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:42:05.406172 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi [None req-dd7048d1-164a-4998-92ba-917af91c61a7 tempest-VolumesActionsTest-731506124 tempest-VolumesActionsTest-731506124-project] Calling method '>' {{(pid=129322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:42:05.406494 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.compute.api [None req-dd7048d1-164a-4998-92ba-917af91c61a7 tempest-VolumesActionsTest-731506124 tempest-VolumesActionsTest-731506124-project] [instance: 2be10a9b-0300-40be-96eb-602b1ad4b05c] Fetching instance by UUID {{(pid=129322) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:42:05.413660 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-dd7048d1-164a-4998-92ba-917af91c61a7 tempest-VolumesActionsTest-731506124 tempest-VolumesActionsTest-731506124-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:42:05.414133 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-dd7048d1-164a-4998-92ba-917af91c61a7 tempest-VolumesActionsTest-731506124 tempest-VolumesActionsTest-731506124-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:42:05.414911 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-dd7048d1-164a-4998-92ba-917af91c61a7 tempest-VolumesActionsTest-731506124 tempest-VolumesActionsTest-731506124-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:42:05.415454 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-dd7048d1-164a-4998-92ba-917af91c61a7 tempest-VolumesActionsTest-731506124 tempest-VolumesActionsTest-731506124-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:42:05.453287 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.virt.hardware [None req-c38b9a0e-089b-419a-bb2d-45b74f9eded2 tempest-TestMinimumBasicScenario-102576986 tempest-TestMinimumBasicScenario-102576986-project] Flavor limits 0:0:0 {{(pid=129321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 26 12:42:05.454080 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.virt.hardware [None req-c38b9a0e-089b-419a-bb2d-45b74f9eded2 tempest-TestMinimumBasicScenario-102576986 tempest-TestMinimumBasicScenario-102576986-project] Image limits 0:0:0 {{(pid=129321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 26 12:42:05.454247 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.virt.hardware [None req-c38b9a0e-089b-419a-bb2d-45b74f9eded2 tempest-TestMinimumBasicScenario-102576986 tempest-TestMinimumBasicScenario-102576986-project] Flavor pref 0:0:0 {{(pid=129321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 26 12:42:05.454544 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.virt.hardware [None req-c38b9a0e-089b-419a-bb2d-45b74f9eded2 tempest-TestMinimumBasicScenario-102576986 tempest-TestMinimumBasicScenario-102576986-project] Image pref 0:0:0 {{(pid=129321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 26 12:42:05.454945 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.virt.hardware [None req-c38b9a0e-089b-419a-bb2d-45b74f9eded2 tempest-TestMinimumBasicScenario-102576986 tempest-TestMinimumBasicScenario-102576986-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 26 12:42:05.466064 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-c38b9a0e-089b-419a-bb2d-45b74f9eded2 tempest-TestMinimumBasicScenario-102576986 tempest-TestMinimumBasicScenario-102576986-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:42:05.472257 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-c38b9a0e-089b-419a-bb2d-45b74f9eded2 tempest-TestMinimumBasicScenario-102576986 tempest-TestMinimumBasicScenario-102576986-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:42:05.474353 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-c38b9a0e-089b-419a-bb2d-45b74f9eded2 tempest-TestMinimumBasicScenario-102576986 tempest-TestMinimumBasicScenario-102576986-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:42:05.478389 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-c38b9a0e-089b-419a-bb2d-45b74f9eded2 tempest-TestMinimumBasicScenario-102576986 tempest-TestMinimumBasicScenario-102576986-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:42:05.502945 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.quota [None req-c38b9a0e-089b-419a-bb2d-45b74f9eded2 tempest-TestMinimumBasicScenario-102576986 tempest-TestMinimumBasicScenario-102576986-project] Getting quotas for project 2fa2c4d6423444e487d259062656129b. Resources: {'instances', 'cores', 'ram'} {{(pid=129321) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 26 12:42:05.512523 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.quota [None req-c38b9a0e-089b-419a-bb2d-45b74f9eded2 tempest-TestMinimumBasicScenario-102576986 tempest-TestMinimumBasicScenario-102576986-project] Getting quotas for user 0352a80bdc174b9a9df4eca60b81eba4 and project 2fa2c4d6423444e487d259062656129b. Resources: {'instances', 'cores', 'ram'} {{(pid=129321) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 26 12:42:05.542474 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.compute.api [None req-c38b9a0e-089b-419a-bb2d-45b74f9eded2 tempest-TestMinimumBasicScenario-102576986 tempest-TestMinimumBasicScenario-102576986-project] Going to run 1 instances... {{(pid=129321) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 26 12:42:05.546526 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.compute.api [None req-c38b9a0e-089b-419a-bb2d-45b74f9eded2 tempest-TestMinimumBasicScenario-102576986 tempest-TestMinimumBasicScenario-102576986-project] [instance: 76661008-e6d3-4646-a9ba-d5d0e83a4b65] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='99c85640-8d42-4b86-951c-f4f01da9911a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129321) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 26 12:42:05.623003 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.policy [None req-dd7048d1-164a-4998-92ba-917af91c61a7 tempest-VolumesActionsTest-731506124 tempest-VolumesActionsTest-731506124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f39e076a9e6b401db6de9a2846519591', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa93879e60e470185e8dd71efaaf1a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129322) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:42:05.634264 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: INFO nova.api.openstack.requestlog [None req-dd7048d1-164a-4998-92ba-917af91c61a7 tempest-VolumesActionsTest-731506124 tempest-VolumesActionsTest-731506124-project] 10.222.0.75 "GET /compute/v2.1/servers/2be10a9b-0300-40be-96eb-602b1ad4b05c" status: 200 len: 1314 microversion: 2.1 time: 0.235167 May 26 12:42:05.635599 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: [pid: 129322|app: 0|req: 194/373] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 26 12:42:05 2022] GET /compute/v2.1/servers/2be10a9b-0300-40be-96eb-602b1ad4b05c => generated 1314 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:42:05.664317 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: INFO nova.api.openstack.requestlog [None req-c38b9a0e-089b-419a-bb2d-45b74f9eded2 tempest-TestMinimumBasicScenario-102576986 tempest-TestMinimumBasicScenario-102576986-project] 10.222.0.75 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.801727 May 26 12:42:05.671486 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: [pid: 129321|app: 0|req: 180/374] 10.222.0.75 () {60 vars in 1146 bytes} [Thu May 26 12:42:03 2022] POST /compute/v2.1/servers => generated 380 bytes in 1811 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 26 12:42:05.677108 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi [None req-c71668d4-03ef-4d89-b71a-cffa76834d39 tempest-TestMinimumBasicScenario-102576986 tempest-TestMinimumBasicScenario-102576986-project] Calling method '>' {{(pid=129322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:42:05.677918 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.compute.api [None req-c71668d4-03ef-4d89-b71a-cffa76834d39 tempest-TestMinimumBasicScenario-102576986 tempest-TestMinimumBasicScenario-102576986-project] [instance: 76661008-e6d3-4646-a9ba-d5d0e83a4b65] Fetching instance by UUID {{(pid=129322) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:42:05.811399 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.policy [None req-c71668d4-03ef-4d89-b71a-cffa76834d39 tempest-TestMinimumBasicScenario-102576986 tempest-TestMinimumBasicScenario-102576986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0352a80bdc174b9a9df4eca60b81eba4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fa2c4d6423444e487d259062656129b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129322) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:42:05.823444 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: INFO nova.api.openstack.requestlog [None req-c71668d4-03ef-4d89-b71a-cffa76834d39 tempest-TestMinimumBasicScenario-102576986 tempest-TestMinimumBasicScenario-102576986-project] 10.222.0.75 "GET /compute/v2.1/servers/76661008-e6d3-4646-a9ba-d5d0e83a4b65" status: 200 len: 1257 microversion: 2.1 time: 0.149717 May 26 12:42:05.835982 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: [pid: 129322|app: 0|req: 195/375] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 26 12:42:05 2022] GET /compute/v2.1/servers/76661008-e6d3-4646-a9ba-d5d0e83a4b65 => generated 1257 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:42:06.414594 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi [None req-37121095-3505-4133-95ad-791f95b21013 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Calling method '>' {{(pid=129321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:42:06.415206 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.compute.api [None req-37121095-3505-4133-95ad-791f95b21013 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] [instance: e911acec-b583-42eb-b5de-dee9573bad6c] Fetching instance by UUID {{(pid=129321) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:42:06.431233 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-37121095-3505-4133-95ad-791f95b21013 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:42:06.431712 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-37121095-3505-4133-95ad-791f95b21013 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:42:06.432489 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-37121095-3505-4133-95ad-791f95b21013 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:42:06.432915 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-37121095-3505-4133-95ad-791f95b21013 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:42:06.659234 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi [None req-a06c0883-3f2c-4bec-8795-be9243179d84 tempest-VolumesActionsTest-731506124 tempest-VolumesActionsTest-731506124-project] Calling method '>' {{(pid=129322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:42:06.661399 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.compute.api [None req-a06c0883-3f2c-4bec-8795-be9243179d84 tempest-VolumesActionsTest-731506124 tempest-VolumesActionsTest-731506124-project] [instance: 2be10a9b-0300-40be-96eb-602b1ad4b05c] Fetching instance by UUID {{(pid=129322) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:42:06.677767 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-a06c0883-3f2c-4bec-8795-be9243179d84 tempest-VolumesActionsTest-731506124 tempest-VolumesActionsTest-731506124-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:42:06.678969 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-a06c0883-3f2c-4bec-8795-be9243179d84 tempest-VolumesActionsTest-731506124 tempest-VolumesActionsTest-731506124-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:42:06.680802 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-a06c0883-3f2c-4bec-8795-be9243179d84 tempest-VolumesActionsTest-731506124 tempest-VolumesActionsTest-731506124-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:42:06.681389 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-a06c0883-3f2c-4bec-8795-be9243179d84 tempest-VolumesActionsTest-731506124 tempest-VolumesActionsTest-731506124-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:42:07.074513 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.policy [None req-37121095-3505-4133-95ad-791f95b21013 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0431b1f25497443ba483b3c440669080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e36ab03283d4ce6a2fed5e111e03d34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129321) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:42:07.084726 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: INFO nova.api.openstack.requestlog [None req-37121095-3505-4133-95ad-791f95b21013 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] 10.222.0.75 "GET /compute/v2.1/servers/e911acec-b583-42eb-b5de-dee9573bad6c" status: 200 len: 1372 microversion: 2.1 time: 0.674841 May 26 12:42:07.086025 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: [pid: 129321|app: 0|req: 181/376] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 26 12:42:06 2022] GET /compute/v2.1/servers/e911acec-b583-42eb-b5de-dee9573bad6c => generated 1372 bytes in 677 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:42:07.092225 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi [None req-6719c7fe-f5bb-41be-8e29-99fcc0fa65f7 tempest-TestMinimumBasicScenario-102576986 tempest-TestMinimumBasicScenario-102576986-project] Calling method '>' {{(pid=129321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:42:07.093279 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.compute.api [None req-6719c7fe-f5bb-41be-8e29-99fcc0fa65f7 tempest-TestMinimumBasicScenario-102576986 tempest-TestMinimumBasicScenario-102576986-project] [instance: 76661008-e6d3-4646-a9ba-d5d0e83a4b65] Fetching instance by UUID {{(pid=129321) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:42:07.109804 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-6719c7fe-f5bb-41be-8e29-99fcc0fa65f7 tempest-TestMinimumBasicScenario-102576986 tempest-TestMinimumBasicScenario-102576986-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:42:07.110285 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-6719c7fe-f5bb-41be-8e29-99fcc0fa65f7 tempest-TestMinimumBasicScenario-102576986 tempest-TestMinimumBasicScenario-102576986-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:42:07.111082 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-6719c7fe-f5bb-41be-8e29-99fcc0fa65f7 tempest-TestMinimumBasicScenario-102576986 tempest-TestMinimumBasicScenario-102576986-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:42:07.111503 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-6719c7fe-f5bb-41be-8e29-99fcc0fa65f7 tempest-TestMinimumBasicScenario-102576986 tempest-TestMinimumBasicScenario-102576986-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:42:07.238670 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.policy [None req-6719c7fe-f5bb-41be-8e29-99fcc0fa65f7 tempest-TestMinimumBasicScenario-102576986 tempest-TestMinimumBasicScenario-102576986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0352a80bdc174b9a9df4eca60b81eba4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fa2c4d6423444e487d259062656129b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129321) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:42:07.249227 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: INFO nova.api.openstack.requestlog [None req-6719c7fe-f5bb-41be-8e29-99fcc0fa65f7 tempest-TestMinimumBasicScenario-102576986 tempest-TestMinimumBasicScenario-102576986-project] 10.222.0.75 "GET /compute/v2.1/servers/76661008-e6d3-4646-a9ba-d5d0e83a4b65" status: 200 len: 1309 microversion: 2.1 time: 0.161749 May 26 12:42:07.254930 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: [pid: 129321|app: 0|req: 182/377] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 26 12:42:07 2022] GET /compute/v2.1/servers/76661008-e6d3-4646-a9ba-d5d0e83a4b65 => generated 1309 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:42:07.271300 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.policy [None req-a06c0883-3f2c-4bec-8795-be9243179d84 tempest-VolumesActionsTest-731506124 tempest-VolumesActionsTest-731506124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f39e076a9e6b401db6de9a2846519591', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa93879e60e470185e8dd71efaaf1a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129322) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:42:07.296307 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: INFO nova.api.openstack.requestlog [None req-a06c0883-3f2c-4bec-8795-be9243179d84 tempest-VolumesActionsTest-731506124 tempest-VolumesActionsTest-731506124-project] 10.222.0.75 "GET /compute/v2.1/servers/2be10a9b-0300-40be-96eb-602b1ad4b05c" status: 200 len: 1314 microversion: 2.1 time: 0.642986 May 26 12:42:07.311676 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: [pid: 129322|app: 0|req: 196/378] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 26 12:42:06 2022] GET /compute/v2.1/servers/2be10a9b-0300-40be-96eb-602b1ad4b05c => generated 1314 bytes in 652 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:42:07.321283 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi [None req-532678a5-2f53-4349-86dc-3053f031480a tempest-VolumesSnapshotTestJSON-1904508205 tempest-VolumesSnapshotTestJSON-1904508205-project] Calling method '>' {{(pid=129321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:42:07.322481 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.compute.api [None req-532678a5-2f53-4349-86dc-3053f031480a tempest-VolumesSnapshotTestJSON-1904508205 tempest-VolumesSnapshotTestJSON-1904508205-project] [instance: f392ba2b-2b88-4b1a-be61-0cf28ed1443a] Fetching instance by UUID {{(pid=129321) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:42:07.330510 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-532678a5-2f53-4349-86dc-3053f031480a tempest-VolumesSnapshotTestJSON-1904508205 tempest-VolumesSnapshotTestJSON-1904508205-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:42:07.331229 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-532678a5-2f53-4349-86dc-3053f031480a tempest-VolumesSnapshotTestJSON-1904508205 tempest-VolumesSnapshotTestJSON-1904508205-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:42:07.332284 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-532678a5-2f53-4349-86dc-3053f031480a tempest-VolumesSnapshotTestJSON-1904508205 tempest-VolumesSnapshotTestJSON-1904508205-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:42:07.332899 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-532678a5-2f53-4349-86dc-3053f031480a tempest-VolumesSnapshotTestJSON-1904508205 tempest-VolumesSnapshotTestJSON-1904508205-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:42:07.711324 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.objects.instance [None req-532678a5-2f53-4349-86dc-3053f031480a tempest-VolumesSnapshotTestJSON-1904508205 tempest-VolumesSnapshotTestJSON-1904508205-project] Lazy-loading 'services' on Instance uuid f392ba2b-2b88-4b1a-be61-0cf28ed1443a {{(pid=129321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 26 12:42:07.953492 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: INFO nova.api.openstack.requestlog [None req-532678a5-2f53-4349-86dc-3053f031480a tempest-VolumesSnapshotTestJSON-1904508205 tempest-VolumesSnapshotTestJSON-1904508205-project] 10.222.0.75 "DELETE /compute/v2.1/servers/f392ba2b-2b88-4b1a-be61-0cf28ed1443a/os-volume_attachments/21fa7315-0f91-4f23-abab-73b75d1374ee" status: 202 len: 0 microversion: 2.1 time: 0.660278 May 26 12:42:07.962408 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: [pid: 129321|app: 0|req: 183/379] 10.222.0.75 () {58 vars in 1415 bytes} [Thu May 26 12:42:07 2022] DELETE /compute/v2.1/servers/f392ba2b-2b88-4b1a-be61-0cf28ed1443a/os-volume_attachments/21fa7315-0f91-4f23-abab-73b75d1374ee => generated 0 bytes in 669 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 26 12:42:08.104404 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi [None req-77ffdc0e-dbaa-46f6-808d-9eee844ca799 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Calling method '>' {{(pid=129322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:42:08.105344 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.compute.api [None req-77ffdc0e-dbaa-46f6-808d-9eee844ca799 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] [instance: e911acec-b583-42eb-b5de-dee9573bad6c] Fetching instance by UUID {{(pid=129322) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:42:08.113984 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-77ffdc0e-dbaa-46f6-808d-9eee844ca799 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:42:08.114847 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-77ffdc0e-dbaa-46f6-808d-9eee844ca799 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:42:08.116067 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-77ffdc0e-dbaa-46f6-808d-9eee844ca799 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:42:08.116518 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-77ffdc0e-dbaa-46f6-808d-9eee844ca799 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:42:08.274551 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi [None req-71c6c51c-e8bc-4be4-b579-c91422621071 tempest-TestMinimumBasicScenario-102576986 tempest-TestMinimumBasicScenario-102576986-project] Calling method '>' {{(pid=129321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:42:08.275934 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.compute.api [None req-71c6c51c-e8bc-4be4-b579-c91422621071 tempest-TestMinimumBasicScenario-102576986 tempest-TestMinimumBasicScenario-102576986-project] [instance: 76661008-e6d3-4646-a9ba-d5d0e83a4b65] Fetching instance by UUID {{(pid=129321) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:42:08.291366 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-71c6c51c-e8bc-4be4-b579-c91422621071 tempest-TestMinimumBasicScenario-102576986 tempest-TestMinimumBasicScenario-102576986-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:42:08.294041 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-71c6c51c-e8bc-4be4-b579-c91422621071 tempest-TestMinimumBasicScenario-102576986 tempest-TestMinimumBasicScenario-102576986-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:42:08.294903 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-71c6c51c-e8bc-4be4-b579-c91422621071 tempest-TestMinimumBasicScenario-102576986 tempest-TestMinimumBasicScenario-102576986-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:42:08.295346 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-71c6c51c-e8bc-4be4-b579-c91422621071 tempest-TestMinimumBasicScenario-102576986 tempest-TestMinimumBasicScenario-102576986-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:42:08.393545 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.policy [None req-71c6c51c-e8bc-4be4-b579-c91422621071 tempest-TestMinimumBasicScenario-102576986 tempest-TestMinimumBasicScenario-102576986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0352a80bdc174b9a9df4eca60b81eba4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fa2c4d6423444e487d259062656129b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129321) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:42:08.405813 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: INFO nova.api.openstack.requestlog [None req-71c6c51c-e8bc-4be4-b579-c91422621071 tempest-TestMinimumBasicScenario-102576986 tempest-TestMinimumBasicScenario-102576986-project] 10.222.0.75 "GET /compute/v2.1/servers/76661008-e6d3-4646-a9ba-d5d0e83a4b65" status: 200 len: 1315 microversion: 2.1 time: 0.137281 May 26 12:42:08.408600 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: [pid: 129321|app: 0|req: 184/380] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 26 12:42:08 2022] GET /compute/v2.1/servers/76661008-e6d3-4646-a9ba-d5d0e83a4b65 => generated 1315 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:42:08.417376 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi [None req-4fef57d9-6568-417b-a37a-a1bf3105322e tempest-VolumesActionsTest-731506124 tempest-VolumesActionsTest-731506124-project] Calling method '>' {{(pid=129321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:42:08.420122 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.compute.api [None req-4fef57d9-6568-417b-a37a-a1bf3105322e tempest-VolumesActionsTest-731506124 tempest-VolumesActionsTest-731506124-project] [instance: 2be10a9b-0300-40be-96eb-602b1ad4b05c] Fetching instance by UUID {{(pid=129321) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:42:08.431494 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-4fef57d9-6568-417b-a37a-a1bf3105322e tempest-VolumesActionsTest-731506124 tempest-VolumesActionsTest-731506124-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:42:08.432584 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-4fef57d9-6568-417b-a37a-a1bf3105322e tempest-VolumesActionsTest-731506124 tempest-VolumesActionsTest-731506124-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:42:08.433979 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-4fef57d9-6568-417b-a37a-a1bf3105322e tempest-VolumesActionsTest-731506124 tempest-VolumesActionsTest-731506124-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:42:08.435025 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-4fef57d9-6568-417b-a37a-a1bf3105322e tempest-VolumesActionsTest-731506124 tempest-VolumesActionsTest-731506124-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:42:08.448824 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.policy [None req-77ffdc0e-dbaa-46f6-808d-9eee844ca799 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0431b1f25497443ba483b3c440669080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e36ab03283d4ce6a2fed5e111e03d34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129322) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:42:08.476152 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: INFO nova.api.openstack.requestlog [None req-77ffdc0e-dbaa-46f6-808d-9eee844ca799 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] 10.222.0.75 "GET /compute/v2.1/servers/e911acec-b583-42eb-b5de-dee9573bad6c" status: 200 len: 1372 microversion: 2.1 time: 0.374784 May 26 12:42:08.478573 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: [pid: 129322|app: 0|req: 197/381] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 26 12:42:08 2022] GET /compute/v2.1/servers/e911acec-b583-42eb-b5de-dee9573bad6c => generated 1372 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 12:42:08.712992 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi [req-2b33d80f-70ac-4ab0-a651-6e8c6f89c111 req-4af8794e-5944-4d4a-8244-9fc2dca7c1cd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e911acec-b583-42eb-b5de-dee9573bad6c", "name": "network-vif-plugged", "status": "completed", "tag": "fc5a0b73-9cdf-4e1b-8b93-f12bfc2ac6a4"}]} {{(pid=129322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 12:42:08.740913 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [req-2b33d80f-70ac-4ab0-a651-6e8c6f89c111 req-4af8794e-5944-4d4a-8244-9fc2dca7c1cd service nova] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:42:08.743488 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [req-2b33d80f-70ac-4ab0-a651-6e8c6f89c111 req-4af8794e-5944-4d4a-8244-9fc2dca7c1cd service nova] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:42:08.779606 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: INFO nova.api.openstack.compute.server_external_events [req-2b33d80f-70ac-4ab0-a651-6e8c6f89c111 req-4af8794e-5944-4d4a-8244-9fc2dca7c1cd service nova] Creating event network-vif-plugged:fc5a0b73-9cdf-4e1b-8b93-f12bfc2ac6a4 for instance e911acec-b583-42eb-b5de-dee9573bad6c on hv-cinder-81966 May 26 12:42:08.806115 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: INFO nova.api.openstack.requestlog [req-2b33d80f-70ac-4ab0-a651-6e8c6f89c111 req-4af8794e-5944-4d4a-8244-9fc2dca7c1cd service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.099233 May 26 12:42:08.807302 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: [pid: 129322|app: 0|req: 198/382] 10.222.0.75 () {64 vars in 1317 bytes} [Thu May 26 12:42:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 26 12:42:08.905989 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.policy [None req-4fef57d9-6568-417b-a37a-a1bf3105322e tempest-VolumesActionsTest-731506124 tempest-VolumesActionsTest-731506124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f39e076a9e6b401db6de9a2846519591', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa93879e60e470185e8dd71efaaf1a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129321) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:42:08.915204 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: INFO nova.api.openstack.requestlog [None req-4fef57d9-6568-417b-a37a-a1bf3105322e tempest-VolumesActionsTest-731506124 tempest-VolumesActionsTest-731506124-project] 10.222.0.75 "GET /compute/v2.1/servers/2be10a9b-0300-40be-96eb-602b1ad4b05c" status: 200 len: 1314 microversion: 2.1 time: 0.504846 May 26 12:42:08.916770 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: [pid: 129321|app: 0|req: 185/383] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 26 12:42:08 2022] GET /compute/v2.1/servers/2be10a9b-0300-40be-96eb-602b1ad4b05c => generated 1314 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:42:09.431162 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi [None req-5de712da-4d35-493f-b3ac-5634c15d53e9 tempest-TestMinimumBasicScenario-102576986 tempest-TestMinimumBasicScenario-102576986-project] Calling method '>' {{(pid=129322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:42:09.433024 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.compute.api [None req-5de712da-4d35-493f-b3ac-5634c15d53e9 tempest-TestMinimumBasicScenario-102576986 tempest-TestMinimumBasicScenario-102576986-project] [instance: 76661008-e6d3-4646-a9ba-d5d0e83a4b65] Fetching instance by UUID {{(pid=129322) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:42:09.443790 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-5de712da-4d35-493f-b3ac-5634c15d53e9 tempest-TestMinimumBasicScenario-102576986 tempest-TestMinimumBasicScenario-102576986-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:42:09.444580 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-5de712da-4d35-493f-b3ac-5634c15d53e9 tempest-TestMinimumBasicScenario-102576986 tempest-TestMinimumBasicScenario-102576986-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:42:09.445891 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-5de712da-4d35-493f-b3ac-5634c15d53e9 tempest-TestMinimumBasicScenario-102576986 tempest-TestMinimumBasicScenario-102576986-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:42:09.446444 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-5de712da-4d35-493f-b3ac-5634c15d53e9 tempest-TestMinimumBasicScenario-102576986 tempest-TestMinimumBasicScenario-102576986-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:42:09.501634 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi [None req-f1aebc97-9939-44d1-aaea-58d8477d35ac tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Calling method '>' {{(pid=129321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:42:09.502992 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.compute.api [None req-f1aebc97-9939-44d1-aaea-58d8477d35ac tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] [instance: e911acec-b583-42eb-b5de-dee9573bad6c] Fetching instance by UUID {{(pid=129321) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:42:09.525229 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-f1aebc97-9939-44d1-aaea-58d8477d35ac tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:42:09.525905 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-f1aebc97-9939-44d1-aaea-58d8477d35ac tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:42:09.527147 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-f1aebc97-9939-44d1-aaea-58d8477d35ac tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:42:09.528159 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-f1aebc97-9939-44d1-aaea-58d8477d35ac tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:42:09.761480 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.policy [None req-5de712da-4d35-493f-b3ac-5634c15d53e9 tempest-TestMinimumBasicScenario-102576986 tempest-TestMinimumBasicScenario-102576986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0352a80bdc174b9a9df4eca60b81eba4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fa2c4d6423444e487d259062656129b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129322) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:42:09.774692 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: INFO nova.api.openstack.requestlog [None req-5de712da-4d35-493f-b3ac-5634c15d53e9 tempest-TestMinimumBasicScenario-102576986 tempest-TestMinimumBasicScenario-102576986-project] 10.222.0.75 "GET /compute/v2.1/servers/76661008-e6d3-4646-a9ba-d5d0e83a4b65" status: 200 len: 1357 microversion: 2.1 time: 0.352003 May 26 12:42:09.784778 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: [pid: 129322|app: 0|req: 199/384] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 26 12:42:09 2022] GET /compute/v2.1/servers/76661008-e6d3-4646-a9ba-d5d0e83a4b65 => generated 1357 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:42:09.818136 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.policy [None req-f1aebc97-9939-44d1-aaea-58d8477d35ac tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0431b1f25497443ba483b3c440669080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e36ab03283d4ce6a2fed5e111e03d34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129321) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:42:09.834347 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: INFO nova.api.openstack.requestlog [None req-f1aebc97-9939-44d1-aaea-58d8477d35ac tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] 10.222.0.75 "GET /compute/v2.1/servers/e911acec-b583-42eb-b5de-dee9573bad6c" status: 200 len: 1372 microversion: 2.1 time: 0.337428 May 26 12:42:09.854246 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: [pid: 129321|app: 0|req: 186/385] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 26 12:42:09 2022] GET /compute/v2.1/servers/e911acec-b583-42eb-b5de-dee9573bad6c => generated 1372 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:42:09.934808 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi [None req-c67e9a31-ee4a-4490-903a-3842d360f7ad tempest-VolumesActionsTest-731506124 tempest-VolumesActionsTest-731506124-project] Calling method '>' {{(pid=129322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:42:09.935701 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.compute.api [None req-c67e9a31-ee4a-4490-903a-3842d360f7ad tempest-VolumesActionsTest-731506124 tempest-VolumesActionsTest-731506124-project] [instance: 2be10a9b-0300-40be-96eb-602b1ad4b05c] Fetching instance by UUID {{(pid=129322) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:42:09.943375 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-c67e9a31-ee4a-4490-903a-3842d360f7ad tempest-VolumesActionsTest-731506124 tempest-VolumesActionsTest-731506124-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:42:09.944139 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-c67e9a31-ee4a-4490-903a-3842d360f7ad tempest-VolumesActionsTest-731506124 tempest-VolumesActionsTest-731506124-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:42:09.944971 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-c67e9a31-ee4a-4490-903a-3842d360f7ad tempest-VolumesActionsTest-731506124 tempest-VolumesActionsTest-731506124-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:42:09.945477 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-c67e9a31-ee4a-4490-903a-3842d360f7ad tempest-VolumesActionsTest-731506124 tempest-VolumesActionsTest-731506124-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:42:10.130336 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.policy [None req-c67e9a31-ee4a-4490-903a-3842d360f7ad tempest-VolumesActionsTest-731506124 tempest-VolumesActionsTest-731506124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f39e076a9e6b401db6de9a2846519591', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa93879e60e470185e8dd71efaaf1a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129322) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:42:10.141411 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: INFO nova.api.openstack.requestlog [None req-c67e9a31-ee4a-4490-903a-3842d360f7ad tempest-VolumesActionsTest-731506124 tempest-VolumesActionsTest-731506124-project] 10.222.0.75 "GET /compute/v2.1/servers/2be10a9b-0300-40be-96eb-602b1ad4b05c" status: 200 len: 1314 microversion: 2.1 time: 0.210589 May 26 12:42:10.142153 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: [pid: 129322|app: 0|req: 200/386] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 26 12:42:09 2022] GET /compute/v2.1/servers/2be10a9b-0300-40be-96eb-602b1ad4b05c => generated 1314 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:42:10.354562 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi [None req-c5a1fd24-4340-4e53-9abf-5e0cc3cc2bf9 tempest-TestShelveInstance-546397589 tempest-TestShelveInstance-546397589-project] Action: 'create', calling method: .version_select at 0x7f8308a031f0>, body: {"keypair": {"name": "tempest-TestShelveInstance-59050459", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDZ1ArJbbcdwPI8Pz0ZRTNRzCo8s0HVHc7Dd96KRn2X3Wio1s2xvIZzfur03mIl97KwCWC6XzXi7sBz+GsCYMB2ogs/Q9tw+x6ldteJBlhuP3Tm/hEvPGdWAwIC6QuSzIw=="}} {{(pid=129321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 12:42:10.359404 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG dbcounter [-] [129321] Writing DB stats nova_api:SELECT=79,nova_api:INSERT=7 {{(pid=129321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:42:10.374167 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.quota [None req-c5a1fd24-4340-4e53-9abf-5e0cc3cc2bf9 tempest-TestShelveInstance-546397589 tempest-TestShelveInstance-546397589-project] Getting quotas for project c1f2f503ef674a4b97f848b69f8b63c5. Resources: {'key_pairs'} {{(pid=129321) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 26 12:42:10.378695 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.quota [None req-c5a1fd24-4340-4e53-9abf-5e0cc3cc2bf9 tempest-TestShelveInstance-546397589 tempest-TestShelveInstance-546397589-project] Getting quotas for user 8d9bf2dcfce24386a1aaf9709d88da45 and project c1f2f503ef674a4b97f848b69f8b63c5. Resources: {'key_pairs'} {{(pid=129321) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 26 12:42:10.407980 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: INFO nova.api.openstack.requestlog [None req-c5a1fd24-4340-4e53-9abf-5e0cc3cc2bf9 tempest-TestShelveInstance-546397589 tempest-TestShelveInstance-546397589-project] 10.222.0.75 "POST /compute/v2.1/os-keypairs" status: 200 len: 395 microversion: 2.1 time: 0.280226 May 26 12:42:10.408699 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: [pid: 129321|app: 0|req: 187/387] 10.222.0.75 () {60 vars in 1158 bytes} [Thu May 26 12:42:10 2022] POST /compute/v2.1/os-keypairs => generated 395 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 12:42:10.792709 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi [None req-a1f0a31f-8a96-48b5-97eb-687d50547b00 tempest-TestMinimumBasicScenario-102576986 tempest-TestMinimumBasicScenario-102576986-project] Calling method '>' {{(pid=129322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:42:10.795913 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.compute.api [None req-a1f0a31f-8a96-48b5-97eb-687d50547b00 tempest-TestMinimumBasicScenario-102576986 tempest-TestMinimumBasicScenario-102576986-project] [instance: 76661008-e6d3-4646-a9ba-d5d0e83a4b65] Fetching instance by UUID {{(pid=129322) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:42:10.803204 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-a1f0a31f-8a96-48b5-97eb-687d50547b00 tempest-TestMinimumBasicScenario-102576986 tempest-TestMinimumBasicScenario-102576986-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:42:10.803826 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-a1f0a31f-8a96-48b5-97eb-687d50547b00 tempest-TestMinimumBasicScenario-102576986 tempest-TestMinimumBasicScenario-102576986-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:42:10.804906 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-a1f0a31f-8a96-48b5-97eb-687d50547b00 tempest-TestMinimumBasicScenario-102576986 tempest-TestMinimumBasicScenario-102576986-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:42:10.805277 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-a1f0a31f-8a96-48b5-97eb-687d50547b00 tempest-TestMinimumBasicScenario-102576986 tempest-TestMinimumBasicScenario-102576986-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:42:10.862271 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi [None req-7eda6046-dc10-499f-9bd7-760305298d7a tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Calling method '>' {{(pid=129321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:42:10.863116 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.compute.api [None req-7eda6046-dc10-499f-9bd7-760305298d7a tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] [instance: e911acec-b583-42eb-b5de-dee9573bad6c] Fetching instance by UUID {{(pid=129321) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:42:10.880814 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-7eda6046-dc10-499f-9bd7-760305298d7a tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:42:10.881446 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-7eda6046-dc10-499f-9bd7-760305298d7a tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:42:10.882825 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-7eda6046-dc10-499f-9bd7-760305298d7a tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:42:10.885573 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-7eda6046-dc10-499f-9bd7-760305298d7a tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:42:11.246687 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.policy [None req-a1f0a31f-8a96-48b5-97eb-687d50547b00 tempest-TestMinimumBasicScenario-102576986 tempest-TestMinimumBasicScenario-102576986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0352a80bdc174b9a9df4eca60b81eba4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fa2c4d6423444e487d259062656129b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129322) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:42:11.274808 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: INFO nova.api.openstack.requestlog [None req-a1f0a31f-8a96-48b5-97eb-687d50547b00 tempest-TestMinimumBasicScenario-102576986 tempest-TestMinimumBasicScenario-102576986-project] 10.222.0.75 "GET /compute/v2.1/servers/76661008-e6d3-4646-a9ba-d5d0e83a4b65" status: 200 len: 1357 microversion: 2.1 time: 0.475170 May 26 12:42:11.289444 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: [pid: 129322|app: 0|req: 201/388] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 26 12:42:10 2022] GET /compute/v2.1/servers/76661008-e6d3-4646-a9ba-d5d0e83a4b65 => generated 1357 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:42:11.307730 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi [None req-c1976504-5e1b-4c21-ac9b-8c13b34d139e tempest-VolumesActionsTest-731506124 tempest-VolumesActionsTest-731506124-project] Calling method '>' {{(pid=129322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:42:11.308804 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.compute.api [None req-c1976504-5e1b-4c21-ac9b-8c13b34d139e tempest-VolumesActionsTest-731506124 tempest-VolumesActionsTest-731506124-project] [instance: 2be10a9b-0300-40be-96eb-602b1ad4b05c] Fetching instance by UUID {{(pid=129322) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:42:11.323076 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-c1976504-5e1b-4c21-ac9b-8c13b34d139e tempest-VolumesActionsTest-731506124 tempest-VolumesActionsTest-731506124-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:42:11.326444 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-c1976504-5e1b-4c21-ac9b-8c13b34d139e tempest-VolumesActionsTest-731506124 tempest-VolumesActionsTest-731506124-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:42:11.328323 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-c1976504-5e1b-4c21-ac9b-8c13b34d139e tempest-VolumesActionsTest-731506124 tempest-VolumesActionsTest-731506124-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:42:11.330897 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-c1976504-5e1b-4c21-ac9b-8c13b34d139e tempest-VolumesActionsTest-731506124 tempest-VolumesActionsTest-731506124-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:42:11.382500 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.policy [None req-7eda6046-dc10-499f-9bd7-760305298d7a tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0431b1f25497443ba483b3c440669080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e36ab03283d4ce6a2fed5e111e03d34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129321) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:42:11.393793 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: INFO nova.api.openstack.requestlog [None req-7eda6046-dc10-499f-9bd7-760305298d7a tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] 10.222.0.75 "GET /compute/v2.1/servers/e911acec-b583-42eb-b5de-dee9573bad6c" status: 200 len: 1372 microversion: 2.1 time: 0.536170 May 26 12:42:11.401987 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: [pid: 129321|app: 0|req: 188/389] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 26 12:42:10 2022] GET /compute/v2.1/servers/e911acec-b583-42eb-b5de-dee9573bad6c => generated 1372 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:42:11.716993 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.policy [None req-c1976504-5e1b-4c21-ac9b-8c13b34d139e tempest-VolumesActionsTest-731506124 tempest-VolumesActionsTest-731506124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f39e076a9e6b401db6de9a2846519591', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa93879e60e470185e8dd71efaaf1a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129322) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:42:11.735509 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: INFO nova.api.openstack.requestlog [None req-c1976504-5e1b-4c21-ac9b-8c13b34d139e tempest-VolumesActionsTest-731506124 tempest-VolumesActionsTest-731506124-project] 10.222.0.75 "GET /compute/v2.1/servers/2be10a9b-0300-40be-96eb-602b1ad4b05c" status: 200 len: 1314 microversion: 2.1 time: 0.439693 May 26 12:42:11.736960 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: [pid: 129322|app: 0|req: 202/390] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 26 12:42:11 2022] GET /compute/v2.1/servers/2be10a9b-0300-40be-96eb-602b1ad4b05c => generated 1314 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:42:12.294229 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi [None req-e266958a-7931-48bc-bd1c-b4fb87a89537 tempest-TestMinimumBasicScenario-102576986 tempest-TestMinimumBasicScenario-102576986-project] Calling method '>' {{(pid=129321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:42:12.294913 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.compute.api [None req-e266958a-7931-48bc-bd1c-b4fb87a89537 tempest-TestMinimumBasicScenario-102576986 tempest-TestMinimumBasicScenario-102576986-project] [instance: 76661008-e6d3-4646-a9ba-d5d0e83a4b65] Fetching instance by UUID {{(pid=129321) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:42:12.295272 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi [req-fd0c905e-b397-45fc-b490-9fb505cb53bd req-c3a01218-e491-46ae-9170-96f9e2d44f8b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "76661008-e6d3-4646-a9ba-d5d0e83a4b65", "tag": "4aebdf54-88c1-42d5-a224-778a4410cff0"}]} {{(pid=129322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 12:42:12.310278 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-e266958a-7931-48bc-bd1c-b4fb87a89537 tempest-TestMinimumBasicScenario-102576986 tempest-TestMinimumBasicScenario-102576986-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:42:12.310739 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-e266958a-7931-48bc-bd1c-b4fb87a89537 tempest-TestMinimumBasicScenario-102576986 tempest-TestMinimumBasicScenario-102576986-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:42:12.310899 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [req-fd0c905e-b397-45fc-b490-9fb505cb53bd req-c3a01218-e491-46ae-9170-96f9e2d44f8b service nova] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:42:12.311301 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [req-fd0c905e-b397-45fc-b490-9fb505cb53bd req-c3a01218-e491-46ae-9170-96f9e2d44f8b service nova] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:42:12.311555 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-e266958a-7931-48bc-bd1c-b4fb87a89537 tempest-TestMinimumBasicScenario-102576986 tempest-TestMinimumBasicScenario-102576986-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:42:12.315994 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-e266958a-7931-48bc-bd1c-b4fb87a89537 tempest-TestMinimumBasicScenario-102576986 tempest-TestMinimumBasicScenario-102576986-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:42:12.340413 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: INFO nova.api.openstack.compute.server_external_events [req-fd0c905e-b397-45fc-b490-9fb505cb53bd req-c3a01218-e491-46ae-9170-96f9e2d44f8b service nova] Creating event network-changed:4aebdf54-88c1-42d5-a224-778a4410cff0 for instance 76661008-e6d3-4646-a9ba-d5d0e83a4b65 on hv-cinder-81966 May 26 12:42:12.352476 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: INFO nova.api.openstack.requestlog [req-fd0c905e-b397-45fc-b490-9fb505cb53bd req-c3a01218-e491-46ae-9170-96f9e2d44f8b service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.061539 May 26 12:42:12.353392 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: [pid: 129322|app: 0|req: 203/391] 10.222.0.75 () {64 vars in 1317 bytes} [Thu May 26 12:42:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 26 12:42:12.423977 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi [None req-5bee578f-407e-4288-a929-abdffefd2a2a tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Calling method '>' {{(pid=129322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:42:12.424711 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.compute.api [None req-5bee578f-407e-4288-a929-abdffefd2a2a tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] [instance: e911acec-b583-42eb-b5de-dee9573bad6c] Fetching instance by UUID {{(pid=129322) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:42:12.444321 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-5bee578f-407e-4288-a929-abdffefd2a2a tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:42:12.445108 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-5bee578f-407e-4288-a929-abdffefd2a2a tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:42:12.446981 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-5bee578f-407e-4288-a929-abdffefd2a2a tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:42:12.447876 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-5bee578f-407e-4288-a929-abdffefd2a2a tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:42:12.549680 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.policy [None req-e266958a-7931-48bc-bd1c-b4fb87a89537 tempest-TestMinimumBasicScenario-102576986 tempest-TestMinimumBasicScenario-102576986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0352a80bdc174b9a9df4eca60b81eba4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fa2c4d6423444e487d259062656129b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129321) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:42:12.559427 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: INFO nova.api.openstack.requestlog [None req-e266958a-7931-48bc-bd1c-b4fb87a89537 tempest-TestMinimumBasicScenario-102576986 tempest-TestMinimumBasicScenario-102576986-project] 10.222.0.75 "GET /compute/v2.1/servers/76661008-e6d3-4646-a9ba-d5d0e83a4b65" status: 200 len: 1357 microversion: 2.1 time: 0.269392 May 26 12:42:12.561403 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: [pid: 129321|app: 0|req: 189/392] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 26 12:42:12 2022] GET /compute/v2.1/servers/76661008-e6d3-4646-a9ba-d5d0e83a4b65 => generated 1357 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 12:42:12.683059 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.policy [None req-5bee578f-407e-4288-a929-abdffefd2a2a tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0431b1f25497443ba483b3c440669080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e36ab03283d4ce6a2fed5e111e03d34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129322) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:42:12.692485 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: INFO nova.api.openstack.requestlog [None req-5bee578f-407e-4288-a929-abdffefd2a2a tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] 10.222.0.75 "GET /compute/v2.1/servers/e911acec-b583-42eb-b5de-dee9573bad6c" status: 200 len: 1372 microversion: 2.1 time: 0.273551 May 26 12:42:12.696798 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: [pid: 129322|app: 0|req: 204/393] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 26 12:42:12 2022] GET /compute/v2.1/servers/e911acec-b583-42eb-b5de-dee9573bad6c => generated 1372 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 12:42:12.764868 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi [None req-eafd97b7-f5b6-49f4-934d-aae302409228 tempest-VolumesActionsTest-731506124 tempest-VolumesActionsTest-731506124-project] Calling method '>' {{(pid=129321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:42:12.765757 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.compute.api [None req-eafd97b7-f5b6-49f4-934d-aae302409228 tempest-VolumesActionsTest-731506124 tempest-VolumesActionsTest-731506124-project] [instance: 2be10a9b-0300-40be-96eb-602b1ad4b05c] Fetching instance by UUID {{(pid=129321) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:42:12.784962 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-eafd97b7-f5b6-49f4-934d-aae302409228 tempest-VolumesActionsTest-731506124 tempest-VolumesActionsTest-731506124-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:42:12.785893 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-eafd97b7-f5b6-49f4-934d-aae302409228 tempest-VolumesActionsTest-731506124 tempest-VolumesActionsTest-731506124-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:42:12.788018 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-eafd97b7-f5b6-49f4-934d-aae302409228 tempest-VolumesActionsTest-731506124 tempest-VolumesActionsTest-731506124-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:42:12.789369 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-eafd97b7-f5b6-49f4-934d-aae302409228 tempest-VolumesActionsTest-731506124 tempest-VolumesActionsTest-731506124-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:42:13.006263 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.policy [None req-eafd97b7-f5b6-49f4-934d-aae302409228 tempest-VolumesActionsTest-731506124 tempest-VolumesActionsTest-731506124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f39e076a9e6b401db6de9a2846519591', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa93879e60e470185e8dd71efaaf1a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129321) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:42:13.029893 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: INFO nova.api.openstack.requestlog [None req-eafd97b7-f5b6-49f4-934d-aae302409228 tempest-VolumesActionsTest-731506124 tempest-VolumesActionsTest-731506124-project] 10.222.0.75 "GET /compute/v2.1/servers/2be10a9b-0300-40be-96eb-602b1ad4b05c" status: 200 len: 1314 microversion: 2.1 time: 0.270434 May 26 12:42:13.046891 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: [pid: 129321|app: 0|req: 190/394] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 26 12:42:12 2022] GET /compute/v2.1/servers/2be10a9b-0300-40be-96eb-602b1ad4b05c => generated 1314 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:42:13.584505 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi [None req-40f601af-cf2d-42c2-ac53-7d5ffdeec505 tempest-TestMinimumBasicScenario-102576986 tempest-TestMinimumBasicScenario-102576986-project] Calling method '>' {{(pid=129322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:42:13.586586 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.compute.api [None req-40f601af-cf2d-42c2-ac53-7d5ffdeec505 tempest-TestMinimumBasicScenario-102576986 tempest-TestMinimumBasicScenario-102576986-project] [instance: 76661008-e6d3-4646-a9ba-d5d0e83a4b65] Fetching instance by UUID {{(pid=129322) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:42:13.597898 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-40f601af-cf2d-42c2-ac53-7d5ffdeec505 tempest-TestMinimumBasicScenario-102576986 tempest-TestMinimumBasicScenario-102576986-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:42:13.598522 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-40f601af-cf2d-42c2-ac53-7d5ffdeec505 tempest-TestMinimumBasicScenario-102576986 tempest-TestMinimumBasicScenario-102576986-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:42:13.600410 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-40f601af-cf2d-42c2-ac53-7d5ffdeec505 tempest-TestMinimumBasicScenario-102576986 tempest-TestMinimumBasicScenario-102576986-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:42:13.601040 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-40f601af-cf2d-42c2-ac53-7d5ffdeec505 tempest-TestMinimumBasicScenario-102576986 tempest-TestMinimumBasicScenario-102576986-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:42:13.710586 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi [None req-475e9260-a82c-4c01-a9fe-08beae7bd550 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Calling method '>' {{(pid=129321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:42:13.711276 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.compute.api [None req-475e9260-a82c-4c01-a9fe-08beae7bd550 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] [instance: e911acec-b583-42eb-b5de-dee9573bad6c] Fetching instance by UUID {{(pid=129321) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:42:13.717877 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-475e9260-a82c-4c01-a9fe-08beae7bd550 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:42:13.718323 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-475e9260-a82c-4c01-a9fe-08beae7bd550 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:42:13.719095 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-475e9260-a82c-4c01-a9fe-08beae7bd550 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:42:13.719511 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-475e9260-a82c-4c01-a9fe-08beae7bd550 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:42:13.761392 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.policy [None req-40f601af-cf2d-42c2-ac53-7d5ffdeec505 tempest-TestMinimumBasicScenario-102576986 tempest-TestMinimumBasicScenario-102576986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0352a80bdc174b9a9df4eca60b81eba4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fa2c4d6423444e487d259062656129b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129322) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:42:13.769329 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: INFO nova.api.openstack.requestlog [None req-40f601af-cf2d-42c2-ac53-7d5ffdeec505 tempest-TestMinimumBasicScenario-102576986 tempest-TestMinimumBasicScenario-102576986-project] 10.222.0.75 "GET /compute/v2.1/servers/76661008-e6d3-4646-a9ba-d5d0e83a4b65" status: 200 len: 1357 microversion: 2.1 time: 0.190016 May 26 12:42:13.779519 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: [pid: 129322|app: 0|req: 205/395] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 26 12:42:13 2022] GET /compute/v2.1/servers/76661008-e6d3-4646-a9ba-d5d0e83a4b65 => generated 1357 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:42:13.905169 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.policy [None req-475e9260-a82c-4c01-a9fe-08beae7bd550 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0431b1f25497443ba483b3c440669080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e36ab03283d4ce6a2fed5e111e03d34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129321) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:42:13.913630 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: INFO nova.api.openstack.requestlog [None req-475e9260-a82c-4c01-a9fe-08beae7bd550 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] 10.222.0.75 "GET /compute/v2.1/servers/e911acec-b583-42eb-b5de-dee9573bad6c" status: 200 len: 1372 microversion: 2.1 time: 0.207034 May 26 12:42:13.914985 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: [pid: 129321|app: 0|req: 191/396] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 26 12:42:13 2022] GET /compute/v2.1/servers/e911acec-b583-42eb-b5de-dee9573bad6c => generated 1372 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:42:14.059654 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi [None req-ffb26d80-ce9c-4167-b7d6-54c866aec006 tempest-VolumesActionsTest-731506124 tempest-VolumesActionsTest-731506124-project] Calling method '>' {{(pid=129322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:42:14.060385 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.compute.api [None req-ffb26d80-ce9c-4167-b7d6-54c866aec006 tempest-VolumesActionsTest-731506124 tempest-VolumesActionsTest-731506124-project] [instance: 2be10a9b-0300-40be-96eb-602b1ad4b05c] Fetching instance by UUID {{(pid=129322) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:42:14.072493 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-ffb26d80-ce9c-4167-b7d6-54c866aec006 tempest-VolumesActionsTest-731506124 tempest-VolumesActionsTest-731506124-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:42:14.074189 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-ffb26d80-ce9c-4167-b7d6-54c866aec006 tempest-VolumesActionsTest-731506124 tempest-VolumesActionsTest-731506124-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:42:14.076488 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-ffb26d80-ce9c-4167-b7d6-54c866aec006 tempest-VolumesActionsTest-731506124 tempest-VolumesActionsTest-731506124-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:42:14.077753 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-ffb26d80-ce9c-4167-b7d6-54c866aec006 tempest-VolumesActionsTest-731506124 tempest-VolumesActionsTest-731506124-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:42:14.254020 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.policy [None req-ffb26d80-ce9c-4167-b7d6-54c866aec006 tempest-VolumesActionsTest-731506124 tempest-VolumesActionsTest-731506124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f39e076a9e6b401db6de9a2846519591', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa93879e60e470185e8dd71efaaf1a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129322) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:42:14.264875 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: INFO nova.api.openstack.requestlog [None req-ffb26d80-ce9c-4167-b7d6-54c866aec006 tempest-VolumesActionsTest-731506124 tempest-VolumesActionsTest-731506124-project] 10.222.0.75 "GET /compute/v2.1/servers/2be10a9b-0300-40be-96eb-602b1ad4b05c" status: 200 len: 1314 microversion: 2.1 time: 0.212266 May 26 12:42:14.266017 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: [pid: 129322|app: 0|req: 206/397] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 26 12:42:14 2022] GET /compute/v2.1/servers/2be10a9b-0300-40be-96eb-602b1ad4b05c => generated 1314 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 12:42:14.786873 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi [None req-aa89a441-d9e2-4c9b-97ee-592939a0f98b tempest-TestMinimumBasicScenario-102576986 tempest-TestMinimumBasicScenario-102576986-project] Calling method '>' {{(pid=129321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:42:14.787674 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.compute.api [None req-aa89a441-d9e2-4c9b-97ee-592939a0f98b tempest-TestMinimumBasicScenario-102576986 tempest-TestMinimumBasicScenario-102576986-project] [instance: 76661008-e6d3-4646-a9ba-d5d0e83a4b65] Fetching instance by UUID {{(pid=129321) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:42:14.797131 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-aa89a441-d9e2-4c9b-97ee-592939a0f98b tempest-TestMinimumBasicScenario-102576986 tempest-TestMinimumBasicScenario-102576986-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:42:14.797131 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-aa89a441-d9e2-4c9b-97ee-592939a0f98b tempest-TestMinimumBasicScenario-102576986 tempest-TestMinimumBasicScenario-102576986-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:42:14.797523 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-aa89a441-d9e2-4c9b-97ee-592939a0f98b tempest-TestMinimumBasicScenario-102576986 tempest-TestMinimumBasicScenario-102576986-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:42:14.797977 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-aa89a441-d9e2-4c9b-97ee-592939a0f98b tempest-TestMinimumBasicScenario-102576986 tempest-TestMinimumBasicScenario-102576986-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:42:14.938120 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi [None req-faad2eb3-ccee-4976-a6cc-76bc22d4a2c5 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Calling method '>' {{(pid=129322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:42:14.939344 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.compute.api [None req-faad2eb3-ccee-4976-a6cc-76bc22d4a2c5 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] [instance: e911acec-b583-42eb-b5de-dee9573bad6c] Fetching instance by UUID {{(pid=129322) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:42:14.953527 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-faad2eb3-ccee-4976-a6cc-76bc22d4a2c5 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:42:14.955058 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-faad2eb3-ccee-4976-a6cc-76bc22d4a2c5 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:42:14.963640 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.policy [None req-aa89a441-d9e2-4c9b-97ee-592939a0f98b tempest-TestMinimumBasicScenario-102576986 tempest-TestMinimumBasicScenario-102576986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0352a80bdc174b9a9df4eca60b81eba4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fa2c4d6423444e487d259062656129b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129321) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:42:14.969256 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-faad2eb3-ccee-4976-a6cc-76bc22d4a2c5 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:42:14.970477 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-faad2eb3-ccee-4976-a6cc-76bc22d4a2c5 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:42:14.992070 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: INFO nova.api.openstack.requestlog [None req-aa89a441-d9e2-4c9b-97ee-592939a0f98b tempest-TestMinimumBasicScenario-102576986 tempest-TestMinimumBasicScenario-102576986-project] 10.222.0.75 "GET /compute/v2.1/servers/76661008-e6d3-4646-a9ba-d5d0e83a4b65" status: 200 len: 1357 microversion: 2.1 time: 0.208684 May 26 12:42:14.993313 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: [pid: 129321|app: 0|req: 192/398] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 26 12:42:14 2022] GET /compute/v2.1/servers/76661008-e6d3-4646-a9ba-d5d0e83a4b65 => generated 1357 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:42:15.140460 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.policy [None req-faad2eb3-ccee-4976-a6cc-76bc22d4a2c5 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0431b1f25497443ba483b3c440669080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e36ab03283d4ce6a2fed5e111e03d34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129322) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:42:15.143231 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG dbcounter [-] [129322] Writing DB stats nova_cell1:SELECT=100 {{(pid=129322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:42:15.150429 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: INFO nova.api.openstack.requestlog [None req-faad2eb3-ccee-4976-a6cc-76bc22d4a2c5 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] 10.222.0.75 "GET /compute/v2.1/servers/e911acec-b583-42eb-b5de-dee9573bad6c" status: 200 len: 1372 microversion: 2.1 time: 0.220001 May 26 12:42:15.151008 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: [pid: 129322|app: 0|req: 207/399] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 26 12:42:14 2022] GET /compute/v2.1/servers/e911acec-b583-42eb-b5de-dee9573bad6c => generated 1372 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:42:15.284524 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi [None req-65bca672-1527-43c3-89aa-8cd2ae167305 tempest-VolumesActionsTest-731506124 tempest-VolumesActionsTest-731506124-project] Calling method '>' {{(pid=129321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:42:15.285172 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.compute.api [None req-65bca672-1527-43c3-89aa-8cd2ae167305 tempest-VolumesActionsTest-731506124 tempest-VolumesActionsTest-731506124-project] [instance: 2be10a9b-0300-40be-96eb-602b1ad4b05c] Fetching instance by UUID {{(pid=129321) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:42:15.291656 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-65bca672-1527-43c3-89aa-8cd2ae167305 tempest-VolumesActionsTest-731506124 tempest-VolumesActionsTest-731506124-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:42:15.292096 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-65bca672-1527-43c3-89aa-8cd2ae167305 tempest-VolumesActionsTest-731506124 tempest-VolumesActionsTest-731506124-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:42:15.292854 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-65bca672-1527-43c3-89aa-8cd2ae167305 tempest-VolumesActionsTest-731506124 tempest-VolumesActionsTest-731506124-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:42:15.293295 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-65bca672-1527-43c3-89aa-8cd2ae167305 tempest-VolumesActionsTest-731506124 tempest-VolumesActionsTest-731506124-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:42:15.322795 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi [req-e6ab634c-f296-4b44-bfd7-0f2aeafb2ce4 req-6ec17589-3044-4339-8d75-21813ce0c501 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2be10a9b-0300-40be-96eb-602b1ad4b05c", "name": "network-vif-plugged", "status": "completed", "tag": "e3e9d691-3b6e-416b-a1d1-d3fb6069ade1"}]} {{(pid=129322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 12:42:15.340420 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [req-e6ab634c-f296-4b44-bfd7-0f2aeafb2ce4 req-6ec17589-3044-4339-8d75-21813ce0c501 service nova] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:42:15.341464 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [req-e6ab634c-f296-4b44-bfd7-0f2aeafb2ce4 req-6ec17589-3044-4339-8d75-21813ce0c501 service nova] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:42:15.367756 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: INFO nova.api.openstack.compute.server_external_events [req-e6ab634c-f296-4b44-bfd7-0f2aeafb2ce4 req-6ec17589-3044-4339-8d75-21813ce0c501 service nova] Creating event network-vif-plugged:e3e9d691-3b6e-416b-a1d1-d3fb6069ade1 for instance 2be10a9b-0300-40be-96eb-602b1ad4b05c on hv-cinder-81966 May 26 12:42:15.375617 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: INFO nova.api.openstack.requestlog [req-e6ab634c-f296-4b44-bfd7-0f2aeafb2ce4 req-6ec17589-3044-4339-8d75-21813ce0c501 service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057682 May 26 12:42:15.376244 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: [pid: 129322|app: 0|req: 208/400] 10.222.0.75 () {64 vars in 1317 bytes} [Thu May 26 12:42:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 12:42:15.461841 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.policy [None req-65bca672-1527-43c3-89aa-8cd2ae167305 tempest-VolumesActionsTest-731506124 tempest-VolumesActionsTest-731506124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f39e076a9e6b401db6de9a2846519591', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa93879e60e470185e8dd71efaaf1a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129321) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:42:15.470250 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: INFO nova.api.openstack.requestlog [None req-65bca672-1527-43c3-89aa-8cd2ae167305 tempest-VolumesActionsTest-731506124 tempest-VolumesActionsTest-731506124-project] 10.222.0.75 "GET /compute/v2.1/servers/2be10a9b-0300-40be-96eb-602b1ad4b05c" status: 200 len: 1314 microversion: 2.1 time: 0.189742 May 26 12:42:15.471068 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: [pid: 129321|app: 0|req: 193/401] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 26 12:42:15 2022] GET /compute/v2.1/servers/2be10a9b-0300-40be-96eb-602b1ad4b05c => generated 1314 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:42:16.007589 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG dbcounter [-] [129322] Writing DB stats nova_cell0:SELECT=2 {{(pid=129322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:42:16.012968 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi [None req-c105a60e-4974-4c59-80a6-c0d632e5658a tempest-TestMinimumBasicScenario-102576986 tempest-TestMinimumBasicScenario-102576986-project] Calling method '>' {{(pid=129322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:42:16.013686 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.compute.api [None req-c105a60e-4974-4c59-80a6-c0d632e5658a tempest-TestMinimumBasicScenario-102576986 tempest-TestMinimumBasicScenario-102576986-project] [instance: 76661008-e6d3-4646-a9ba-d5d0e83a4b65] Fetching instance by UUID {{(pid=129322) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:42:16.020991 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-c105a60e-4974-4c59-80a6-c0d632e5658a tempest-TestMinimumBasicScenario-102576986 tempest-TestMinimumBasicScenario-102576986-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:42:16.021442 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-c105a60e-4974-4c59-80a6-c0d632e5658a tempest-TestMinimumBasicScenario-102576986 tempest-TestMinimumBasicScenario-102576986-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:42:16.022221 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-c105a60e-4974-4c59-80a6-c0d632e5658a tempest-TestMinimumBasicScenario-102576986 tempest-TestMinimumBasicScenario-102576986-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:42:16.022652 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-c105a60e-4974-4c59-80a6-c0d632e5658a tempest-TestMinimumBasicScenario-102576986 tempest-TestMinimumBasicScenario-102576986-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:42:16.166838 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi [None req-2be249a8-93b9-4289-a76e-043f914ada28 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Calling method '>' {{(pid=129321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:42:16.168242 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.compute.api [None req-2be249a8-93b9-4289-a76e-043f914ada28 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] [instance: e911acec-b583-42eb-b5de-dee9573bad6c] Fetching instance by UUID {{(pid=129321) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:42:16.170319 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG dbcounter [-] [129321] Writing DB stats nova_cell0:SELECT=2 {{(pid=129321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:42:16.178366 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-2be249a8-93b9-4289-a76e-043f914ada28 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:42:16.178826 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-2be249a8-93b9-4289-a76e-043f914ada28 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:42:16.179658 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-2be249a8-93b9-4289-a76e-043f914ada28 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:42:16.180128 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-2be249a8-93b9-4289-a76e-043f914ada28 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:42:16.181157 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.policy [None req-c105a60e-4974-4c59-80a6-c0d632e5658a tempest-TestMinimumBasicScenario-102576986 tempest-TestMinimumBasicScenario-102576986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0352a80bdc174b9a9df4eca60b81eba4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fa2c4d6423444e487d259062656129b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129322) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:42:16.189521 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: INFO nova.api.openstack.requestlog [None req-c105a60e-4974-4c59-80a6-c0d632e5658a tempest-TestMinimumBasicScenario-102576986 tempest-TestMinimumBasicScenario-102576986-project] 10.222.0.75 "GET /compute/v2.1/servers/76661008-e6d3-4646-a9ba-d5d0e83a4b65" status: 200 len: 1357 microversion: 2.1 time: 0.183029 May 26 12:42:16.190159 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: [pid: 129322|app: 0|req: 209/402] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 26 12:42:16 2022] GET /compute/v2.1/servers/76661008-e6d3-4646-a9ba-d5d0e83a4b65 => generated 1357 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:42:16.324604 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.policy [None req-2be249a8-93b9-4289-a76e-043f914ada28 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0431b1f25497443ba483b3c440669080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e36ab03283d4ce6a2fed5e111e03d34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129321) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:42:16.333913 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: INFO nova.api.openstack.requestlog [None req-2be249a8-93b9-4289-a76e-043f914ada28 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] 10.222.0.75 "GET /compute/v2.1/servers/e911acec-b583-42eb-b5de-dee9573bad6c" status: 200 len: 1372 microversion: 2.1 time: 0.171209 May 26 12:42:16.334515 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: [pid: 129321|app: 0|req: 194/403] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 26 12:42:16 2022] GET /compute/v2.1/servers/e911acec-b583-42eb-b5de-dee9573bad6c => generated 1372 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:42:16.492085 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi [None req-e119cc61-6651-4cd6-b242-1d61d5ab1823 tempest-VolumesActionsTest-731506124 tempest-VolumesActionsTest-731506124-project] Calling method '>' {{(pid=129322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:42:16.497109 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.compute.api [None req-e119cc61-6651-4cd6-b242-1d61d5ab1823 tempest-VolumesActionsTest-731506124 tempest-VolumesActionsTest-731506124-project] [instance: 2be10a9b-0300-40be-96eb-602b1ad4b05c] Fetching instance by UUID {{(pid=129322) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:42:16.504700 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-e119cc61-6651-4cd6-b242-1d61d5ab1823 tempest-VolumesActionsTest-731506124 tempest-VolumesActionsTest-731506124-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:42:16.505162 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-e119cc61-6651-4cd6-b242-1d61d5ab1823 tempest-VolumesActionsTest-731506124 tempest-VolumesActionsTest-731506124-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:42:16.505910 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-e119cc61-6651-4cd6-b242-1d61d5ab1823 tempest-VolumesActionsTest-731506124 tempest-VolumesActionsTest-731506124-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:42:16.506446 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-e119cc61-6651-4cd6-b242-1d61d5ab1823 tempest-VolumesActionsTest-731506124 tempest-VolumesActionsTest-731506124-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:42:16.669617 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.policy [None req-e119cc61-6651-4cd6-b242-1d61d5ab1823 tempest-VolumesActionsTest-731506124 tempest-VolumesActionsTest-731506124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f39e076a9e6b401db6de9a2846519591', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa93879e60e470185e8dd71efaaf1a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129322) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:42:16.679576 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: INFO nova.api.openstack.requestlog [None req-e119cc61-6651-4cd6-b242-1d61d5ab1823 tempest-VolumesActionsTest-731506124 tempest-VolumesActionsTest-731506124-project] 10.222.0.75 "GET /compute/v2.1/servers/2be10a9b-0300-40be-96eb-602b1ad4b05c" status: 200 len: 1314 microversion: 2.1 time: 0.191656 May 26 12:42:16.687618 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: [pid: 129322|app: 0|req: 210/404] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 26 12:42:16 2022] GET /compute/v2.1/servers/2be10a9b-0300-40be-96eb-602b1ad4b05c => generated 1314 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:42:17.207888 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi [None req-aba2c3ae-d151-4162-83b3-7d05accfc8a0 tempest-TestMinimumBasicScenario-102576986 tempest-TestMinimumBasicScenario-102576986-project] Calling method '>' {{(pid=129321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:42:17.208543 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.compute.api [None req-aba2c3ae-d151-4162-83b3-7d05accfc8a0 tempest-TestMinimumBasicScenario-102576986 tempest-TestMinimumBasicScenario-102576986-project] [instance: 76661008-e6d3-4646-a9ba-d5d0e83a4b65] Fetching instance by UUID {{(pid=129321) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:42:17.215242 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-aba2c3ae-d151-4162-83b3-7d05accfc8a0 tempest-TestMinimumBasicScenario-102576986 tempest-TestMinimumBasicScenario-102576986-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:42:17.215714 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-aba2c3ae-d151-4162-83b3-7d05accfc8a0 tempest-TestMinimumBasicScenario-102576986 tempest-TestMinimumBasicScenario-102576986-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:42:17.216474 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-aba2c3ae-d151-4162-83b3-7d05accfc8a0 tempest-TestMinimumBasicScenario-102576986 tempest-TestMinimumBasicScenario-102576986-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:42:17.216898 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-aba2c3ae-d151-4162-83b3-7d05accfc8a0 tempest-TestMinimumBasicScenario-102576986 tempest-TestMinimumBasicScenario-102576986-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:42:17.351200 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi [None req-37a3772d-4e0a-43b6-89df-78b0ad00ddc7 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Calling method '>' {{(pid=129322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:42:17.351966 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.compute.api [None req-37a3772d-4e0a-43b6-89df-78b0ad00ddc7 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] [instance: e911acec-b583-42eb-b5de-dee9573bad6c] Fetching instance by UUID {{(pid=129322) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:42:17.364878 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-37a3772d-4e0a-43b6-89df-78b0ad00ddc7 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:42:17.365333 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-37a3772d-4e0a-43b6-89df-78b0ad00ddc7 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:42:17.366300 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-37a3772d-4e0a-43b6-89df-78b0ad00ddc7 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:42:17.366904 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-37a3772d-4e0a-43b6-89df-78b0ad00ddc7 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:42:17.378560 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.policy [None req-aba2c3ae-d151-4162-83b3-7d05accfc8a0 tempest-TestMinimumBasicScenario-102576986 tempest-TestMinimumBasicScenario-102576986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0352a80bdc174b9a9df4eca60b81eba4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fa2c4d6423444e487d259062656129b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129321) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:42:17.387113 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG dbcounter [-] [129321] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=129321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:42:17.405196 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: INFO nova.api.openstack.requestlog [None req-aba2c3ae-d151-4162-83b3-7d05accfc8a0 tempest-TestMinimumBasicScenario-102576986 tempest-TestMinimumBasicScenario-102576986-project] 10.222.0.75 "GET /compute/v2.1/servers/76661008-e6d3-4646-a9ba-d5d0e83a4b65" status: 200 len: 1357 microversion: 2.1 time: 0.201612 May 26 12:42:17.411386 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: [pid: 129321|app: 0|req: 195/405] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 26 12:42:17 2022] GET /compute/v2.1/servers/76661008-e6d3-4646-a9ba-d5d0e83a4b65 => generated 1357 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 12:42:17.543031 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.policy [None req-37a3772d-4e0a-43b6-89df-78b0ad00ddc7 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0431b1f25497443ba483b3c440669080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e36ab03283d4ce6a2fed5e111e03d34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129322) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:42:17.552419 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: INFO nova.api.openstack.requestlog [None req-37a3772d-4e0a-43b6-89df-78b0ad00ddc7 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] 10.222.0.75 "GET /compute/v2.1/servers/e911acec-b583-42eb-b5de-dee9573bad6c" status: 200 len: 1372 microversion: 2.1 time: 0.205450 May 26 12:42:17.553358 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: [pid: 129322|app: 0|req: 211/406] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 26 12:42:17 2022] GET /compute/v2.1/servers/e911acec-b583-42eb-b5de-dee9573bad6c => generated 1372 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:42:17.702627 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi [None req-e2cfb2cf-8c99-45de-88f0-de3e0b3a0b23 tempest-VolumesActionsTest-731506124 tempest-VolumesActionsTest-731506124-project] Calling method '>' {{(pid=129321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:42:17.703343 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.compute.api [None req-e2cfb2cf-8c99-45de-88f0-de3e0b3a0b23 tempest-VolumesActionsTest-731506124 tempest-VolumesActionsTest-731506124-project] [instance: 2be10a9b-0300-40be-96eb-602b1ad4b05c] Fetching instance by UUID {{(pid=129321) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:42:17.711164 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-e2cfb2cf-8c99-45de-88f0-de3e0b3a0b23 tempest-VolumesActionsTest-731506124 tempest-VolumesActionsTest-731506124-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:42:17.712166 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-e2cfb2cf-8c99-45de-88f0-de3e0b3a0b23 tempest-VolumesActionsTest-731506124 tempest-VolumesActionsTest-731506124-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:42:17.713010 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-e2cfb2cf-8c99-45de-88f0-de3e0b3a0b23 tempest-VolumesActionsTest-731506124 tempest-VolumesActionsTest-731506124-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:42:17.713632 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-e2cfb2cf-8c99-45de-88f0-de3e0b3a0b23 tempest-VolumesActionsTest-731506124 tempest-VolumesActionsTest-731506124-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:42:17.888971 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.policy [None req-e2cfb2cf-8c99-45de-88f0-de3e0b3a0b23 tempest-VolumesActionsTest-731506124 tempest-VolumesActionsTest-731506124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f39e076a9e6b401db6de9a2846519591', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa93879e60e470185e8dd71efaaf1a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129321) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:42:17.897114 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: INFO nova.api.openstack.requestlog [None req-e2cfb2cf-8c99-45de-88f0-de3e0b3a0b23 tempest-VolumesActionsTest-731506124 tempest-VolumesActionsTest-731506124-project] 10.222.0.75 "GET /compute/v2.1/servers/2be10a9b-0300-40be-96eb-602b1ad4b05c" status: 200 len: 1314 microversion: 2.1 time: 0.199573 May 26 12:42:17.897680 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: [pid: 129321|app: 0|req: 196/407] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 26 12:42:17 2022] GET /compute/v2.1/servers/2be10a9b-0300-40be-96eb-602b1ad4b05c => generated 1314 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 12:42:18.425654 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi [None req-589158a8-b400-4a1b-9d44-f4d9097398e2 tempest-TestMinimumBasicScenario-102576986 tempest-TestMinimumBasicScenario-102576986-project] Calling method '>' {{(pid=129322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:42:18.427159 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.compute.api [None req-589158a8-b400-4a1b-9d44-f4d9097398e2 tempest-TestMinimumBasicScenario-102576986 tempest-TestMinimumBasicScenario-102576986-project] [instance: 76661008-e6d3-4646-a9ba-d5d0e83a4b65] Fetching instance by UUID {{(pid=129322) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:42:18.434839 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-589158a8-b400-4a1b-9d44-f4d9097398e2 tempest-TestMinimumBasicScenario-102576986 tempest-TestMinimumBasicScenario-102576986-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:42:18.435563 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-589158a8-b400-4a1b-9d44-f4d9097398e2 tempest-TestMinimumBasicScenario-102576986 tempest-TestMinimumBasicScenario-102576986-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:42:18.436502 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-589158a8-b400-4a1b-9d44-f4d9097398e2 tempest-TestMinimumBasicScenario-102576986 tempest-TestMinimumBasicScenario-102576986-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:42:18.436998 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-589158a8-b400-4a1b-9d44-f4d9097398e2 tempest-TestMinimumBasicScenario-102576986 tempest-TestMinimumBasicScenario-102576986-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:42:18.570858 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi [None req-a70423d5-be76-49b2-be30-dfde5c960395 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Calling method '>' {{(pid=129321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:42:18.582123 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.policy [None req-589158a8-b400-4a1b-9d44-f4d9097398e2 tempest-TestMinimumBasicScenario-102576986 tempest-TestMinimumBasicScenario-102576986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0352a80bdc174b9a9df4eca60b81eba4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fa2c4d6423444e487d259062656129b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129322) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:42:18.588531 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.compute.api [None req-a70423d5-be76-49b2-be30-dfde5c960395 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] [instance: e911acec-b583-42eb-b5de-dee9573bad6c] Fetching instance by UUID {{(pid=129321) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:42:18.594716 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: INFO nova.api.openstack.requestlog [None req-589158a8-b400-4a1b-9d44-f4d9097398e2 tempest-TestMinimumBasicScenario-102576986 tempest-TestMinimumBasicScenario-102576986-project] 10.222.0.75 "GET /compute/v2.1/servers/76661008-e6d3-4646-a9ba-d5d0e83a4b65" status: 200 len: 1357 microversion: 2.1 time: 0.174394 May 26 12:42:18.595328 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: [pid: 129322|app: 0|req: 212/408] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 26 12:42:18 2022] GET /compute/v2.1/servers/76661008-e6d3-4646-a9ba-d5d0e83a4b65 => generated 1357 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:42:18.601314 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-a70423d5-be76-49b2-be30-dfde5c960395 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:42:18.602347 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-a70423d5-be76-49b2-be30-dfde5c960395 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:42:18.603772 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-a70423d5-be76-49b2-be30-dfde5c960395 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:42:18.608090 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-a70423d5-be76-49b2-be30-dfde5c960395 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:42:18.768673 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.policy [None req-a70423d5-be76-49b2-be30-dfde5c960395 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0431b1f25497443ba483b3c440669080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e36ab03283d4ce6a2fed5e111e03d34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129321) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:42:18.782367 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: INFO nova.api.openstack.requestlog [None req-a70423d5-be76-49b2-be30-dfde5c960395 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] 10.222.0.75 "GET /compute/v2.1/servers/e911acec-b583-42eb-b5de-dee9573bad6c" status: 200 len: 1372 microversion: 2.1 time: 0.215750 May 26 12:42:18.783402 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: [pid: 129321|app: 0|req: 197/409] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 26 12:42:18 2022] GET /compute/v2.1/servers/e911acec-b583-42eb-b5de-dee9573bad6c => generated 1372 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:42:18.914880 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi [None req-3507cb17-c6f3-4b7b-89ca-09ad3ceccb37 tempest-VolumesActionsTest-731506124 tempest-VolumesActionsTest-731506124-project] Calling method '>' {{(pid=129322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:42:18.915611 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.compute.api [None req-3507cb17-c6f3-4b7b-89ca-09ad3ceccb37 tempest-VolumesActionsTest-731506124 tempest-VolumesActionsTest-731506124-project] [instance: 2be10a9b-0300-40be-96eb-602b1ad4b05c] Fetching instance by UUID {{(pid=129322) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:42:18.922070 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-3507cb17-c6f3-4b7b-89ca-09ad3ceccb37 tempest-VolumesActionsTest-731506124 tempest-VolumesActionsTest-731506124-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:42:18.922599 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-3507cb17-c6f3-4b7b-89ca-09ad3ceccb37 tempest-VolumesActionsTest-731506124 tempest-VolumesActionsTest-731506124-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:42:18.923441 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-3507cb17-c6f3-4b7b-89ca-09ad3ceccb37 tempest-VolumesActionsTest-731506124 tempest-VolumesActionsTest-731506124-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:42:18.923968 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-3507cb17-c6f3-4b7b-89ca-09ad3ceccb37 tempest-VolumesActionsTest-731506124 tempest-VolumesActionsTest-731506124-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:42:19.076072 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.policy [None req-3507cb17-c6f3-4b7b-89ca-09ad3ceccb37 tempest-VolumesActionsTest-731506124 tempest-VolumesActionsTest-731506124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f39e076a9e6b401db6de9a2846519591', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa93879e60e470185e8dd71efaaf1a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129322) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:42:19.085008 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: INFO nova.api.openstack.requestlog [None req-3507cb17-c6f3-4b7b-89ca-09ad3ceccb37 tempest-VolumesActionsTest-731506124 tempest-VolumesActionsTest-731506124-project] 10.222.0.75 "GET /compute/v2.1/servers/2be10a9b-0300-40be-96eb-602b1ad4b05c" status: 200 len: 1314 microversion: 2.1 time: 0.173966 May 26 12:42:19.085625 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: [pid: 129322|app: 0|req: 213/410] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 26 12:42:18 2022] GET /compute/v2.1/servers/2be10a9b-0300-40be-96eb-602b1ad4b05c => generated 1314 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:42:19.613053 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi [None req-07a6fa21-bb47-4a04-a703-684c531f3b92 tempest-TestMinimumBasicScenario-102576986 tempest-TestMinimumBasicScenario-102576986-project] Calling method '>' {{(pid=129321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:42:19.613662 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.compute.api [None req-07a6fa21-bb47-4a04-a703-684c531f3b92 tempest-TestMinimumBasicScenario-102576986 tempest-TestMinimumBasicScenario-102576986-project] [instance: 76661008-e6d3-4646-a9ba-d5d0e83a4b65] Fetching instance by UUID {{(pid=129321) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:42:19.621157 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-07a6fa21-bb47-4a04-a703-684c531f3b92 tempest-TestMinimumBasicScenario-102576986 tempest-TestMinimumBasicScenario-102576986-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:42:19.621908 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-07a6fa21-bb47-4a04-a703-684c531f3b92 tempest-TestMinimumBasicScenario-102576986 tempest-TestMinimumBasicScenario-102576986-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:42:19.622817 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-07a6fa21-bb47-4a04-a703-684c531f3b92 tempest-TestMinimumBasicScenario-102576986 tempest-TestMinimumBasicScenario-102576986-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:42:19.623244 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-07a6fa21-bb47-4a04-a703-684c531f3b92 tempest-TestMinimumBasicScenario-102576986 tempest-TestMinimumBasicScenario-102576986-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:42:19.799120 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.policy [None req-07a6fa21-bb47-4a04-a703-684c531f3b92 tempest-TestMinimumBasicScenario-102576986 tempest-TestMinimumBasicScenario-102576986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0352a80bdc174b9a9df4eca60b81eba4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fa2c4d6423444e487d259062656129b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129321) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:42:19.800799 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi [None req-00fae82d-f2de-46bf-95c9-bf0b6f24cd8d tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Calling method '>' {{(pid=129322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:42:19.801676 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.compute.api [None req-00fae82d-f2de-46bf-95c9-bf0b6f24cd8d tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] [instance: e911acec-b583-42eb-b5de-dee9573bad6c] Fetching instance by UUID {{(pid=129322) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:42:19.808327 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: INFO nova.api.openstack.requestlog [None req-07a6fa21-bb47-4a04-a703-684c531f3b92 tempest-TestMinimumBasicScenario-102576986 tempest-TestMinimumBasicScenario-102576986-project] 10.222.0.75 "GET /compute/v2.1/servers/76661008-e6d3-4646-a9ba-d5d0e83a4b65" status: 200 len: 1357 microversion: 2.1 time: 0.198786 May 26 12:42:19.810193 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-00fae82d-f2de-46bf-95c9-bf0b6f24cd8d tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:42:19.810489 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: [pid: 129321|app: 0|req: 198/411] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 26 12:42:19 2022] GET /compute/v2.1/servers/76661008-e6d3-4646-a9ba-d5d0e83a4b65 => generated 1357 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:42:19.810648 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-00fae82d-f2de-46bf-95c9-bf0b6f24cd8d tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:42:19.811292 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-00fae82d-f2de-46bf-95c9-bf0b6f24cd8d tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:42:19.811763 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-00fae82d-f2de-46bf-95c9-bf0b6f24cd8d tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:42:19.959455 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.policy [None req-00fae82d-f2de-46bf-95c9-bf0b6f24cd8d tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0431b1f25497443ba483b3c440669080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e36ab03283d4ce6a2fed5e111e03d34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129322) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:42:19.972645 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: INFO nova.api.openstack.requestlog [None req-00fae82d-f2de-46bf-95c9-bf0b6f24cd8d tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] 10.222.0.75 "GET /compute/v2.1/servers/e911acec-b583-42eb-b5de-dee9573bad6c" status: 200 len: 1372 microversion: 2.1 time: 0.176112 May 26 12:42:19.973937 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: [pid: 129322|app: 0|req: 214/412] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 26 12:42:19 2022] GET /compute/v2.1/servers/e911acec-b583-42eb-b5de-dee9573bad6c => generated 1372 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 12:42:20.108065 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi [None req-93bed761-6403-4930-86e1-1883b4c250b9 tempest-VolumesActionsTest-731506124 tempest-VolumesActionsTest-731506124-project] Calling method '>' {{(pid=129321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:42:20.109009 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.compute.api [None req-93bed761-6403-4930-86e1-1883b4c250b9 tempest-VolumesActionsTest-731506124 tempest-VolumesActionsTest-731506124-project] [instance: 2be10a9b-0300-40be-96eb-602b1ad4b05c] Fetching instance by UUID {{(pid=129321) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:42:20.120806 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-93bed761-6403-4930-86e1-1883b4c250b9 tempest-VolumesActionsTest-731506124 tempest-VolumesActionsTest-731506124-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:42:20.120806 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-93bed761-6403-4930-86e1-1883b4c250b9 tempest-VolumesActionsTest-731506124 tempest-VolumesActionsTest-731506124-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:42:20.120806 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-93bed761-6403-4930-86e1-1883b4c250b9 tempest-VolumesActionsTest-731506124 tempest-VolumesActionsTest-731506124-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:42:20.120806 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-93bed761-6403-4930-86e1-1883b4c250b9 tempest-VolumesActionsTest-731506124 tempest-VolumesActionsTest-731506124-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:42:20.273128 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.policy [None req-93bed761-6403-4930-86e1-1883b4c250b9 tempest-VolumesActionsTest-731506124 tempest-VolumesActionsTest-731506124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f39e076a9e6b401db6de9a2846519591', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa93879e60e470185e8dd71efaaf1a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129321) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:42:20.281457 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: INFO nova.api.openstack.requestlog [None req-93bed761-6403-4930-86e1-1883b4c250b9 tempest-VolumesActionsTest-731506124 tempest-VolumesActionsTest-731506124-project] 10.222.0.75 "GET /compute/v2.1/servers/2be10a9b-0300-40be-96eb-602b1ad4b05c" status: 200 len: 1314 microversion: 2.1 time: 0.178942 May 26 12:42:20.282097 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: [pid: 129321|app: 0|req: 199/413] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 26 12:42:20 2022] GET /compute/v2.1/servers/2be10a9b-0300-40be-96eb-602b1ad4b05c => generated 1314 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:42:20.827746 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi [None req-d81162dd-8e3e-4711-9a2b-904aef252766 tempest-TestMinimumBasicScenario-102576986 tempest-TestMinimumBasicScenario-102576986-project] Calling method '>' {{(pid=129322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:42:20.828441 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.compute.api [None req-d81162dd-8e3e-4711-9a2b-904aef252766 tempest-TestMinimumBasicScenario-102576986 tempest-TestMinimumBasicScenario-102576986-project] [instance: 76661008-e6d3-4646-a9ba-d5d0e83a4b65] Fetching instance by UUID {{(pid=129322) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:42:20.835159 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-d81162dd-8e3e-4711-9a2b-904aef252766 tempest-TestMinimumBasicScenario-102576986 tempest-TestMinimumBasicScenario-102576986-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:42:20.835654 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-d81162dd-8e3e-4711-9a2b-904aef252766 tempest-TestMinimumBasicScenario-102576986 tempest-TestMinimumBasicScenario-102576986-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:42:20.837236 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-d81162dd-8e3e-4711-9a2b-904aef252766 tempest-TestMinimumBasicScenario-102576986 tempest-TestMinimumBasicScenario-102576986-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:42:20.837692 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-d81162dd-8e3e-4711-9a2b-904aef252766 tempest-TestMinimumBasicScenario-102576986 tempest-TestMinimumBasicScenario-102576986-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:42:20.991912 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi [None req-deb3cd68-5a75-49c2-aaf4-194e5d7d6e9f tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Calling method '>' {{(pid=129321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:42:20.993129 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.compute.api [None req-deb3cd68-5a75-49c2-aaf4-194e5d7d6e9f tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] [instance: e911acec-b583-42eb-b5de-dee9573bad6c] Fetching instance by UUID {{(pid=129321) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:42:20.998423 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG dbcounter [-] [129321] Writing DB stats nova_cell0:SELECT=14 {{(pid=129321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:42:21.000828 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-deb3cd68-5a75-49c2-aaf4-194e5d7d6e9f tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:42:21.001538 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-deb3cd68-5a75-49c2-aaf4-194e5d7d6e9f tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:42:21.002396 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-deb3cd68-5a75-49c2-aaf4-194e5d7d6e9f tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:42:21.002995 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-deb3cd68-5a75-49c2-aaf4-194e5d7d6e9f tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:42:21.010402 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.policy [None req-d81162dd-8e3e-4711-9a2b-904aef252766 tempest-TestMinimumBasicScenario-102576986 tempest-TestMinimumBasicScenario-102576986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0352a80bdc174b9a9df4eca60b81eba4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fa2c4d6423444e487d259062656129b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129322) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:42:21.018489 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: INFO nova.api.openstack.requestlog [None req-d81162dd-8e3e-4711-9a2b-904aef252766 tempest-TestMinimumBasicScenario-102576986 tempest-TestMinimumBasicScenario-102576986-project] 10.222.0.75 "GET /compute/v2.1/servers/76661008-e6d3-4646-a9ba-d5d0e83a4b65" status: 200 len: 1357 microversion: 2.1 time: 0.194641 May 26 12:42:21.019084 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: [pid: 129322|app: 0|req: 215/414] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 26 12:42:20 2022] GET /compute/v2.1/servers/76661008-e6d3-4646-a9ba-d5d0e83a4b65 => generated 1357 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 12:42:21.186629 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.policy [None req-deb3cd68-5a75-49c2-aaf4-194e5d7d6e9f tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0431b1f25497443ba483b3c440669080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e36ab03283d4ce6a2fed5e111e03d34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129321) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:42:21.194456 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: INFO nova.api.openstack.requestlog [None req-deb3cd68-5a75-49c2-aaf4-194e5d7d6e9f tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] 10.222.0.75 "GET /compute/v2.1/servers/e911acec-b583-42eb-b5de-dee9573bad6c" status: 200 len: 1372 microversion: 2.1 time: 0.206888 May 26 12:42:21.195050 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: [pid: 129321|app: 0|req: 200/415] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 26 12:42:20 2022] GET /compute/v2.1/servers/e911acec-b583-42eb-b5de-dee9573bad6c => generated 1372 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 12:42:21.300521 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi [None req-d34f7d53-7185-49e6-be8b-a8be57f09330 tempest-VolumesActionsTest-731506124 tempest-VolumesActionsTest-731506124-project] Calling method '>' {{(pid=129322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:42:21.301323 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.compute.api [None req-d34f7d53-7185-49e6-be8b-a8be57f09330 tempest-VolumesActionsTest-731506124 tempest-VolumesActionsTest-731506124-project] [instance: 2be10a9b-0300-40be-96eb-602b1ad4b05c] Fetching instance by UUID {{(pid=129322) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:42:21.311211 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-d34f7d53-7185-49e6-be8b-a8be57f09330 tempest-VolumesActionsTest-731506124 tempest-VolumesActionsTest-731506124-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:42:21.311964 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-d34f7d53-7185-49e6-be8b-a8be57f09330 tempest-VolumesActionsTest-731506124 tempest-VolumesActionsTest-731506124-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:42:21.313152 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-d34f7d53-7185-49e6-be8b-a8be57f09330 tempest-VolumesActionsTest-731506124 tempest-VolumesActionsTest-731506124-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:42:21.313791 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-d34f7d53-7185-49e6-be8b-a8be57f09330 tempest-VolumesActionsTest-731506124 tempest-VolumesActionsTest-731506124-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:42:21.489167 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.policy [None req-d34f7d53-7185-49e6-be8b-a8be57f09330 tempest-VolumesActionsTest-731506124 tempest-VolumesActionsTest-731506124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f39e076a9e6b401db6de9a2846519591', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa93879e60e470185e8dd71efaaf1a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129322) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:42:21.501057 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: INFO nova.api.openstack.requestlog [None req-d34f7d53-7185-49e6-be8b-a8be57f09330 tempest-VolumesActionsTest-731506124 tempest-VolumesActionsTest-731506124-project] 10.222.0.75 "GET /compute/v2.1/servers/2be10a9b-0300-40be-96eb-602b1ad4b05c" status: 200 len: 1314 microversion: 2.1 time: 0.205935 May 26 12:42:21.501939 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: [pid: 129322|app: 0|req: 216/416] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 26 12:42:21 2022] GET /compute/v2.1/servers/2be10a9b-0300-40be-96eb-602b1ad4b05c => generated 1314 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:42:22.038580 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi [None req-c1427114-7ed4-449c-8d59-5764e34b11f7 tempest-TestMinimumBasicScenario-102576986 tempest-TestMinimumBasicScenario-102576986-project] Calling method '>' {{(pid=129321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:42:22.039462 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.compute.api [None req-c1427114-7ed4-449c-8d59-5764e34b11f7 tempest-TestMinimumBasicScenario-102576986 tempest-TestMinimumBasicScenario-102576986-project] [instance: 76661008-e6d3-4646-a9ba-d5d0e83a4b65] Fetching instance by UUID {{(pid=129321) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:42:22.046517 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-c1427114-7ed4-449c-8d59-5764e34b11f7 tempest-TestMinimumBasicScenario-102576986 tempest-TestMinimumBasicScenario-102576986-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:42:22.046986 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-c1427114-7ed4-449c-8d59-5764e34b11f7 tempest-TestMinimumBasicScenario-102576986 tempest-TestMinimumBasicScenario-102576986-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:42:22.047781 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-c1427114-7ed4-449c-8d59-5764e34b11f7 tempest-TestMinimumBasicScenario-102576986 tempest-TestMinimumBasicScenario-102576986-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:42:22.048265 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-c1427114-7ed4-449c-8d59-5764e34b11f7 tempest-TestMinimumBasicScenario-102576986 tempest-TestMinimumBasicScenario-102576986-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:42:22.212083 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi [None req-c365110e-f1f4-4a0e-b074-9a3e7b1203d0 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Calling method '>' {{(pid=129322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:42:22.214456 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.compute.api [None req-c365110e-f1f4-4a0e-b074-9a3e7b1203d0 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] [instance: e911acec-b583-42eb-b5de-dee9573bad6c] Fetching instance by UUID {{(pid=129322) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:42:22.223263 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-c365110e-f1f4-4a0e-b074-9a3e7b1203d0 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:42:22.230923 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-c365110e-f1f4-4a0e-b074-9a3e7b1203d0 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:42:22.230923 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-c365110e-f1f4-4a0e-b074-9a3e7b1203d0 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:42:22.230923 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-c365110e-f1f4-4a0e-b074-9a3e7b1203d0 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:42:22.231466 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.policy [None req-c1427114-7ed4-449c-8d59-5764e34b11f7 tempest-TestMinimumBasicScenario-102576986 tempest-TestMinimumBasicScenario-102576986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0352a80bdc174b9a9df4eca60b81eba4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fa2c4d6423444e487d259062656129b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129321) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:42:22.239144 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: INFO nova.api.openstack.requestlog [None req-c1427114-7ed4-449c-8d59-5764e34b11f7 tempest-TestMinimumBasicScenario-102576986 tempest-TestMinimumBasicScenario-102576986-project] 10.222.0.75 "GET /compute/v2.1/servers/76661008-e6d3-4646-a9ba-d5d0e83a4b65" status: 200 len: 1357 microversion: 2.1 time: 0.204375 May 26 12:42:22.239808 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: [pid: 129321|app: 0|req: 201/417] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 26 12:42:22 2022] GET /compute/v2.1/servers/76661008-e6d3-4646-a9ba-d5d0e83a4b65 => generated 1357 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:42:22.377575 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.policy [None req-c365110e-f1f4-4a0e-b074-9a3e7b1203d0 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0431b1f25497443ba483b3c440669080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e36ab03283d4ce6a2fed5e111e03d34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129322) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:42:22.386235 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: INFO nova.api.openstack.requestlog [None req-c365110e-f1f4-4a0e-b074-9a3e7b1203d0 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] 10.222.0.75 "GET /compute/v2.1/servers/e911acec-b583-42eb-b5de-dee9573bad6c" status: 200 len: 1372 microversion: 2.1 time: 0.178474 May 26 12:42:22.395277 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: [pid: 129322|app: 0|req: 217/418] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 26 12:42:22 2022] GET /compute/v2.1/servers/e911acec-b583-42eb-b5de-dee9573bad6c => generated 1372 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 12:42:22.520575 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi [None req-fee74b2d-648d-4dda-8ca5-9349391d3b46 tempest-VolumesActionsTest-731506124 tempest-VolumesActionsTest-731506124-project] Calling method '>' {{(pid=129321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:42:22.521178 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.compute.api [None req-fee74b2d-648d-4dda-8ca5-9349391d3b46 tempest-VolumesActionsTest-731506124 tempest-VolumesActionsTest-731506124-project] [instance: 2be10a9b-0300-40be-96eb-602b1ad4b05c] Fetching instance by UUID {{(pid=129321) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:42:22.528499 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-fee74b2d-648d-4dda-8ca5-9349391d3b46 tempest-VolumesActionsTest-731506124 tempest-VolumesActionsTest-731506124-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:42:22.529214 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-fee74b2d-648d-4dda-8ca5-9349391d3b46 tempest-VolumesActionsTest-731506124 tempest-VolumesActionsTest-731506124-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:42:22.530370 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-fee74b2d-648d-4dda-8ca5-9349391d3b46 tempest-VolumesActionsTest-731506124 tempest-VolumesActionsTest-731506124-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:42:22.530979 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-fee74b2d-648d-4dda-8ca5-9349391d3b46 tempest-VolumesActionsTest-731506124 tempest-VolumesActionsTest-731506124-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:42:22.699578 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.policy [None req-fee74b2d-648d-4dda-8ca5-9349391d3b46 tempest-VolumesActionsTest-731506124 tempest-VolumesActionsTest-731506124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f39e076a9e6b401db6de9a2846519591', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa93879e60e470185e8dd71efaaf1a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129321) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:42:22.708049 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: INFO nova.api.openstack.requestlog [None req-fee74b2d-648d-4dda-8ca5-9349391d3b46 tempest-VolumesActionsTest-731506124 tempest-VolumesActionsTest-731506124-project] 10.222.0.75 "GET /compute/v2.1/servers/2be10a9b-0300-40be-96eb-602b1ad4b05c" status: 200 len: 1314 microversion: 2.1 time: 0.191307 May 26 12:42:22.709252 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: [pid: 129321|app: 0|req: 202/419] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 26 12:42:22 2022] GET /compute/v2.1/servers/2be10a9b-0300-40be-96eb-602b1ad4b05c => generated 1314 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:42:23.258664 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi [None req-822d6fd1-e8aa-418a-a229-ca564f8735bd tempest-TestMinimumBasicScenario-102576986 tempest-TestMinimumBasicScenario-102576986-project] Calling method '>' {{(pid=129322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:42:23.259996 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.compute.api [None req-822d6fd1-e8aa-418a-a229-ca564f8735bd tempest-TestMinimumBasicScenario-102576986 tempest-TestMinimumBasicScenario-102576986-project] [instance: 76661008-e6d3-4646-a9ba-d5d0e83a4b65] Fetching instance by UUID {{(pid=129322) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:42:23.267431 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-822d6fd1-e8aa-418a-a229-ca564f8735bd tempest-TestMinimumBasicScenario-102576986 tempest-TestMinimumBasicScenario-102576986-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:42:23.268162 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-822d6fd1-e8aa-418a-a229-ca564f8735bd tempest-TestMinimumBasicScenario-102576986 tempest-TestMinimumBasicScenario-102576986-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:42:23.269105 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-822d6fd1-e8aa-418a-a229-ca564f8735bd tempest-TestMinimumBasicScenario-102576986 tempest-TestMinimumBasicScenario-102576986-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:42:23.269686 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-822d6fd1-e8aa-418a-a229-ca564f8735bd tempest-TestMinimumBasicScenario-102576986 tempest-TestMinimumBasicScenario-102576986-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:42:23.406870 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi [None req-00c39fd2-0dc1-41f0-8059-957b36e82372 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Calling method '>' {{(pid=129321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:42:23.407715 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.compute.api [None req-00c39fd2-0dc1-41f0-8059-957b36e82372 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] [instance: e911acec-b583-42eb-b5de-dee9573bad6c] Fetching instance by UUID {{(pid=129321) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:42:23.414162 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-00c39fd2-0dc1-41f0-8059-957b36e82372 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:42:23.419905 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-00c39fd2-0dc1-41f0-8059-957b36e82372 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:42:23.419905 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-00c39fd2-0dc1-41f0-8059-957b36e82372 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:42:23.419905 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-00c39fd2-0dc1-41f0-8059-957b36e82372 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:42:23.427744 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.policy [None req-822d6fd1-e8aa-418a-a229-ca564f8735bd tempest-TestMinimumBasicScenario-102576986 tempest-TestMinimumBasicScenario-102576986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0352a80bdc174b9a9df4eca60b81eba4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fa2c4d6423444e487d259062656129b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129322) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:42:23.451844 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: INFO nova.api.openstack.requestlog [None req-822d6fd1-e8aa-418a-a229-ca564f8735bd tempest-TestMinimumBasicScenario-102576986 tempest-TestMinimumBasicScenario-102576986-project] 10.222.0.75 "GET /compute/v2.1/servers/76661008-e6d3-4646-a9ba-d5d0e83a4b65" status: 200 len: 1357 microversion: 2.1 time: 0.192513 May 26 12:42:23.452822 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: [pid: 129322|app: 0|req: 218/420] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 26 12:42:23 2022] GET /compute/v2.1/servers/76661008-e6d3-4646-a9ba-d5d0e83a4b65 => generated 1357 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:42:23.568640 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.policy [None req-00c39fd2-0dc1-41f0-8059-957b36e82372 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0431b1f25497443ba483b3c440669080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e36ab03283d4ce6a2fed5e111e03d34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129321) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:42:23.576833 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: INFO nova.api.openstack.requestlog [None req-00c39fd2-0dc1-41f0-8059-957b36e82372 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] 10.222.0.75 "GET /compute/v2.1/servers/e911acec-b583-42eb-b5de-dee9573bad6c" status: 200 len: 1372 microversion: 2.1 time: 0.174948 May 26 12:42:23.577414 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: [pid: 129321|app: 0|req: 203/421] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 26 12:42:23 2022] GET /compute/v2.1/servers/e911acec-b583-42eb-b5de-dee9573bad6c => generated 1372 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:42:23.726758 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi [None req-71628129-bead-4b5c-9682-901583feb06a tempest-VolumesActionsTest-731506124 tempest-VolumesActionsTest-731506124-project] Calling method '>' {{(pid=129322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:42:23.727789 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.compute.api [None req-71628129-bead-4b5c-9682-901583feb06a tempest-VolumesActionsTest-731506124 tempest-VolumesActionsTest-731506124-project] [instance: 2be10a9b-0300-40be-96eb-602b1ad4b05c] Fetching instance by UUID {{(pid=129322) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:42:23.737498 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-71628129-bead-4b5c-9682-901583feb06a tempest-VolumesActionsTest-731506124 tempest-VolumesActionsTest-731506124-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:42:23.737951 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-71628129-bead-4b5c-9682-901583feb06a tempest-VolumesActionsTest-731506124 tempest-VolumesActionsTest-731506124-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:42:23.738777 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-71628129-bead-4b5c-9682-901583feb06a tempest-VolumesActionsTest-731506124 tempest-VolumesActionsTest-731506124-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:42:23.739212 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-71628129-bead-4b5c-9682-901583feb06a tempest-VolumesActionsTest-731506124 tempest-VolumesActionsTest-731506124-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:42:23.901084 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.policy [None req-71628129-bead-4b5c-9682-901583feb06a tempest-VolumesActionsTest-731506124 tempest-VolumesActionsTest-731506124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f39e076a9e6b401db6de9a2846519591', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa93879e60e470185e8dd71efaaf1a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129322) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:42:23.910224 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: INFO nova.api.openstack.requestlog [None req-71628129-bead-4b5c-9682-901583feb06a tempest-VolumesActionsTest-731506124 tempest-VolumesActionsTest-731506124-project] 10.222.0.75 "GET /compute/v2.1/servers/2be10a9b-0300-40be-96eb-602b1ad4b05c" status: 200 len: 1314 microversion: 2.1 time: 0.187395 May 26 12:42:23.911074 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: [pid: 129322|app: 0|req: 219/422] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 26 12:42:23 2022] GET /compute/v2.1/servers/2be10a9b-0300-40be-96eb-602b1ad4b05c => generated 1314 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:42:24.470358 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi [None req-e6af46e1-755d-4fdf-85a6-e565f3bbe8b3 tempest-TestMinimumBasicScenario-102576986 tempest-TestMinimumBasicScenario-102576986-project] Calling method '>' {{(pid=129321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:42:24.472574 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.compute.api [None req-e6af46e1-755d-4fdf-85a6-e565f3bbe8b3 tempest-TestMinimumBasicScenario-102576986 tempest-TestMinimumBasicScenario-102576986-project] [instance: 76661008-e6d3-4646-a9ba-d5d0e83a4b65] Fetching instance by UUID {{(pid=129321) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:42:24.483308 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-e6af46e1-755d-4fdf-85a6-e565f3bbe8b3 tempest-TestMinimumBasicScenario-102576986 tempest-TestMinimumBasicScenario-102576986-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:42:24.483780 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-e6af46e1-755d-4fdf-85a6-e565f3bbe8b3 tempest-TestMinimumBasicScenario-102576986 tempest-TestMinimumBasicScenario-102576986-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:42:24.484566 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-e6af46e1-755d-4fdf-85a6-e565f3bbe8b3 tempest-TestMinimumBasicScenario-102576986 tempest-TestMinimumBasicScenario-102576986-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:42:24.485295 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-e6af46e1-755d-4fdf-85a6-e565f3bbe8b3 tempest-TestMinimumBasicScenario-102576986 tempest-TestMinimumBasicScenario-102576986-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:42:24.597430 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi [None req-46140359-9915-4cb4-af66-7eaf28cbbfc4 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Calling method '>' {{(pid=129322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:42:24.598045 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.compute.api [None req-46140359-9915-4cb4-af66-7eaf28cbbfc4 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] [instance: e911acec-b583-42eb-b5de-dee9573bad6c] Fetching instance by UUID {{(pid=129322) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:42:24.605291 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-46140359-9915-4cb4-af66-7eaf28cbbfc4 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:42:24.605800 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-46140359-9915-4cb4-af66-7eaf28cbbfc4 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:42:24.606593 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-46140359-9915-4cb4-af66-7eaf28cbbfc4 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:42:24.606997 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-46140359-9915-4cb4-af66-7eaf28cbbfc4 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:42:24.652933 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.policy [None req-e6af46e1-755d-4fdf-85a6-e565f3bbe8b3 tempest-TestMinimumBasicScenario-102576986 tempest-TestMinimumBasicScenario-102576986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0352a80bdc174b9a9df4eca60b81eba4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fa2c4d6423444e487d259062656129b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129321) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:42:24.678293 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: INFO nova.api.openstack.requestlog [None req-e6af46e1-755d-4fdf-85a6-e565f3bbe8b3 tempest-TestMinimumBasicScenario-102576986 tempest-TestMinimumBasicScenario-102576986-project] 10.222.0.75 "GET /compute/v2.1/servers/76661008-e6d3-4646-a9ba-d5d0e83a4b65" status: 200 len: 1357 microversion: 2.1 time: 0.212580 May 26 12:42:24.678925 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: [pid: 129321|app: 0|req: 204/423] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 26 12:42:24 2022] GET /compute/v2.1/servers/76661008-e6d3-4646-a9ba-d5d0e83a4b65 => generated 1357 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:42:24.769301 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.policy [None req-46140359-9915-4cb4-af66-7eaf28cbbfc4 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0431b1f25497443ba483b3c440669080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e36ab03283d4ce6a2fed5e111e03d34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129322) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:42:24.780180 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: INFO nova.api.openstack.requestlog [None req-46140359-9915-4cb4-af66-7eaf28cbbfc4 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] 10.222.0.75 "GET /compute/v2.1/servers/e911acec-b583-42eb-b5de-dee9573bad6c" status: 200 len: 1372 microversion: 2.1 time: 0.189388 May 26 12:42:24.780774 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: [pid: 129322|app: 0|req: 220/424] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 26 12:42:24 2022] GET /compute/v2.1/servers/e911acec-b583-42eb-b5de-dee9573bad6c => generated 1372 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:42:24.928675 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi [None req-4cd3465e-9765-46cb-bd0e-fca2d6ebf350 tempest-VolumesActionsTest-731506124 tempest-VolumesActionsTest-731506124-project] Calling method '>' {{(pid=129321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:42:24.929473 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.compute.api [None req-4cd3465e-9765-46cb-bd0e-fca2d6ebf350 tempest-VolumesActionsTest-731506124 tempest-VolumesActionsTest-731506124-project] [instance: 2be10a9b-0300-40be-96eb-602b1ad4b05c] Fetching instance by UUID {{(pid=129321) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:42:24.937262 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-4cd3465e-9765-46cb-bd0e-fca2d6ebf350 tempest-VolumesActionsTest-731506124 tempest-VolumesActionsTest-731506124-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:42:24.937886 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-4cd3465e-9765-46cb-bd0e-fca2d6ebf350 tempest-VolumesActionsTest-731506124 tempest-VolumesActionsTest-731506124-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:42:24.938985 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-4cd3465e-9765-46cb-bd0e-fca2d6ebf350 tempest-VolumesActionsTest-731506124 tempest-VolumesActionsTest-731506124-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:42:24.939620 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-4cd3465e-9765-46cb-bd0e-fca2d6ebf350 tempest-VolumesActionsTest-731506124 tempest-VolumesActionsTest-731506124-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:42:25.093848 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.policy [None req-4cd3465e-9765-46cb-bd0e-fca2d6ebf350 tempest-VolumesActionsTest-731506124 tempest-VolumesActionsTest-731506124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f39e076a9e6b401db6de9a2846519591', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa93879e60e470185e8dd71efaaf1a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129321) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:42:25.105889 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: INFO nova.api.openstack.requestlog [None req-4cd3465e-9765-46cb-bd0e-fca2d6ebf350 tempest-VolumesActionsTest-731506124 tempest-VolumesActionsTest-731506124-project] 10.222.0.75 "GET /compute/v2.1/servers/2be10a9b-0300-40be-96eb-602b1ad4b05c" status: 200 len: 1314 microversion: 2.1 time: 0.182801 May 26 12:42:25.106900 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: [pid: 129321|app: 0|req: 205/425] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 26 12:42:24 2022] GET /compute/v2.1/servers/2be10a9b-0300-40be-96eb-602b1ad4b05c => generated 1314 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:42:25.698208 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi [None req-a181031e-bde9-4c34-8b4c-169e25dbf8fe tempest-TestMinimumBasicScenario-102576986 tempest-TestMinimumBasicScenario-102576986-project] Calling method '>' {{(pid=129322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:42:25.698862 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.compute.api [None req-a181031e-bde9-4c34-8b4c-169e25dbf8fe tempest-TestMinimumBasicScenario-102576986 tempest-TestMinimumBasicScenario-102576986-project] [instance: 76661008-e6d3-4646-a9ba-d5d0e83a4b65] Fetching instance by UUID {{(pid=129322) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:42:25.706097 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-a181031e-bde9-4c34-8b4c-169e25dbf8fe tempest-TestMinimumBasicScenario-102576986 tempest-TestMinimumBasicScenario-102576986-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:42:25.706886 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-a181031e-bde9-4c34-8b4c-169e25dbf8fe tempest-TestMinimumBasicScenario-102576986 tempest-TestMinimumBasicScenario-102576986-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:42:25.707682 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-a181031e-bde9-4c34-8b4c-169e25dbf8fe tempest-TestMinimumBasicScenario-102576986 tempest-TestMinimumBasicScenario-102576986-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:42:25.708111 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-a181031e-bde9-4c34-8b4c-169e25dbf8fe tempest-TestMinimumBasicScenario-102576986 tempest-TestMinimumBasicScenario-102576986-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:42:25.797346 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi [None req-efe5ede1-4c04-4a5e-b951-431e3fde2074 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Calling method '>' {{(pid=129321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:42:25.798021 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.compute.api [None req-efe5ede1-4c04-4a5e-b951-431e3fde2074 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] [instance: e911acec-b583-42eb-b5de-dee9573bad6c] Fetching instance by UUID {{(pid=129321) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:42:25.804456 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-efe5ede1-4c04-4a5e-b951-431e3fde2074 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:42:25.804907 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-efe5ede1-4c04-4a5e-b951-431e3fde2074 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:42:25.805671 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-efe5ede1-4c04-4a5e-b951-431e3fde2074 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:42:25.806307 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-efe5ede1-4c04-4a5e-b951-431e3fde2074 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:42:25.883740 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.policy [None req-a181031e-bde9-4c34-8b4c-169e25dbf8fe tempest-TestMinimumBasicScenario-102576986 tempest-TestMinimumBasicScenario-102576986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0352a80bdc174b9a9df4eca60b81eba4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fa2c4d6423444e487d259062656129b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129322) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:42:25.893000 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: INFO nova.api.openstack.requestlog [None req-a181031e-bde9-4c34-8b4c-169e25dbf8fe tempest-TestMinimumBasicScenario-102576986 tempest-TestMinimumBasicScenario-102576986-project] 10.222.0.75 "GET /compute/v2.1/servers/76661008-e6d3-4646-a9ba-d5d0e83a4b65" status: 200 len: 1357 microversion: 2.1 time: 0.200821 May 26 12:42:25.893606 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: [pid: 129322|app: 0|req: 221/426] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 26 12:42:25 2022] GET /compute/v2.1/servers/76661008-e6d3-4646-a9ba-d5d0e83a4b65 => generated 1357 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:42:26.124716 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi [None req-635faac7-477f-4bc3-bebd-79697751f26a tempest-VolumesActionsTest-731506124 tempest-VolumesActionsTest-731506124-project] Calling method '>' {{(pid=129322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:42:26.125331 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.compute.api [None req-635faac7-477f-4bc3-bebd-79697751f26a tempest-VolumesActionsTest-731506124 tempest-VolumesActionsTest-731506124-project] [instance: 2be10a9b-0300-40be-96eb-602b1ad4b05c] Fetching instance by UUID {{(pid=129322) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:42:26.132006 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-635faac7-477f-4bc3-bebd-79697751f26a tempest-VolumesActionsTest-731506124 tempest-VolumesActionsTest-731506124-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:42:26.132452 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-635faac7-477f-4bc3-bebd-79697751f26a tempest-VolumesActionsTest-731506124 tempest-VolumesActionsTest-731506124-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:42:26.133251 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-635faac7-477f-4bc3-bebd-79697751f26a tempest-VolumesActionsTest-731506124 tempest-VolumesActionsTest-731506124-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:42:26.133683 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-635faac7-477f-4bc3-bebd-79697751f26a tempest-VolumesActionsTest-731506124 tempest-VolumesActionsTest-731506124-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:42:26.229822 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.policy [None req-efe5ede1-4c04-4a5e-b951-431e3fde2074 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0431b1f25497443ba483b3c440669080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e36ab03283d4ce6a2fed5e111e03d34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129321) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:42:26.237628 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: INFO nova.api.openstack.requestlog [None req-efe5ede1-4c04-4a5e-b951-431e3fde2074 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] 10.222.0.75 "GET /compute/v2.1/servers/e911acec-b583-42eb-b5de-dee9573bad6c" status: 200 len: 1372 microversion: 2.1 time: 0.444080 May 26 12:42:26.238416 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: [pid: 129321|app: 0|req: 206/427] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 26 12:42:25 2022] GET /compute/v2.1/servers/e911acec-b583-42eb-b5de-dee9573bad6c => generated 1372 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 12:42:26.314216 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.policy [None req-635faac7-477f-4bc3-bebd-79697751f26a tempest-VolumesActionsTest-731506124 tempest-VolumesActionsTest-731506124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f39e076a9e6b401db6de9a2846519591', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa93879e60e470185e8dd71efaaf1a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129322) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:42:26.322384 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: INFO nova.api.openstack.requestlog [None req-635faac7-477f-4bc3-bebd-79697751f26a tempest-VolumesActionsTest-731506124 tempest-VolumesActionsTest-731506124-project] 10.222.0.75 "GET /compute/v2.1/servers/2be10a9b-0300-40be-96eb-602b1ad4b05c" status: 200 len: 1314 microversion: 2.1 time: 0.202124 May 26 12:42:26.322943 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: [pid: 129322|app: 0|req: 222/428] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 26 12:42:26 2022] GET /compute/v2.1/servers/2be10a9b-0300-40be-96eb-602b1ad4b05c => generated 1314 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 12:42:26.912384 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi [None req-6dd9156e-3f1d-438b-aa3d-1e550d9ecb29 tempest-TestMinimumBasicScenario-102576986 tempest-TestMinimumBasicScenario-102576986-project] Calling method '>' {{(pid=129321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:42:26.913020 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.compute.api [None req-6dd9156e-3f1d-438b-aa3d-1e550d9ecb29 tempest-TestMinimumBasicScenario-102576986 tempest-TestMinimumBasicScenario-102576986-project] [instance: 76661008-e6d3-4646-a9ba-d5d0e83a4b65] Fetching instance by UUID {{(pid=129321) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:42:26.921695 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-6dd9156e-3f1d-438b-aa3d-1e550d9ecb29 tempest-TestMinimumBasicScenario-102576986 tempest-TestMinimumBasicScenario-102576986-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:42:26.922573 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-6dd9156e-3f1d-438b-aa3d-1e550d9ecb29 tempest-TestMinimumBasicScenario-102576986 tempest-TestMinimumBasicScenario-102576986-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:42:26.923526 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-6dd9156e-3f1d-438b-aa3d-1e550d9ecb29 tempest-TestMinimumBasicScenario-102576986 tempest-TestMinimumBasicScenario-102576986-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:42:26.923985 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-6dd9156e-3f1d-438b-aa3d-1e550d9ecb29 tempest-TestMinimumBasicScenario-102576986 tempest-TestMinimumBasicScenario-102576986-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:42:27.074001 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.policy [None req-6dd9156e-3f1d-438b-aa3d-1e550d9ecb29 tempest-TestMinimumBasicScenario-102576986 tempest-TestMinimumBasicScenario-102576986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0352a80bdc174b9a9df4eca60b81eba4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fa2c4d6423444e487d259062656129b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129321) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:42:27.081733 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: INFO nova.api.openstack.requestlog [None req-6dd9156e-3f1d-438b-aa3d-1e550d9ecb29 tempest-TestMinimumBasicScenario-102576986 tempest-TestMinimumBasicScenario-102576986-project] 10.222.0.75 "GET /compute/v2.1/servers/76661008-e6d3-4646-a9ba-d5d0e83a4b65" status: 200 len: 1357 microversion: 2.1 time: 0.173425 May 26 12:42:27.082320 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: [pid: 129321|app: 0|req: 207/429] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 26 12:42:26 2022] GET /compute/v2.1/servers/76661008-e6d3-4646-a9ba-d5d0e83a4b65 => generated 1357 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:42:27.258251 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi [None req-00367b82-bd00-429d-bd84-4bc58cf9f259 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Calling method '>' {{(pid=129322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:42:27.259192 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.compute.api [None req-00367b82-bd00-429d-bd84-4bc58cf9f259 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] [instance: e911acec-b583-42eb-b5de-dee9573bad6c] Fetching instance by UUID {{(pid=129322) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:42:27.266122 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-00367b82-bd00-429d-bd84-4bc58cf9f259 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:42:27.266558 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-00367b82-bd00-429d-bd84-4bc58cf9f259 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:42:27.267326 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-00367b82-bd00-429d-bd84-4bc58cf9f259 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:42:27.267800 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-00367b82-bd00-429d-bd84-4bc58cf9f259 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:42:27.339321 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi [None req-2e4d14fc-edd7-449a-8ec7-888403da86a7 tempest-VolumesActionsTest-731506124 tempest-VolumesActionsTest-731506124-project] Calling method '>' {{(pid=129321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:42:27.340114 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.compute.api [None req-2e4d14fc-edd7-449a-8ec7-888403da86a7 tempest-VolumesActionsTest-731506124 tempest-VolumesActionsTest-731506124-project] [instance: 2be10a9b-0300-40be-96eb-602b1ad4b05c] Fetching instance by UUID {{(pid=129321) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:42:27.346555 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-2e4d14fc-edd7-449a-8ec7-888403da86a7 tempest-VolumesActionsTest-731506124 tempest-VolumesActionsTest-731506124-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:42:27.347044 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-2e4d14fc-edd7-449a-8ec7-888403da86a7 tempest-VolumesActionsTest-731506124 tempest-VolumesActionsTest-731506124-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:42:27.347953 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-2e4d14fc-edd7-449a-8ec7-888403da86a7 tempest-VolumesActionsTest-731506124 tempest-VolumesActionsTest-731506124-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:42:27.348417 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-2e4d14fc-edd7-449a-8ec7-888403da86a7 tempest-VolumesActionsTest-731506124 tempest-VolumesActionsTest-731506124-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:42:27.429970 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.policy [None req-00367b82-bd00-429d-bd84-4bc58cf9f259 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0431b1f25497443ba483b3c440669080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e36ab03283d4ce6a2fed5e111e03d34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129322) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:42:27.449041 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: INFO nova.api.openstack.requestlog [None req-00367b82-bd00-429d-bd84-4bc58cf9f259 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] 10.222.0.75 "GET /compute/v2.1/servers/e911acec-b583-42eb-b5de-dee9573bad6c" status: 200 len: 1372 microversion: 2.1 time: 0.196594 May 26 12:42:27.456027 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: [pid: 129322|app: 0|req: 223/430] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 26 12:42:27 2022] GET /compute/v2.1/servers/e911acec-b583-42eb-b5de-dee9573bad6c => generated 1372 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:42:27.540245 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.policy [None req-2e4d14fc-edd7-449a-8ec7-888403da86a7 tempest-VolumesActionsTest-731506124 tempest-VolumesActionsTest-731506124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f39e076a9e6b401db6de9a2846519591', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa93879e60e470185e8dd71efaaf1a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129321) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:42:27.548902 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: INFO nova.api.openstack.requestlog [None req-2e4d14fc-edd7-449a-8ec7-888403da86a7 tempest-VolumesActionsTest-731506124 tempest-VolumesActionsTest-731506124-project] 10.222.0.75 "GET /compute/v2.1/servers/2be10a9b-0300-40be-96eb-602b1ad4b05c" status: 200 len: 1314 microversion: 2.1 time: 0.213577 May 26 12:42:27.549496 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: [pid: 129321|app: 0|req: 208/431] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 26 12:42:27 2022] GET /compute/v2.1/servers/2be10a9b-0300-40be-96eb-602b1ad4b05c => generated 1314 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 12:42:28.100344 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi [None req-0376ccf7-623c-49fd-8f06-fd02eeb581e8 tempest-TestMinimumBasicScenario-102576986 tempest-TestMinimumBasicScenario-102576986-project] Calling method '>' {{(pid=129322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:42:28.100885 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.compute.api [None req-0376ccf7-623c-49fd-8f06-fd02eeb581e8 tempest-TestMinimumBasicScenario-102576986 tempest-TestMinimumBasicScenario-102576986-project] [instance: 76661008-e6d3-4646-a9ba-d5d0e83a4b65] Fetching instance by UUID {{(pid=129322) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:42:28.108218 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-0376ccf7-623c-49fd-8f06-fd02eeb581e8 tempest-TestMinimumBasicScenario-102576986 tempest-TestMinimumBasicScenario-102576986-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:42:28.108668 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-0376ccf7-623c-49fd-8f06-fd02eeb581e8 tempest-TestMinimumBasicScenario-102576986 tempest-TestMinimumBasicScenario-102576986-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:42:28.109507 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-0376ccf7-623c-49fd-8f06-fd02eeb581e8 tempest-TestMinimumBasicScenario-102576986 tempest-TestMinimumBasicScenario-102576986-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:42:28.109960 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-0376ccf7-623c-49fd-8f06-fd02eeb581e8 tempest-TestMinimumBasicScenario-102576986 tempest-TestMinimumBasicScenario-102576986-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:42:28.260476 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.policy [None req-0376ccf7-623c-49fd-8f06-fd02eeb581e8 tempest-TestMinimumBasicScenario-102576986 tempest-TestMinimumBasicScenario-102576986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0352a80bdc174b9a9df4eca60b81eba4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fa2c4d6423444e487d259062656129b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129322) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:42:28.269990 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: INFO nova.api.openstack.requestlog [None req-0376ccf7-623c-49fd-8f06-fd02eeb581e8 tempest-TestMinimumBasicScenario-102576986 tempest-TestMinimumBasicScenario-102576986-project] 10.222.0.75 "GET /compute/v2.1/servers/76661008-e6d3-4646-a9ba-d5d0e83a4b65" status: 200 len: 1357 microversion: 2.1 time: 0.173971 May 26 12:42:28.271284 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: [pid: 129322|app: 0|req: 224/432] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 26 12:42:28 2022] GET /compute/v2.1/servers/76661008-e6d3-4646-a9ba-d5d0e83a4b65 => generated 1357 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:42:28.465874 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi [None req-81e604c9-ff25-4cb2-af57-6bd1759dc9d0 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Calling method '>' {{(pid=129321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:42:28.466661 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.compute.api [None req-81e604c9-ff25-4cb2-af57-6bd1759dc9d0 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] [instance: e911acec-b583-42eb-b5de-dee9573bad6c] Fetching instance by UUID {{(pid=129321) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:42:28.473751 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-81e604c9-ff25-4cb2-af57-6bd1759dc9d0 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:42:28.474138 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-81e604c9-ff25-4cb2-af57-6bd1759dc9d0 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:42:28.474900 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-81e604c9-ff25-4cb2-af57-6bd1759dc9d0 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:42:28.475325 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-81e604c9-ff25-4cb2-af57-6bd1759dc9d0 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:42:28.566991 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi [None req-586e7be8-9772-4cdb-bea6-72ed286661a4 tempest-VolumesActionsTest-731506124 tempest-VolumesActionsTest-731506124-project] Calling method '>' {{(pid=129322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:42:28.567893 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.compute.api [None req-586e7be8-9772-4cdb-bea6-72ed286661a4 tempest-VolumesActionsTest-731506124 tempest-VolumesActionsTest-731506124-project] [instance: 2be10a9b-0300-40be-96eb-602b1ad4b05c] Fetching instance by UUID {{(pid=129322) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:42:28.587364 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-586e7be8-9772-4cdb-bea6-72ed286661a4 tempest-VolumesActionsTest-731506124 tempest-VolumesActionsTest-731506124-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:42:28.587916 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-586e7be8-9772-4cdb-bea6-72ed286661a4 tempest-VolumesActionsTest-731506124 tempest-VolumesActionsTest-731506124-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:42:28.588774 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-586e7be8-9772-4cdb-bea6-72ed286661a4 tempest-VolumesActionsTest-731506124 tempest-VolumesActionsTest-731506124-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:42:28.589209 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-586e7be8-9772-4cdb-bea6-72ed286661a4 tempest-VolumesActionsTest-731506124 tempest-VolumesActionsTest-731506124-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:42:28.592359 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG dbcounter [-] [129322] Writing DB stats nova_cell1:SELECT=100 {{(pid=129322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:42:28.630053 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.policy [None req-81e604c9-ff25-4cb2-af57-6bd1759dc9d0 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0431b1f25497443ba483b3c440669080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e36ab03283d4ce6a2fed5e111e03d34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129321) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:42:28.638082 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: INFO nova.api.openstack.requestlog [None req-81e604c9-ff25-4cb2-af57-6bd1759dc9d0 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] 10.222.0.75 "GET /compute/v2.1/servers/e911acec-b583-42eb-b5de-dee9573bad6c" status: 200 len: 1372 microversion: 2.1 time: 0.175996 May 26 12:42:28.638752 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: [pid: 129321|app: 0|req: 209/433] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 26 12:42:28 2022] GET /compute/v2.1/servers/e911acec-b583-42eb-b5de-dee9573bad6c => generated 1372 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:42:28.739271 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.policy [None req-586e7be8-9772-4cdb-bea6-72ed286661a4 tempest-VolumesActionsTest-731506124 tempest-VolumesActionsTest-731506124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f39e076a9e6b401db6de9a2846519591', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa93879e60e470185e8dd71efaaf1a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129322) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:42:28.751565 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: INFO nova.api.openstack.requestlog [None req-586e7be8-9772-4cdb-bea6-72ed286661a4 tempest-VolumesActionsTest-731506124 tempest-VolumesActionsTest-731506124-project] 10.222.0.75 "GET /compute/v2.1/servers/2be10a9b-0300-40be-96eb-602b1ad4b05c" status: 200 len: 1314 microversion: 2.1 time: 0.184169 May 26 12:42:28.756599 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: [pid: 129322|app: 0|req: 225/434] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 26 12:42:28 2022] GET /compute/v2.1/servers/2be10a9b-0300-40be-96eb-602b1ad4b05c => generated 1314 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 12:42:29.288581 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi [None req-90f382b6-ead1-4d46-8f53-ee2103989ad0 tempest-TestMinimumBasicScenario-102576986 tempest-TestMinimumBasicScenario-102576986-project] Calling method '>' {{(pid=129321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:42:29.289265 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.compute.api [None req-90f382b6-ead1-4d46-8f53-ee2103989ad0 tempest-TestMinimumBasicScenario-102576986 tempest-TestMinimumBasicScenario-102576986-project] [instance: 76661008-e6d3-4646-a9ba-d5d0e83a4b65] Fetching instance by UUID {{(pid=129321) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:42:29.296179 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-90f382b6-ead1-4d46-8f53-ee2103989ad0 tempest-TestMinimumBasicScenario-102576986 tempest-TestMinimumBasicScenario-102576986-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:42:29.296618 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-90f382b6-ead1-4d46-8f53-ee2103989ad0 tempest-TestMinimumBasicScenario-102576986 tempest-TestMinimumBasicScenario-102576986-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:42:29.297380 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-90f382b6-ead1-4d46-8f53-ee2103989ad0 tempest-TestMinimumBasicScenario-102576986 tempest-TestMinimumBasicScenario-102576986-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:42:29.297801 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-90f382b6-ead1-4d46-8f53-ee2103989ad0 tempest-TestMinimumBasicScenario-102576986 tempest-TestMinimumBasicScenario-102576986-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:42:29.436609 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.policy [None req-90f382b6-ead1-4d46-8f53-ee2103989ad0 tempest-TestMinimumBasicScenario-102576986 tempest-TestMinimumBasicScenario-102576986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0352a80bdc174b9a9df4eca60b81eba4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fa2c4d6423444e487d259062656129b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129321) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:42:29.444529 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: INFO nova.api.openstack.requestlog [None req-90f382b6-ead1-4d46-8f53-ee2103989ad0 tempest-TestMinimumBasicScenario-102576986 tempest-TestMinimumBasicScenario-102576986-project] 10.222.0.75 "GET /compute/v2.1/servers/76661008-e6d3-4646-a9ba-d5d0e83a4b65" status: 200 len: 1357 microversion: 2.1 time: 0.159753 May 26 12:42:29.445111 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: [pid: 129321|app: 0|req: 210/435] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 26 12:42:29 2022] GET /compute/v2.1/servers/76661008-e6d3-4646-a9ba-d5d0e83a4b65 => generated 1357 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:42:29.655244 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi [None req-9ee8726f-bb1a-4a63-a943-9b21e28e743b tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Calling method '>' {{(pid=129322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:42:29.655956 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.compute.api [None req-9ee8726f-bb1a-4a63-a943-9b21e28e743b tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] [instance: e911acec-b583-42eb-b5de-dee9573bad6c] Fetching instance by UUID {{(pid=129322) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:42:29.664264 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-9ee8726f-bb1a-4a63-a943-9b21e28e743b tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:42:29.665008 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-9ee8726f-bb1a-4a63-a943-9b21e28e743b tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:42:29.666381 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-9ee8726f-bb1a-4a63-a943-9b21e28e743b tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:42:29.666801 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-9ee8726f-bb1a-4a63-a943-9b21e28e743b tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:42:29.764712 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi [None req-256e488a-6ab5-4686-aea9-d628ab3f331a tempest-VolumesActionsTest-731506124 tempest-VolumesActionsTest-731506124-project] Calling method '>' {{(pid=129321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:42:29.766037 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.compute.api [None req-256e488a-6ab5-4686-aea9-d628ab3f331a tempest-VolumesActionsTest-731506124 tempest-VolumesActionsTest-731506124-project] [instance: 2be10a9b-0300-40be-96eb-602b1ad4b05c] Fetching instance by UUID {{(pid=129321) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:42:29.773252 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-256e488a-6ab5-4686-aea9-d628ab3f331a tempest-VolumesActionsTest-731506124 tempest-VolumesActionsTest-731506124-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:42:29.774049 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-256e488a-6ab5-4686-aea9-d628ab3f331a tempest-VolumesActionsTest-731506124 tempest-VolumesActionsTest-731506124-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:42:29.774819 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-256e488a-6ab5-4686-aea9-d628ab3f331a tempest-VolumesActionsTest-731506124 tempest-VolumesActionsTest-731506124-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:42:29.775253 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-256e488a-6ab5-4686-aea9-d628ab3f331a tempest-VolumesActionsTest-731506124 tempest-VolumesActionsTest-731506124-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:42:29.808047 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.policy [None req-9ee8726f-bb1a-4a63-a943-9b21e28e743b tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0431b1f25497443ba483b3c440669080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e36ab03283d4ce6a2fed5e111e03d34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129322) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:42:29.816388 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: INFO nova.api.openstack.requestlog [None req-9ee8726f-bb1a-4a63-a943-9b21e28e743b tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] 10.222.0.75 "GET /compute/v2.1/servers/e911acec-b583-42eb-b5de-dee9573bad6c" status: 200 len: 1372 microversion: 2.1 time: 0.165056 May 26 12:42:29.817006 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: [pid: 129322|app: 0|req: 226/436] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 26 12:42:29 2022] GET /compute/v2.1/servers/e911acec-b583-42eb-b5de-dee9573bad6c => generated 1372 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:42:29.914246 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.policy [None req-256e488a-6ab5-4686-aea9-d628ab3f331a tempest-VolumesActionsTest-731506124 tempest-VolumesActionsTest-731506124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f39e076a9e6b401db6de9a2846519591', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa93879e60e470185e8dd71efaaf1a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129321) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:42:29.922515 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: INFO nova.api.openstack.requestlog [None req-256e488a-6ab5-4686-aea9-d628ab3f331a tempest-VolumesActionsTest-731506124 tempest-VolumesActionsTest-731506124-project] 10.222.0.75 "GET /compute/v2.1/servers/2be10a9b-0300-40be-96eb-602b1ad4b05c" status: 200 len: 1314 microversion: 2.1 time: 0.161713 May 26 12:42:29.923117 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: [pid: 129321|app: 0|req: 211/437] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 26 12:42:29 2022] GET /compute/v2.1/servers/2be10a9b-0300-40be-96eb-602b1ad4b05c => generated 1314 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 12:42:30.462401 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi [None req-2f8985a1-7a04-4821-9564-28616e5f5e4e tempest-TestMinimumBasicScenario-102576986 tempest-TestMinimumBasicScenario-102576986-project] Calling method '>' {{(pid=129322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:42:30.463094 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.compute.api [None req-2f8985a1-7a04-4821-9564-28616e5f5e4e tempest-TestMinimumBasicScenario-102576986 tempest-TestMinimumBasicScenario-102576986-project] [instance: 76661008-e6d3-4646-a9ba-d5d0e83a4b65] Fetching instance by UUID {{(pid=129322) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:42:30.469421 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-2f8985a1-7a04-4821-9564-28616e5f5e4e tempest-TestMinimumBasicScenario-102576986 tempest-TestMinimumBasicScenario-102576986-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:42:30.469856 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-2f8985a1-7a04-4821-9564-28616e5f5e4e tempest-TestMinimumBasicScenario-102576986 tempest-TestMinimumBasicScenario-102576986-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:42:30.470618 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-2f8985a1-7a04-4821-9564-28616e5f5e4e tempest-TestMinimumBasicScenario-102576986 tempest-TestMinimumBasicScenario-102576986-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:42:30.471046 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-2f8985a1-7a04-4821-9564-28616e5f5e4e tempest-TestMinimumBasicScenario-102576986 tempest-TestMinimumBasicScenario-102576986-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:42:30.604208 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.policy [None req-2f8985a1-7a04-4821-9564-28616e5f5e4e tempest-TestMinimumBasicScenario-102576986 tempest-TestMinimumBasicScenario-102576986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0352a80bdc174b9a9df4eca60b81eba4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fa2c4d6423444e487d259062656129b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129322) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:42:30.614102 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: INFO nova.api.openstack.requestlog [None req-2f8985a1-7a04-4821-9564-28616e5f5e4e tempest-TestMinimumBasicScenario-102576986 tempest-TestMinimumBasicScenario-102576986-project] 10.222.0.75 "GET /compute/v2.1/servers/76661008-e6d3-4646-a9ba-d5d0e83a4b65" status: 200 len: 1357 microversion: 2.1 time: 0.155644 May 26 12:42:30.614702 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: [pid: 129322|app: 0|req: 227/438] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 26 12:42:30 2022] GET /compute/v2.1/servers/76661008-e6d3-4646-a9ba-d5d0e83a4b65 => generated 1357 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:42:30.834130 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi [None req-a41ebb05-9183-483f-ab85-38571606e077 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Calling method '>' {{(pid=129321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:42:30.834786 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.compute.api [None req-a41ebb05-9183-483f-ab85-38571606e077 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] [instance: e911acec-b583-42eb-b5de-dee9573bad6c] Fetching instance by UUID {{(pid=129321) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:42:30.842273 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-a41ebb05-9183-483f-ab85-38571606e077 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:42:30.842749 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-a41ebb05-9183-483f-ab85-38571606e077 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:42:30.843553 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-a41ebb05-9183-483f-ab85-38571606e077 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:42:30.844006 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-a41ebb05-9183-483f-ab85-38571606e077 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:42:30.862439 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG dbcounter [-] [129321] Writing DB stats nova_cell1:SELECT=100 {{(pid=129321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:42:30.940284 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi [None req-b63f8d94-0056-49a4-aad8-f8816fd8d59d tempest-VolumesActionsTest-731506124 tempest-VolumesActionsTest-731506124-project] Calling method '>' {{(pid=129322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:42:30.940892 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.compute.api [None req-b63f8d94-0056-49a4-aad8-f8816fd8d59d tempest-VolumesActionsTest-731506124 tempest-VolumesActionsTest-731506124-project] [instance: 2be10a9b-0300-40be-96eb-602b1ad4b05c] Fetching instance by UUID {{(pid=129322) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:42:30.947919 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-b63f8d94-0056-49a4-aad8-f8816fd8d59d tempest-VolumesActionsTest-731506124 tempest-VolumesActionsTest-731506124-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:42:30.948370 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-b63f8d94-0056-49a4-aad8-f8816fd8d59d tempest-VolumesActionsTest-731506124 tempest-VolumesActionsTest-731506124-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:42:30.949150 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-b63f8d94-0056-49a4-aad8-f8816fd8d59d tempest-VolumesActionsTest-731506124 tempest-VolumesActionsTest-731506124-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:42:30.949577 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-b63f8d94-0056-49a4-aad8-f8816fd8d59d tempest-VolumesActionsTest-731506124 tempest-VolumesActionsTest-731506124-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:42:30.988683 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.policy [None req-a41ebb05-9183-483f-ab85-38571606e077 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0431b1f25497443ba483b3c440669080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e36ab03283d4ce6a2fed5e111e03d34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129321) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:42:30.997267 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: INFO nova.api.openstack.requestlog [None req-a41ebb05-9183-483f-ab85-38571606e077 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] 10.222.0.75 "GET /compute/v2.1/servers/e911acec-b583-42eb-b5de-dee9573bad6c" status: 200 len: 1372 microversion: 2.1 time: 0.166977 May 26 12:42:30.998062 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: [pid: 129321|app: 0|req: 212/439] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 26 12:42:30 2022] GET /compute/v2.1/servers/e911acec-b583-42eb-b5de-dee9573bad6c => generated 1372 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:42:31.101550 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.policy [None req-b63f8d94-0056-49a4-aad8-f8816fd8d59d tempest-VolumesActionsTest-731506124 tempest-VolumesActionsTest-731506124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f39e076a9e6b401db6de9a2846519591', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa93879e60e470185e8dd71efaaf1a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129322) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:42:31.110554 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: INFO nova.api.openstack.requestlog [None req-b63f8d94-0056-49a4-aad8-f8816fd8d59d tempest-VolumesActionsTest-731506124 tempest-VolumesActionsTest-731506124-project] 10.222.0.75 "GET /compute/v2.1/servers/2be10a9b-0300-40be-96eb-602b1ad4b05c" status: 200 len: 1314 microversion: 2.1 time: 0.174061 May 26 12:42:31.111106 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: [pid: 129322|app: 0|req: 228/440] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 26 12:42:30 2022] GET /compute/v2.1/servers/2be10a9b-0300-40be-96eb-602b1ad4b05c => generated 1314 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 12:42:31.635038 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi [None req-8fc3ea56-e55b-496a-bea4-61814941206a tempest-TestMinimumBasicScenario-102576986 tempest-TestMinimumBasicScenario-102576986-project] Calling method '>' {{(pid=129321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:42:31.635809 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.compute.api [None req-8fc3ea56-e55b-496a-bea4-61814941206a tempest-TestMinimumBasicScenario-102576986 tempest-TestMinimumBasicScenario-102576986-project] [instance: 76661008-e6d3-4646-a9ba-d5d0e83a4b65] Fetching instance by UUID {{(pid=129321) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:42:31.642940 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-8fc3ea56-e55b-496a-bea4-61814941206a tempest-TestMinimumBasicScenario-102576986 tempest-TestMinimumBasicScenario-102576986-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:42:31.643381 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-8fc3ea56-e55b-496a-bea4-61814941206a tempest-TestMinimumBasicScenario-102576986 tempest-TestMinimumBasicScenario-102576986-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:42:31.644172 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-8fc3ea56-e55b-496a-bea4-61814941206a tempest-TestMinimumBasicScenario-102576986 tempest-TestMinimumBasicScenario-102576986-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:42:31.644607 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-8fc3ea56-e55b-496a-bea4-61814941206a tempest-TestMinimumBasicScenario-102576986 tempest-TestMinimumBasicScenario-102576986-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:42:31.780614 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.policy [None req-8fc3ea56-e55b-496a-bea4-61814941206a tempest-TestMinimumBasicScenario-102576986 tempest-TestMinimumBasicScenario-102576986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0352a80bdc174b9a9df4eca60b81eba4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fa2c4d6423444e487d259062656129b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129321) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:42:31.788649 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: INFO nova.api.openstack.requestlog [None req-8fc3ea56-e55b-496a-bea4-61814941206a tempest-TestMinimumBasicScenario-102576986 tempest-TestMinimumBasicScenario-102576986-project] 10.222.0.75 "GET /compute/v2.1/servers/76661008-e6d3-4646-a9ba-d5d0e83a4b65" status: 200 len: 1357 microversion: 2.1 time: 0.159727 May 26 12:42:31.789244 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: [pid: 129321|app: 0|req: 213/441] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 26 12:42:31 2022] GET /compute/v2.1/servers/76661008-e6d3-4646-a9ba-d5d0e83a4b65 => generated 1357 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:42:32.015988 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi [None req-222c0c38-4a4f-478a-b380-7f7ebcd613e6 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Calling method '>' {{(pid=129322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:42:32.016686 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.compute.api [None req-222c0c38-4a4f-478a-b380-7f7ebcd613e6 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] [instance: e911acec-b583-42eb-b5de-dee9573bad6c] Fetching instance by UUID {{(pid=129322) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:42:32.018493 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG dbcounter [-] [129322] Writing DB stats nova_api:SELECT=82 {{(pid=129322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:42:32.024312 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-222c0c38-4a4f-478a-b380-7f7ebcd613e6 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:42:32.024771 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-222c0c38-4a4f-478a-b380-7f7ebcd613e6 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:42:32.025519 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-222c0c38-4a4f-478a-b380-7f7ebcd613e6 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:42:32.026763 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-222c0c38-4a4f-478a-b380-7f7ebcd613e6 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:42:32.127911 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi [None req-ded5e729-d179-4f33-a187-c0e01e783819 tempest-VolumesActionsTest-731506124 tempest-VolumesActionsTest-731506124-project] Calling method '>' {{(pid=129321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:42:32.128951 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.compute.api [None req-ded5e729-d179-4f33-a187-c0e01e783819 tempest-VolumesActionsTest-731506124 tempest-VolumesActionsTest-731506124-project] [instance: 2be10a9b-0300-40be-96eb-602b1ad4b05c] Fetching instance by UUID {{(pid=129321) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:42:32.136120 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-ded5e729-d179-4f33-a187-c0e01e783819 tempest-VolumesActionsTest-731506124 tempest-VolumesActionsTest-731506124-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:42:32.136570 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-ded5e729-d179-4f33-a187-c0e01e783819 tempest-VolumesActionsTest-731506124 tempest-VolumesActionsTest-731506124-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:42:32.137463 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-ded5e729-d179-4f33-a187-c0e01e783819 tempest-VolumesActionsTest-731506124 tempest-VolumesActionsTest-731506124-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:42:32.137890 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-ded5e729-d179-4f33-a187-c0e01e783819 tempest-VolumesActionsTest-731506124 tempest-VolumesActionsTest-731506124-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:42:32.173692 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.policy [None req-222c0c38-4a4f-478a-b380-7f7ebcd613e6 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0431b1f25497443ba483b3c440669080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e36ab03283d4ce6a2fed5e111e03d34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129322) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:42:32.182236 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: INFO nova.api.openstack.requestlog [None req-222c0c38-4a4f-478a-b380-7f7ebcd613e6 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] 10.222.0.75 "GET /compute/v2.1/servers/e911acec-b583-42eb-b5de-dee9573bad6c" status: 200 len: 1372 microversion: 2.1 time: 0.170164 May 26 12:42:32.182839 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: [pid: 129322|app: 0|req: 229/442] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 26 12:42:32 2022] GET /compute/v2.1/servers/e911acec-b583-42eb-b5de-dee9573bad6c => generated 1372 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:42:32.274414 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.policy [None req-ded5e729-d179-4f33-a187-c0e01e783819 tempest-VolumesActionsTest-731506124 tempest-VolumesActionsTest-731506124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f39e076a9e6b401db6de9a2846519591', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa93879e60e470185e8dd71efaaf1a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129321) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:42:32.282875 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: INFO nova.api.openstack.requestlog [None req-ded5e729-d179-4f33-a187-c0e01e783819 tempest-VolumesActionsTest-731506124 tempest-VolumesActionsTest-731506124-project] 10.222.0.75 "GET /compute/v2.1/servers/2be10a9b-0300-40be-96eb-602b1ad4b05c" status: 200 len: 1314 microversion: 2.1 time: 0.159192 May 26 12:42:32.283457 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: [pid: 129321|app: 0|req: 214/443] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 26 12:42:32 2022] GET /compute/v2.1/servers/2be10a9b-0300-40be-96eb-602b1ad4b05c => generated 1314 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:42:32.807903 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi [None req-2854670e-f5b4-4bd8-890b-a77a0bd0fdb9 tempest-TestMinimumBasicScenario-102576986 tempest-TestMinimumBasicScenario-102576986-project] Calling method '>' {{(pid=129322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:42:32.808542 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.compute.api [None req-2854670e-f5b4-4bd8-890b-a77a0bd0fdb9 tempest-TestMinimumBasicScenario-102576986 tempest-TestMinimumBasicScenario-102576986-project] [instance: 76661008-e6d3-4646-a9ba-d5d0e83a4b65] Fetching instance by UUID {{(pid=129322) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:42:32.815563 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-2854670e-f5b4-4bd8-890b-a77a0bd0fdb9 tempest-TestMinimumBasicScenario-102576986 tempest-TestMinimumBasicScenario-102576986-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:42:32.816033 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-2854670e-f5b4-4bd8-890b-a77a0bd0fdb9 tempest-TestMinimumBasicScenario-102576986 tempest-TestMinimumBasicScenario-102576986-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:42:32.816795 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-2854670e-f5b4-4bd8-890b-a77a0bd0fdb9 tempest-TestMinimumBasicScenario-102576986 tempest-TestMinimumBasicScenario-102576986-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:42:32.817232 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-2854670e-f5b4-4bd8-890b-a77a0bd0fdb9 tempest-TestMinimumBasicScenario-102576986 tempest-TestMinimumBasicScenario-102576986-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:42:32.860439 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi [None req-c3f587ac-3ab2-4bf1-85fb-15e9a769179c tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Calling method '>' {{(pid=129321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:42:32.861232 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.compute.api [None req-c3f587ac-3ab2-4bf1-85fb-15e9a769179c tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] [instance: bf2f6303-22b9-4cfa-8d4d-61d2503bc554] Fetching instance by UUID {{(pid=129321) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:42:32.868611 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-c3f587ac-3ab2-4bf1-85fb-15e9a769179c tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:42:32.869059 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-c3f587ac-3ab2-4bf1-85fb-15e9a769179c tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:42:32.870150 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-c3f587ac-3ab2-4bf1-85fb-15e9a769179c tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:42:32.870709 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-c3f587ac-3ab2-4bf1-85fb-15e9a769179c tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:42:32.894780 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: INFO nova.api.openstack.requestlog [None req-c3f587ac-3ab2-4bf1-85fb-15e9a769179c tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] 10.222.0.75 "GET /compute/v2.1/servers/bf2f6303-22b9-4cfa-8d4d-61d2503bc554/ips" status: 200 len: 153 microversion: 2.20 time: 0.038950 May 26 12:42:32.895521 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: [pid: 129321|app: 0|req: 215/444] 10.222.0.75 () {60 vars in 1288 bytes} [Thu May 26 12:42:32 2022] GET /compute/v2.1/servers/bf2f6303-22b9-4cfa-8d4d-61d2503bc554/ips => generated 153 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 26 12:42:32.961661 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.policy [None req-2854670e-f5b4-4bd8-890b-a77a0bd0fdb9 tempest-TestMinimumBasicScenario-102576986 tempest-TestMinimumBasicScenario-102576986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0352a80bdc174b9a9df4eca60b81eba4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fa2c4d6423444e487d259062656129b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129322) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:42:32.969757 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: INFO nova.api.openstack.requestlog [None req-2854670e-f5b4-4bd8-890b-a77a0bd0fdb9 tempest-TestMinimumBasicScenario-102576986 tempest-TestMinimumBasicScenario-102576986-project] 10.222.0.75 "GET /compute/v2.1/servers/76661008-e6d3-4646-a9ba-d5d0e83a4b65" status: 200 len: 1357 microversion: 2.1 time: 0.165841 May 26 12:42:32.970323 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: [pid: 129322|app: 0|req: 230/445] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 26 12:42:32 2022] GET /compute/v2.1/servers/76661008-e6d3-4646-a9ba-d5d0e83a4b65 => generated 1357 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:42:33.199102 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi [None req-22cf4ab3-981c-4694-918b-bd3738701fcb tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Calling method '>' {{(pid=129321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:42:33.200565 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.compute.api [None req-22cf4ab3-981c-4694-918b-bd3738701fcb tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] [instance: e911acec-b583-42eb-b5de-dee9573bad6c] Fetching instance by UUID {{(pid=129321) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:42:33.209565 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-22cf4ab3-981c-4694-918b-bd3738701fcb tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:42:33.210189 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-22cf4ab3-981c-4694-918b-bd3738701fcb tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:42:33.213471 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-22cf4ab3-981c-4694-918b-bd3738701fcb tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:42:33.213471 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-22cf4ab3-981c-4694-918b-bd3738701fcb tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:42:33.300947 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi [None req-e1215b61-7c87-4ce7-91db-5d80b5f05573 tempest-VolumesActionsTest-731506124 tempest-VolumesActionsTest-731506124-project] Calling method '>' {{(pid=129322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:42:33.301546 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.compute.api [None req-e1215b61-7c87-4ce7-91db-5d80b5f05573 tempest-VolumesActionsTest-731506124 tempest-VolumesActionsTest-731506124-project] [instance: 2be10a9b-0300-40be-96eb-602b1ad4b05c] Fetching instance by UUID {{(pid=129322) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:42:33.308633 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-e1215b61-7c87-4ce7-91db-5d80b5f05573 tempest-VolumesActionsTest-731506124 tempest-VolumesActionsTest-731506124-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:42:33.309085 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-e1215b61-7c87-4ce7-91db-5d80b5f05573 tempest-VolumesActionsTest-731506124 tempest-VolumesActionsTest-731506124-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:42:33.310027 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-e1215b61-7c87-4ce7-91db-5d80b5f05573 tempest-VolumesActionsTest-731506124 tempest-VolumesActionsTest-731506124-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:42:33.310279 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-e1215b61-7c87-4ce7-91db-5d80b5f05573 tempest-VolumesActionsTest-731506124 tempest-VolumesActionsTest-731506124-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:42:33.362082 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.policy [None req-22cf4ab3-981c-4694-918b-bd3738701fcb tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0431b1f25497443ba483b3c440669080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e36ab03283d4ce6a2fed5e111e03d34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129321) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:42:33.370752 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: INFO nova.api.openstack.requestlog [None req-22cf4ab3-981c-4694-918b-bd3738701fcb tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] 10.222.0.75 "GET /compute/v2.1/servers/e911acec-b583-42eb-b5de-dee9573bad6c" status: 200 len: 1372 microversion: 2.1 time: 0.176182 May 26 12:42:33.371366 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: [pid: 129321|app: 0|req: 216/446] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 26 12:42:33 2022] GET /compute/v2.1/servers/e911acec-b583-42eb-b5de-dee9573bad6c => generated 1372 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:42:33.452178 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.policy [None req-e1215b61-7c87-4ce7-91db-5d80b5f05573 tempest-VolumesActionsTest-731506124 tempest-VolumesActionsTest-731506124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f39e076a9e6b401db6de9a2846519591', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa93879e60e470185e8dd71efaaf1a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129322) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:42:33.463173 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: INFO nova.api.openstack.requestlog [None req-e1215b61-7c87-4ce7-91db-5d80b5f05573 tempest-VolumesActionsTest-731506124 tempest-VolumesActionsTest-731506124-project] 10.222.0.75 "GET /compute/v2.1/servers/2be10a9b-0300-40be-96eb-602b1ad4b05c" status: 200 len: 1314 microversion: 2.1 time: 0.165921 May 26 12:42:33.463816 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: [pid: 129322|app: 0|req: 231/447] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 26 12:42:33 2022] GET /compute/v2.1/servers/2be10a9b-0300-40be-96eb-602b1ad4b05c => generated 1314 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:42:33.987081 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi [None req-4cccd7e0-2b7c-48f4-b378-6487e71675d8 tempest-TestMinimumBasicScenario-102576986 tempest-TestMinimumBasicScenario-102576986-project] Calling method '>' {{(pid=129321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:42:33.987724 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.compute.api [None req-4cccd7e0-2b7c-48f4-b378-6487e71675d8 tempest-TestMinimumBasicScenario-102576986 tempest-TestMinimumBasicScenario-102576986-project] [instance: 76661008-e6d3-4646-a9ba-d5d0e83a4b65] Fetching instance by UUID {{(pid=129321) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:42:33.994239 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-4cccd7e0-2b7c-48f4-b378-6487e71675d8 tempest-TestMinimumBasicScenario-102576986 tempest-TestMinimumBasicScenario-102576986-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:42:33.994687 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-4cccd7e0-2b7c-48f4-b378-6487e71675d8 tempest-TestMinimumBasicScenario-102576986 tempest-TestMinimumBasicScenario-102576986-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:42:33.995652 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-4cccd7e0-2b7c-48f4-b378-6487e71675d8 tempest-TestMinimumBasicScenario-102576986 tempest-TestMinimumBasicScenario-102576986-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:42:33.996356 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-4cccd7e0-2b7c-48f4-b378-6487e71675d8 tempest-TestMinimumBasicScenario-102576986 tempest-TestMinimumBasicScenario-102576986-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:42:34.147144 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.policy [None req-4cccd7e0-2b7c-48f4-b378-6487e71675d8 tempest-TestMinimumBasicScenario-102576986 tempest-TestMinimumBasicScenario-102576986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0352a80bdc174b9a9df4eca60b81eba4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fa2c4d6423444e487d259062656129b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129321) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:42:34.155576 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: INFO nova.api.openstack.requestlog [None req-4cccd7e0-2b7c-48f4-b378-6487e71675d8 tempest-TestMinimumBasicScenario-102576986 tempest-TestMinimumBasicScenario-102576986-project] 10.222.0.75 "GET /compute/v2.1/servers/76661008-e6d3-4646-a9ba-d5d0e83a4b65" status: 200 len: 1357 microversion: 2.1 time: 0.172493 May 26 12:42:34.156149 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: [pid: 129321|app: 0|req: 217/448] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 26 12:42:33 2022] GET /compute/v2.1/servers/76661008-e6d3-4646-a9ba-d5d0e83a4b65 => generated 1357 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:42:34.388212 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi [None req-aaad75a9-7023-484c-a7ca-5a21f6216865 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Calling method '>' {{(pid=129322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:42:34.388887 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.compute.api [None req-aaad75a9-7023-484c-a7ca-5a21f6216865 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] [instance: e911acec-b583-42eb-b5de-dee9573bad6c] Fetching instance by UUID {{(pid=129322) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:42:34.396445 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-aaad75a9-7023-484c-a7ca-5a21f6216865 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:42:34.396918 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-aaad75a9-7023-484c-a7ca-5a21f6216865 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:42:34.397696 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-aaad75a9-7023-484c-a7ca-5a21f6216865 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:42:34.398126 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-aaad75a9-7023-484c-a7ca-5a21f6216865 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:42:34.481702 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi [None req-5985ad47-36f4-4acb-a3ee-84aa992f847b tempest-VolumesActionsTest-731506124 tempest-VolumesActionsTest-731506124-project] Calling method '>' {{(pid=129321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:42:34.482385 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.compute.api [None req-5985ad47-36f4-4acb-a3ee-84aa992f847b tempest-VolumesActionsTest-731506124 tempest-VolumesActionsTest-731506124-project] [instance: 2be10a9b-0300-40be-96eb-602b1ad4b05c] Fetching instance by UUID {{(pid=129321) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:42:34.489595 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-5985ad47-36f4-4acb-a3ee-84aa992f847b tempest-VolumesActionsTest-731506124 tempest-VolumesActionsTest-731506124-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:42:34.490146 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-5985ad47-36f4-4acb-a3ee-84aa992f847b tempest-VolumesActionsTest-731506124 tempest-VolumesActionsTest-731506124-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:42:34.490946 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-5985ad47-36f4-4acb-a3ee-84aa992f847b tempest-VolumesActionsTest-731506124 tempest-VolumesActionsTest-731506124-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:42:34.491369 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-5985ad47-36f4-4acb-a3ee-84aa992f847b tempest-VolumesActionsTest-731506124 tempest-VolumesActionsTest-731506124-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:42:34.550663 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.policy [None req-aaad75a9-7023-484c-a7ca-5a21f6216865 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0431b1f25497443ba483b3c440669080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e36ab03283d4ce6a2fed5e111e03d34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129322) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:42:34.559692 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: INFO nova.api.openstack.requestlog [None req-aaad75a9-7023-484c-a7ca-5a21f6216865 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] 10.222.0.75 "GET /compute/v2.1/servers/e911acec-b583-42eb-b5de-dee9573bad6c" status: 200 len: 1372 microversion: 2.1 time: 0.175490 May 26 12:42:34.569053 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: [pid: 129322|app: 0|req: 232/449] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 26 12:42:34 2022] GET /compute/v2.1/servers/e911acec-b583-42eb-b5de-dee9573bad6c => generated 1372 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:42:34.640295 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.policy [None req-5985ad47-36f4-4acb-a3ee-84aa992f847b tempest-VolumesActionsTest-731506124 tempest-VolumesActionsTest-731506124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f39e076a9e6b401db6de9a2846519591', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa93879e60e470185e8dd71efaaf1a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129321) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:42:34.648367 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: INFO nova.api.openstack.requestlog [None req-5985ad47-36f4-4acb-a3ee-84aa992f847b tempest-VolumesActionsTest-731506124 tempest-VolumesActionsTest-731506124-project] 10.222.0.75 "GET /compute/v2.1/servers/2be10a9b-0300-40be-96eb-602b1ad4b05c" status: 200 len: 1314 microversion: 2.1 time: 0.170693 May 26 12:42:34.649329 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: [pid: 129321|app: 0|req: 218/450] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 26 12:42:34 2022] GET /compute/v2.1/servers/2be10a9b-0300-40be-96eb-602b1ad4b05c => generated 1314 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 12:42:35.177179 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi [None req-e2f7ee63-d918-4493-a4dc-d4a6469d61d2 tempest-TestMinimumBasicScenario-102576986 tempest-TestMinimumBasicScenario-102576986-project] Calling method '>' {{(pid=129322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:42:35.177782 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.compute.api [None req-e2f7ee63-d918-4493-a4dc-d4a6469d61d2 tempest-TestMinimumBasicScenario-102576986 tempest-TestMinimumBasicScenario-102576986-project] [instance: 76661008-e6d3-4646-a9ba-d5d0e83a4b65] Fetching instance by UUID {{(pid=129322) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:42:35.184922 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-e2f7ee63-d918-4493-a4dc-d4a6469d61d2 tempest-TestMinimumBasicScenario-102576986 tempest-TestMinimumBasicScenario-102576986-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:42:35.185391 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-e2f7ee63-d918-4493-a4dc-d4a6469d61d2 tempest-TestMinimumBasicScenario-102576986 tempest-TestMinimumBasicScenario-102576986-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:42:35.186068 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-e2f7ee63-d918-4493-a4dc-d4a6469d61d2 tempest-TestMinimumBasicScenario-102576986 tempest-TestMinimumBasicScenario-102576986-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:42:35.186504 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-e2f7ee63-d918-4493-a4dc-d4a6469d61d2 tempest-TestMinimumBasicScenario-102576986 tempest-TestMinimumBasicScenario-102576986-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:42:35.329393 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.policy [None req-e2f7ee63-d918-4493-a4dc-d4a6469d61d2 tempest-TestMinimumBasicScenario-102576986 tempest-TestMinimumBasicScenario-102576986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0352a80bdc174b9a9df4eca60b81eba4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fa2c4d6423444e487d259062656129b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129322) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:42:35.337362 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: INFO nova.api.openstack.requestlog [None req-e2f7ee63-d918-4493-a4dc-d4a6469d61d2 tempest-TestMinimumBasicScenario-102576986 tempest-TestMinimumBasicScenario-102576986-project] 10.222.0.75 "GET /compute/v2.1/servers/76661008-e6d3-4646-a9ba-d5d0e83a4b65" status: 200 len: 1357 microversion: 2.1 time: 0.164398 May 26 12:42:35.337979 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: [pid: 129322|app: 0|req: 233/451] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 26 12:42:35 2022] GET /compute/v2.1/servers/76661008-e6d3-4646-a9ba-d5d0e83a4b65 => generated 1357 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:42:35.576367 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi [None req-916f1217-8e4e-4ece-9425-c0bda20ffbd1 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Calling method '>' {{(pid=129321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:42:35.577130 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.compute.api [None req-916f1217-8e4e-4ece-9425-c0bda20ffbd1 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] [instance: e911acec-b583-42eb-b5de-dee9573bad6c] Fetching instance by UUID {{(pid=129321) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:42:35.583652 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-916f1217-8e4e-4ece-9425-c0bda20ffbd1 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:42:35.584064 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-916f1217-8e4e-4ece-9425-c0bda20ffbd1 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:42:35.584820 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-916f1217-8e4e-4ece-9425-c0bda20ffbd1 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:42:35.585247 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-916f1217-8e4e-4ece-9425-c0bda20ffbd1 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:42:35.673189 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi [None req-f7d9f9f4-49d2-4a1b-a7e2-2c7804449d0f tempest-VolumesActionsTest-731506124 tempest-VolumesActionsTest-731506124-project] Calling method '>' {{(pid=129322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:42:35.674203 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.compute.api [None req-f7d9f9f4-49d2-4a1b-a7e2-2c7804449d0f tempest-VolumesActionsTest-731506124 tempest-VolumesActionsTest-731506124-project] [instance: 2be10a9b-0300-40be-96eb-602b1ad4b05c] Fetching instance by UUID {{(pid=129322) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:42:35.682433 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-f7d9f9f4-49d2-4a1b-a7e2-2c7804449d0f tempest-VolumesActionsTest-731506124 tempest-VolumesActionsTest-731506124-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:42:35.682880 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-f7d9f9f4-49d2-4a1b-a7e2-2c7804449d0f tempest-VolumesActionsTest-731506124 tempest-VolumesActionsTest-731506124-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:42:35.683673 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-f7d9f9f4-49d2-4a1b-a7e2-2c7804449d0f tempest-VolumesActionsTest-731506124 tempest-VolumesActionsTest-731506124-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:42:35.684365 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-f7d9f9f4-49d2-4a1b-a7e2-2c7804449d0f tempest-VolumesActionsTest-731506124 tempest-VolumesActionsTest-731506124-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:42:35.729157 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.policy [None req-916f1217-8e4e-4ece-9425-c0bda20ffbd1 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0431b1f25497443ba483b3c440669080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e36ab03283d4ce6a2fed5e111e03d34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129321) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:42:35.737202 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: INFO nova.api.openstack.requestlog [None req-916f1217-8e4e-4ece-9425-c0bda20ffbd1 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] 10.222.0.75 "GET /compute/v2.1/servers/e911acec-b583-42eb-b5de-dee9573bad6c" status: 200 len: 1372 microversion: 2.1 time: 0.164964 May 26 12:42:35.737789 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: [pid: 129321|app: 0|req: 219/452] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 26 12:42:35 2022] GET /compute/v2.1/servers/e911acec-b583-42eb-b5de-dee9573bad6c => generated 1372 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:42:35.819645 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.policy [None req-f7d9f9f4-49d2-4a1b-a7e2-2c7804449d0f tempest-VolumesActionsTest-731506124 tempest-VolumesActionsTest-731506124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f39e076a9e6b401db6de9a2846519591', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa93879e60e470185e8dd71efaaf1a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129322) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:42:35.827724 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: INFO nova.api.openstack.requestlog [None req-f7d9f9f4-49d2-4a1b-a7e2-2c7804449d0f tempest-VolumesActionsTest-731506124 tempest-VolumesActionsTest-731506124-project] 10.222.0.75 "GET /compute/v2.1/servers/2be10a9b-0300-40be-96eb-602b1ad4b05c" status: 200 len: 1314 microversion: 2.1 time: 0.159190 May 26 12:42:35.828294 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: [pid: 129322|app: 0|req: 234/453] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 26 12:42:35 2022] GET /compute/v2.1/servers/2be10a9b-0300-40be-96eb-602b1ad4b05c => generated 1314 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:42:35.902881 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi [None req-a0528b24-0449-4d18-93e0-c29d8fcf52d4 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=129321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 12:42:35.903778 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.compute.api [None req-a0528b24-0449-4d18-93e0-c29d8fcf52d4 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] [instance: bf2f6303-22b9-4cfa-8d4d-61d2503bc554] Fetching instance by UUID {{(pid=129321) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:42:35.912603 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-a0528b24-0449-4d18-93e0-c29d8fcf52d4 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:42:35.913183 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-a0528b24-0449-4d18-93e0-c29d8fcf52d4 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:42:35.914031 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-a0528b24-0449-4d18-93e0-c29d8fcf52d4 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:42:35.914461 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-a0528b24-0449-4d18-93e0-c29d8fcf52d4 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:42:35.937658 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.objects.instance [None req-a0528b24-0449-4d18-93e0-c29d8fcf52d4 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lazy-loading 'flavor' on Instance uuid bf2f6303-22b9-4cfa-8d4d-61d2503bc554 {{(pid=129321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 26 12:42:36.234207 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: INFO nova.api.openstack.requestlog [None req-a0528b24-0449-4d18-93e0-c29d8fcf52d4 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] 10.222.0.75 "POST /compute/v2.1/servers/bf2f6303-22b9-4cfa-8d4d-61d2503bc554/action" status: 202 len: 0 microversion: 2.20 time: 0.334986 May 26 12:42:36.235800 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: [pid: 129321|app: 0|req: 220/454] 10.222.0.75 () {62 vars in 1318 bytes} [Thu May 26 12:42:35 2022] POST /compute/v2.1/servers/bf2f6303-22b9-4cfa-8d4d-61d2503bc554/action => generated 0 bytes in 338 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) May 26 12:42:36.244086 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi [None req-452340e3-7f5f-4a9b-ade0-74841203b1ae tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Calling method '>' {{(pid=129322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:42:36.244703 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.compute.api [None req-452340e3-7f5f-4a9b-ade0-74841203b1ae tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] [instance: bf2f6303-22b9-4cfa-8d4d-61d2503bc554] Fetching instance by UUID {{(pid=129322) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:42:36.251196 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-452340e3-7f5f-4a9b-ade0-74841203b1ae tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:42:36.251675 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-452340e3-7f5f-4a9b-ade0-74841203b1ae tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:42:36.252429 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-452340e3-7f5f-4a9b-ade0-74841203b1ae tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:42:36.252856 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-452340e3-7f5f-4a9b-ade0-74841203b1ae tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:42:36.355100 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi [None req-9e3feec8-c619-48c8-989f-56e223462393 tempest-TestMinimumBasicScenario-102576986 tempest-TestMinimumBasicScenario-102576986-project] Calling method '>' {{(pid=129321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:42:36.355830 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.compute.api [None req-9e3feec8-c619-48c8-989f-56e223462393 tempest-TestMinimumBasicScenario-102576986 tempest-TestMinimumBasicScenario-102576986-project] [instance: 76661008-e6d3-4646-a9ba-d5d0e83a4b65] Fetching instance by UUID {{(pid=129321) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:42:36.363120 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-9e3feec8-c619-48c8-989f-56e223462393 tempest-TestMinimumBasicScenario-102576986 tempest-TestMinimumBasicScenario-102576986-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:42:36.363565 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-9e3feec8-c619-48c8-989f-56e223462393 tempest-TestMinimumBasicScenario-102576986 tempest-TestMinimumBasicScenario-102576986-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:42:36.364365 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-9e3feec8-c619-48c8-989f-56e223462393 tempest-TestMinimumBasicScenario-102576986 tempest-TestMinimumBasicScenario-102576986-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:42:36.364801 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-9e3feec8-c619-48c8-989f-56e223462393 tempest-TestMinimumBasicScenario-102576986 tempest-TestMinimumBasicScenario-102576986-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:42:36.392428 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.policy [None req-452340e3-7f5f-4a9b-ade0-74841203b1ae tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e811736979c44b02b14fecb74c6bd7ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675272fb40d4847819f83ec04afecef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129322) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:42:36.401450 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.policy [None req-452340e3-7f5f-4a9b-ade0-74841203b1ae tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e811736979c44b02b14fecb74c6bd7ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675272fb40d4847819f83ec04afecef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129322) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:42:36.403049 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.policy [None req-452340e3-7f5f-4a9b-ade0-74841203b1ae tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e811736979c44b02b14fecb74c6bd7ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675272fb40d4847819f83ec04afecef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129322) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:42:36.404493 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: INFO nova.api.openstack.requestlog [None req-452340e3-7f5f-4a9b-ade0-74841203b1ae tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] 10.222.0.75 "GET /compute/v2.1/servers/bf2f6303-22b9-4cfa-8d4d-61d2503bc554" status: 200 len: 1725 microversion: 2.20 time: 0.164432 May 26 12:42:36.405051 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: [pid: 129322|app: 0|req: 235/455] 10.222.0.75 () {60 vars in 1276 bytes} [Thu May 26 12:42:36 2022] GET /compute/v2.1/servers/bf2f6303-22b9-4cfa-8d4d-61d2503bc554 => generated 1725 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 12:42:36.501953 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.policy [None req-9e3feec8-c619-48c8-989f-56e223462393 tempest-TestMinimumBasicScenario-102576986 tempest-TestMinimumBasicScenario-102576986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0352a80bdc174b9a9df4eca60b81eba4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fa2c4d6423444e487d259062656129b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129321) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:42:36.510033 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: INFO nova.api.openstack.requestlog [None req-9e3feec8-c619-48c8-989f-56e223462393 tempest-TestMinimumBasicScenario-102576986 tempest-TestMinimumBasicScenario-102576986-project] 10.222.0.75 "GET /compute/v2.1/servers/76661008-e6d3-4646-a9ba-d5d0e83a4b65" status: 200 len: 1357 microversion: 2.1 time: 0.159334 May 26 12:42:36.510604 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: [pid: 129321|app: 0|req: 221/456] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 26 12:42:36 2022] GET /compute/v2.1/servers/76661008-e6d3-4646-a9ba-d5d0e83a4b65 => generated 1357 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:42:36.756216 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi [None req-95eb2d2e-f197-4f7f-9ad6-29252d2523bd tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Calling method '>' {{(pid=129322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:42:36.756808 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.compute.api [None req-95eb2d2e-f197-4f7f-9ad6-29252d2523bd tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] [instance: e911acec-b583-42eb-b5de-dee9573bad6c] Fetching instance by UUID {{(pid=129322) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:42:36.764216 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-95eb2d2e-f197-4f7f-9ad6-29252d2523bd tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:42:36.764666 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-95eb2d2e-f197-4f7f-9ad6-29252d2523bd tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:42:36.765454 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-95eb2d2e-f197-4f7f-9ad6-29252d2523bd tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:42:36.765886 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-95eb2d2e-f197-4f7f-9ad6-29252d2523bd tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:42:36.846119 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi [None req-4d38138b-8fda-4b0e-b57d-868f3fee2c95 tempest-VolumesActionsTest-731506124 tempest-VolumesActionsTest-731506124-project] Calling method '>' {{(pid=129321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:42:36.846561 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.compute.api [None req-4d38138b-8fda-4b0e-b57d-868f3fee2c95 tempest-VolumesActionsTest-731506124 tempest-VolumesActionsTest-731506124-project] [instance: 2be10a9b-0300-40be-96eb-602b1ad4b05c] Fetching instance by UUID {{(pid=129321) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:42:36.852801 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-4d38138b-8fda-4b0e-b57d-868f3fee2c95 tempest-VolumesActionsTest-731506124 tempest-VolumesActionsTest-731506124-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:42:36.853219 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-4d38138b-8fda-4b0e-b57d-868f3fee2c95 tempest-VolumesActionsTest-731506124 tempest-VolumesActionsTest-731506124-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:42:36.853974 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-4d38138b-8fda-4b0e-b57d-868f3fee2c95 tempest-VolumesActionsTest-731506124 tempest-VolumesActionsTest-731506124-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:42:36.854401 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-4d38138b-8fda-4b0e-b57d-868f3fee2c95 tempest-VolumesActionsTest-731506124 tempest-VolumesActionsTest-731506124-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:42:36.915987 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.policy [None req-95eb2d2e-f197-4f7f-9ad6-29252d2523bd tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0431b1f25497443ba483b3c440669080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e36ab03283d4ce6a2fed5e111e03d34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129322) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:42:36.924084 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: INFO nova.api.openstack.requestlog [None req-95eb2d2e-f197-4f7f-9ad6-29252d2523bd tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] 10.222.0.75 "GET /compute/v2.1/servers/e911acec-b583-42eb-b5de-dee9573bad6c" status: 200 len: 1372 microversion: 2.1 time: 0.171682 May 26 12:42:36.924710 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: [pid: 129322|app: 0|req: 236/457] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 26 12:42:36 2022] GET /compute/v2.1/servers/e911acec-b583-42eb-b5de-dee9573bad6c => generated 1372 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:42:36.990495 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.policy [None req-4d38138b-8fda-4b0e-b57d-868f3fee2c95 tempest-VolumesActionsTest-731506124 tempest-VolumesActionsTest-731506124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f39e076a9e6b401db6de9a2846519591', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa93879e60e470185e8dd71efaaf1a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129321) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:42:36.998771 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: INFO nova.api.openstack.requestlog [None req-4d38138b-8fda-4b0e-b57d-868f3fee2c95 tempest-VolumesActionsTest-731506124 tempest-VolumesActionsTest-731506124-project] 10.222.0.75 "GET /compute/v2.1/servers/2be10a9b-0300-40be-96eb-602b1ad4b05c" status: 200 len: 1314 microversion: 2.1 time: 0.156718 May 26 12:42:36.999740 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: [pid: 129321|app: 0|req: 222/458] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 26 12:42:36 2022] GET /compute/v2.1/servers/2be10a9b-0300-40be-96eb-602b1ad4b05c => generated 1314 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 12:42:37.424705 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi [None req-c9342098-c7c3-4908-8e15-2c23b2d927a9 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Calling method '>' {{(pid=129322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:42:37.425328 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.compute.api [None req-c9342098-c7c3-4908-8e15-2c23b2d927a9 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] [instance: bf2f6303-22b9-4cfa-8d4d-61d2503bc554] Fetching instance by UUID {{(pid=129322) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:42:37.431754 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-c9342098-c7c3-4908-8e15-2c23b2d927a9 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:42:37.432205 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-c9342098-c7c3-4908-8e15-2c23b2d927a9 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:42:37.432969 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-c9342098-c7c3-4908-8e15-2c23b2d927a9 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:42:37.433397 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-c9342098-c7c3-4908-8e15-2c23b2d927a9 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:42:37.529660 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi [None req-0de0d631-fa7b-44d9-8549-dde49fd1b2f1 tempest-TestMinimumBasicScenario-102576986 tempest-TestMinimumBasicScenario-102576986-project] Calling method '>' {{(pid=129321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:42:37.530276 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.compute.api [None req-0de0d631-fa7b-44d9-8549-dde49fd1b2f1 tempest-TestMinimumBasicScenario-102576986 tempest-TestMinimumBasicScenario-102576986-project] [instance: 76661008-e6d3-4646-a9ba-d5d0e83a4b65] Fetching instance by UUID {{(pid=129321) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:42:37.536830 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-0de0d631-fa7b-44d9-8549-dde49fd1b2f1 tempest-TestMinimumBasicScenario-102576986 tempest-TestMinimumBasicScenario-102576986-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:42:37.537278 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-0de0d631-fa7b-44d9-8549-dde49fd1b2f1 tempest-TestMinimumBasicScenario-102576986 tempest-TestMinimumBasicScenario-102576986-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:42:37.538048 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-0de0d631-fa7b-44d9-8549-dde49fd1b2f1 tempest-TestMinimumBasicScenario-102576986 tempest-TestMinimumBasicScenario-102576986-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:42:37.538492 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-0de0d631-fa7b-44d9-8549-dde49fd1b2f1 tempest-TestMinimumBasicScenario-102576986 tempest-TestMinimumBasicScenario-102576986-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:42:37.579754 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.policy [None req-c9342098-c7c3-4908-8e15-2c23b2d927a9 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e811736979c44b02b14fecb74c6bd7ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675272fb40d4847819f83ec04afecef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129322) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:42:37.588592 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.policy [None req-c9342098-c7c3-4908-8e15-2c23b2d927a9 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e811736979c44b02b14fecb74c6bd7ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675272fb40d4847819f83ec04afecef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129322) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:42:37.590509 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.policy [None req-c9342098-c7c3-4908-8e15-2c23b2d927a9 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e811736979c44b02b14fecb74c6bd7ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675272fb40d4847819f83ec04afecef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129322) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:42:37.592518 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: INFO nova.api.openstack.requestlog [None req-c9342098-c7c3-4908-8e15-2c23b2d927a9 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] 10.222.0.75 "GET /compute/v2.1/servers/bf2f6303-22b9-4cfa-8d4d-61d2503bc554" status: 200 len: 1725 microversion: 2.20 time: 0.172179 May 26 12:42:37.593783 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: [pid: 129322|app: 0|req: 237/459] 10.222.0.75 () {60 vars in 1276 bytes} [Thu May 26 12:42:37 2022] GET /compute/v2.1/servers/bf2f6303-22b9-4cfa-8d4d-61d2503bc554 => generated 1725 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 12:42:37.673905 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.policy [None req-0de0d631-fa7b-44d9-8549-dde49fd1b2f1 tempest-TestMinimumBasicScenario-102576986 tempest-TestMinimumBasicScenario-102576986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0352a80bdc174b9a9df4eca60b81eba4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fa2c4d6423444e487d259062656129b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129321) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:42:37.682048 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: INFO nova.api.openstack.requestlog [None req-0de0d631-fa7b-44d9-8549-dde49fd1b2f1 tempest-TestMinimumBasicScenario-102576986 tempest-TestMinimumBasicScenario-102576986-project] 10.222.0.75 "GET /compute/v2.1/servers/76661008-e6d3-4646-a9ba-d5d0e83a4b65" status: 200 len: 1357 microversion: 2.1 time: 0.156859 May 26 12:42:37.682573 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: [pid: 129321|app: 0|req: 223/460] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 26 12:42:37 2022] GET /compute/v2.1/servers/76661008-e6d3-4646-a9ba-d5d0e83a4b65 => generated 1357 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:42:37.942372 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi [None req-064f031f-e509-431e-8b1a-84d128413940 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Calling method '>' {{(pid=129322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:42:37.942961 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.compute.api [None req-064f031f-e509-431e-8b1a-84d128413940 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] [instance: e911acec-b583-42eb-b5de-dee9573bad6c] Fetching instance by UUID {{(pid=129322) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:42:37.950372 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-064f031f-e509-431e-8b1a-84d128413940 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:42:37.950824 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-064f031f-e509-431e-8b1a-84d128413940 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:42:37.951589 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-064f031f-e509-431e-8b1a-84d128413940 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:42:37.952047 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-064f031f-e509-431e-8b1a-84d128413940 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:42:38.021967 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi [None req-c3b1af9e-f6bf-4191-90a5-03d9debf14d4 tempest-VolumesActionsTest-731506124 tempest-VolumesActionsTest-731506124-project] Calling method '>' {{(pid=129321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:42:38.023392 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.compute.api [None req-c3b1af9e-f6bf-4191-90a5-03d9debf14d4 tempest-VolumesActionsTest-731506124 tempest-VolumesActionsTest-731506124-project] [instance: 2be10a9b-0300-40be-96eb-602b1ad4b05c] Fetching instance by UUID {{(pid=129321) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:42:38.031009 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-c3b1af9e-f6bf-4191-90a5-03d9debf14d4 tempest-VolumesActionsTest-731506124 tempest-VolumesActionsTest-731506124-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:42:38.031419 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-c3b1af9e-f6bf-4191-90a5-03d9debf14d4 tempest-VolumesActionsTest-731506124 tempest-VolumesActionsTest-731506124-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:42:38.032450 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-c3b1af9e-f6bf-4191-90a5-03d9debf14d4 tempest-VolumesActionsTest-731506124 tempest-VolumesActionsTest-731506124-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:42:38.032903 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-c3b1af9e-f6bf-4191-90a5-03d9debf14d4 tempest-VolumesActionsTest-731506124 tempest-VolumesActionsTest-731506124-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:42:38.093723 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.policy [None req-064f031f-e509-431e-8b1a-84d128413940 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0431b1f25497443ba483b3c440669080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e36ab03283d4ce6a2fed5e111e03d34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129322) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:42:38.101715 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: INFO nova.api.openstack.requestlog [None req-064f031f-e509-431e-8b1a-84d128413940 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] 10.222.0.75 "GET /compute/v2.1/servers/e911acec-b583-42eb-b5de-dee9573bad6c" status: 200 len: 1372 microversion: 2.1 time: 0.163902 May 26 12:42:38.102288 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: [pid: 129322|app: 0|req: 238/461] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 26 12:42:37 2022] GET /compute/v2.1/servers/e911acec-b583-42eb-b5de-dee9573bad6c => generated 1372 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:42:38.172487 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.policy [None req-c3b1af9e-f6bf-4191-90a5-03d9debf14d4 tempest-VolumesActionsTest-731506124 tempest-VolumesActionsTest-731506124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f39e076a9e6b401db6de9a2846519591', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa93879e60e470185e8dd71efaaf1a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129321) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:42:38.180578 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: INFO nova.api.openstack.requestlog [None req-c3b1af9e-f6bf-4191-90a5-03d9debf14d4 tempest-VolumesActionsTest-731506124 tempest-VolumesActionsTest-731506124-project] 10.222.0.75 "GET /compute/v2.1/servers/2be10a9b-0300-40be-96eb-602b1ad4b05c" status: 200 len: 1314 microversion: 2.1 time: 0.162975 May 26 12:42:38.181170 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: [pid: 129321|app: 0|req: 224/462] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 26 12:42:38 2022] GET /compute/v2.1/servers/2be10a9b-0300-40be-96eb-602b1ad4b05c => generated 1314 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 12:42:38.612612 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi [None req-5b0b48f2-caae-461a-b276-79095f3f6791 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Calling method '>' {{(pid=129322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:42:38.613379 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.compute.api [None req-5b0b48f2-caae-461a-b276-79095f3f6791 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] [instance: bf2f6303-22b9-4cfa-8d4d-61d2503bc554] Fetching instance by UUID {{(pid=129322) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:42:38.623786 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-5b0b48f2-caae-461a-b276-79095f3f6791 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:42:38.623786 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-5b0b48f2-caae-461a-b276-79095f3f6791 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:42:38.623786 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-5b0b48f2-caae-461a-b276-79095f3f6791 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:42:38.623786 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-5b0b48f2-caae-461a-b276-79095f3f6791 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:42:38.698803 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi [None req-3ac233e3-eac8-424e-a68e-567584363af4 tempest-TestMinimumBasicScenario-102576986 tempest-TestMinimumBasicScenario-102576986-project] Calling method '>' {{(pid=129321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:42:38.699425 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.compute.api [None req-3ac233e3-eac8-424e-a68e-567584363af4 tempest-TestMinimumBasicScenario-102576986 tempest-TestMinimumBasicScenario-102576986-project] [instance: 76661008-e6d3-4646-a9ba-d5d0e83a4b65] Fetching instance by UUID {{(pid=129321) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:42:38.706599 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-3ac233e3-eac8-424e-a68e-567584363af4 tempest-TestMinimumBasicScenario-102576986 tempest-TestMinimumBasicScenario-102576986-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:42:38.707047 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-3ac233e3-eac8-424e-a68e-567584363af4 tempest-TestMinimumBasicScenario-102576986 tempest-TestMinimumBasicScenario-102576986-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:42:38.707873 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-3ac233e3-eac8-424e-a68e-567584363af4 tempest-TestMinimumBasicScenario-102576986 tempest-TestMinimumBasicScenario-102576986-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:42:38.708302 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-3ac233e3-eac8-424e-a68e-567584363af4 tempest-TestMinimumBasicScenario-102576986 tempest-TestMinimumBasicScenario-102576986-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:42:38.790644 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.policy [None req-5b0b48f2-caae-461a-b276-79095f3f6791 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e811736979c44b02b14fecb74c6bd7ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675272fb40d4847819f83ec04afecef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129322) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:42:38.799991 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.policy [None req-5b0b48f2-caae-461a-b276-79095f3f6791 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e811736979c44b02b14fecb74c6bd7ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675272fb40d4847819f83ec04afecef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129322) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:42:38.802610 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.policy [None req-5b0b48f2-caae-461a-b276-79095f3f6791 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e811736979c44b02b14fecb74c6bd7ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675272fb40d4847819f83ec04afecef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129322) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:42:38.804682 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: INFO nova.api.openstack.requestlog [None req-5b0b48f2-caae-461a-b276-79095f3f6791 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] 10.222.0.75 "GET /compute/v2.1/servers/bf2f6303-22b9-4cfa-8d4d-61d2503bc554" status: 200 len: 1725 microversion: 2.20 time: 0.196499 May 26 12:42:38.806078 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: [pid: 129322|app: 0|req: 239/463] 10.222.0.75 () {60 vars in 1276 bytes} [Thu May 26 12:42:38 2022] GET /compute/v2.1/servers/bf2f6303-22b9-4cfa-8d4d-61d2503bc554 => generated 1725 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 12:42:38.883435 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.policy [None req-3ac233e3-eac8-424e-a68e-567584363af4 tempest-TestMinimumBasicScenario-102576986 tempest-TestMinimumBasicScenario-102576986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0352a80bdc174b9a9df4eca60b81eba4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fa2c4d6423444e487d259062656129b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129321) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:42:38.893890 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: INFO nova.api.openstack.requestlog [None req-3ac233e3-eac8-424e-a68e-567584363af4 tempest-TestMinimumBasicScenario-102576986 tempest-TestMinimumBasicScenario-102576986-project] 10.222.0.75 "GET /compute/v2.1/servers/76661008-e6d3-4646-a9ba-d5d0e83a4b65" status: 200 len: 1357 microversion: 2.1 time: 0.198813 May 26 12:42:38.894757 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: [pid: 129321|app: 0|req: 225/464] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 26 12:42:38 2022] GET /compute/v2.1/servers/76661008-e6d3-4646-a9ba-d5d0e83a4b65 => generated 1357 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 12:42:39.118951 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi [None req-6e49120c-fc22-495d-be3e-d3d320519651 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Calling method '>' {{(pid=129322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:42:39.119571 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.compute.api [None req-6e49120c-fc22-495d-be3e-d3d320519651 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] [instance: e911acec-b583-42eb-b5de-dee9573bad6c] Fetching instance by UUID {{(pid=129322) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:42:39.126432 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-6e49120c-fc22-495d-be3e-d3d320519651 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:42:39.126894 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-6e49120c-fc22-495d-be3e-d3d320519651 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:42:39.127693 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-6e49120c-fc22-495d-be3e-d3d320519651 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:42:39.128126 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-6e49120c-fc22-495d-be3e-d3d320519651 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:42:39.198561 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi [None req-3070045f-2b13-4c79-94f3-fc525eddc778 tempest-VolumesActionsTest-731506124 tempest-VolumesActionsTest-731506124-project] Calling method '>' {{(pid=129321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:42:39.199127 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.compute.api [None req-3070045f-2b13-4c79-94f3-fc525eddc778 tempest-VolumesActionsTest-731506124 tempest-VolumesActionsTest-731506124-project] [instance: 2be10a9b-0300-40be-96eb-602b1ad4b05c] Fetching instance by UUID {{(pid=129321) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:42:39.205832 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-3070045f-2b13-4c79-94f3-fc525eddc778 tempest-VolumesActionsTest-731506124 tempest-VolumesActionsTest-731506124-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:42:39.206276 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-3070045f-2b13-4c79-94f3-fc525eddc778 tempest-VolumesActionsTest-731506124 tempest-VolumesActionsTest-731506124-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:42:39.207048 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-3070045f-2b13-4c79-94f3-fc525eddc778 tempest-VolumesActionsTest-731506124 tempest-VolumesActionsTest-731506124-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:42:39.207479 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-3070045f-2b13-4c79-94f3-fc525eddc778 tempest-VolumesActionsTest-731506124 tempest-VolumesActionsTest-731506124-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:42:39.271962 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.policy [None req-6e49120c-fc22-495d-be3e-d3d320519651 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0431b1f25497443ba483b3c440669080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e36ab03283d4ce6a2fed5e111e03d34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129322) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:42:39.279987 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: INFO nova.api.openstack.requestlog [None req-6e49120c-fc22-495d-be3e-d3d320519651 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] 10.222.0.75 "GET /compute/v2.1/servers/e911acec-b583-42eb-b5de-dee9573bad6c" status: 200 len: 1372 microversion: 2.1 time: 0.165199 May 26 12:42:39.280792 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: [pid: 129322|app: 0|req: 240/465] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 26 12:42:39 2022] GET /compute/v2.1/servers/e911acec-b583-42eb-b5de-dee9573bad6c => generated 1372 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:42:39.345634 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.policy [None req-3070045f-2b13-4c79-94f3-fc525eddc778 tempest-VolumesActionsTest-731506124 tempest-VolumesActionsTest-731506124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f39e076a9e6b401db6de9a2846519591', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa93879e60e470185e8dd71efaaf1a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129321) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:42:39.353422 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: INFO nova.api.openstack.requestlog [None req-3070045f-2b13-4c79-94f3-fc525eddc778 tempest-VolumesActionsTest-731506124 tempest-VolumesActionsTest-731506124-project] 10.222.0.75 "GET /compute/v2.1/servers/2be10a9b-0300-40be-96eb-602b1ad4b05c" status: 200 len: 1314 microversion: 2.1 time: 0.159436 May 26 12:42:39.353996 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: [pid: 129321|app: 0|req: 226/466] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 26 12:42:39 2022] GET /compute/v2.1/servers/2be10a9b-0300-40be-96eb-602b1ad4b05c => generated 1314 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 12:42:39.827509 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi [None req-b514b56b-248c-4d80-afde-f65cbf84ef4d tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Calling method '>' {{(pid=129322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:42:39.828144 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.compute.api [None req-b514b56b-248c-4d80-afde-f65cbf84ef4d tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] [instance: bf2f6303-22b9-4cfa-8d4d-61d2503bc554] Fetching instance by UUID {{(pid=129322) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:42:39.837708 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-b514b56b-248c-4d80-afde-f65cbf84ef4d tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:42:39.838165 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-b514b56b-248c-4d80-afde-f65cbf84ef4d tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:42:39.839342 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-b514b56b-248c-4d80-afde-f65cbf84ef4d tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:42:39.839704 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-b514b56b-248c-4d80-afde-f65cbf84ef4d tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:42:39.906874 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi [None req-5086a420-2fe3-404b-90ad-b9743d3e20f4 tempest-TestShelveInstance-546397589 tempest-TestShelveInstance-546397589-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-1939871166", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-59050459", "security_groups": [{"name": "tempest-secgroup-smoke-1601854803"}], "networks": [{"uuid": "7f93c6f6-e16a-40fa-be29-e37579f1d7f9"}], "block_device_mapping_v2": [{"uuid": "7a321a71-c7ea-4320-a379-61bc22616ad5", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=129321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 12:42:40.013766 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.policy [None req-b514b56b-248c-4d80-afde-f65cbf84ef4d tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e811736979c44b02b14fecb74c6bd7ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675272fb40d4847819f83ec04afecef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129322) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:42:40.016425 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG dbcounter [-] [129322] Writing DB stats nova_cell1:SELECT=100 {{(pid=129322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:42:40.024643 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.policy [None req-b514b56b-248c-4d80-afde-f65cbf84ef4d tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e811736979c44b02b14fecb74c6bd7ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675272fb40d4847819f83ec04afecef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129322) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:42:40.026324 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.policy [None req-b514b56b-248c-4d80-afde-f65cbf84ef4d tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e811736979c44b02b14fecb74c6bd7ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675272fb40d4847819f83ec04afecef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129322) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:42:40.027614 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: INFO nova.api.openstack.requestlog [None req-b514b56b-248c-4d80-afde-f65cbf84ef4d tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] 10.222.0.75 "GET /compute/v2.1/servers/bf2f6303-22b9-4cfa-8d4d-61d2503bc554" status: 200 len: 1725 microversion: 2.20 time: 0.205596 May 26 12:42:40.030310 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: [pid: 129322|app: 0|req: 241/467] 10.222.0.75 () {60 vars in 1276 bytes} [Thu May 26 12:42:39 2022] GET /compute/v2.1/servers/bf2f6303-22b9-4cfa-8d4d-61d2503bc554 => generated 1725 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 12:42:40.034153 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi [None req-6a413321-f1cd-401a-8b53-f1a12a944351 tempest-TestMinimumBasicScenario-102576986 tempest-TestMinimumBasicScenario-102576986-project] Calling method '>' {{(pid=129322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:42:40.034858 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.compute.api [None req-6a413321-f1cd-401a-8b53-f1a12a944351 tempest-TestMinimumBasicScenario-102576986 tempest-TestMinimumBasicScenario-102576986-project] [instance: 76661008-e6d3-4646-a9ba-d5d0e83a4b65] Fetching instance by UUID {{(pid=129322) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:42:40.042557 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-6a413321-f1cd-401a-8b53-f1a12a944351 tempest-TestMinimumBasicScenario-102576986 tempest-TestMinimumBasicScenario-102576986-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:42:40.043007 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-6a413321-f1cd-401a-8b53-f1a12a944351 tempest-TestMinimumBasicScenario-102576986 tempest-TestMinimumBasicScenario-102576986-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:42:40.043815 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-6a413321-f1cd-401a-8b53-f1a12a944351 tempest-TestMinimumBasicScenario-102576986 tempest-TestMinimumBasicScenario-102576986-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:42:40.044244 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-6a413321-f1cd-401a-8b53-f1a12a944351 tempest-TestMinimumBasicScenario-102576986 tempest-TestMinimumBasicScenario-102576986-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:42:40.080314 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.network.neutron [None req-5086a420-2fe3-404b-90ad-b9743d3e20f4 tempest-TestShelveInstance-546397589 tempest-TestShelveInstance-546397589-project] validate_networks() for [('7f93c6f6-e16a-40fa-be29-e37579f1d7f9', None, None, None, None, None)] {{(pid=129321) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 26 12:42:40.204997 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.policy [None req-6a413321-f1cd-401a-8b53-f1a12a944351 tempest-TestMinimumBasicScenario-102576986 tempest-TestMinimumBasicScenario-102576986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0352a80bdc174b9a9df4eca60b81eba4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fa2c4d6423444e487d259062656129b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129322) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:42:40.213051 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: INFO nova.api.openstack.requestlog [None req-6a413321-f1cd-401a-8b53-f1a12a944351 tempest-TestMinimumBasicScenario-102576986 tempest-TestMinimumBasicScenario-102576986-project] 10.222.0.75 "GET /compute/v2.1/servers/76661008-e6d3-4646-a9ba-d5d0e83a4b65" status: 200 len: 1357 microversion: 2.1 time: 0.183058 May 26 12:42:40.213633 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: [pid: 129322|app: 0|req: 242/468] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 26 12:42:40 2022] GET /compute/v2.1/servers/76661008-e6d3-4646-a9ba-d5d0e83a4b65 => generated 1357 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:42:40.298339 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi [None req-d6c0a9a6-e54e-4146-9a14-a1e57ebc0148 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Calling method '>' {{(pid=129322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:42:40.298932 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.compute.api [None req-d6c0a9a6-e54e-4146-9a14-a1e57ebc0148 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] [instance: e911acec-b583-42eb-b5de-dee9573bad6c] Fetching instance by UUID {{(pid=129322) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:42:40.305876 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-d6c0a9a6-e54e-4146-9a14-a1e57ebc0148 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:42:40.306428 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-d6c0a9a6-e54e-4146-9a14-a1e57ebc0148 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:42:40.307509 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-d6c0a9a6-e54e-4146-9a14-a1e57ebc0148 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:42:40.308036 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-d6c0a9a6-e54e-4146-9a14-a1e57ebc0148 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:42:40.468254 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.policy [None req-d6c0a9a6-e54e-4146-9a14-a1e57ebc0148 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0431b1f25497443ba483b3c440669080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e36ab03283d4ce6a2fed5e111e03d34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129322) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:42:40.476586 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: INFO nova.api.openstack.requestlog [None req-d6c0a9a6-e54e-4146-9a14-a1e57ebc0148 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] 10.222.0.75 "GET /compute/v2.1/servers/e911acec-b583-42eb-b5de-dee9573bad6c" status: 200 len: 1372 microversion: 2.1 time: 0.182147 May 26 12:42:40.477185 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: [pid: 129322|app: 0|req: 243/469] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 26 12:42:40 2022] GET /compute/v2.1/servers/e911acec-b583-42eb-b5de-dee9573bad6c => generated 1372 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:42:40.482469 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi [None req-86eead76-9b7d-4233-b005-e3c033f13238 tempest-VolumesSnapshotTestJSON-1904508205 tempest-VolumesSnapshotTestJSON-1904508205-project] Calling method '>' {{(pid=129322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:42:40.483174 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.compute.api [None req-86eead76-9b7d-4233-b005-e3c033f13238 tempest-VolumesSnapshotTestJSON-1904508205 tempest-VolumesSnapshotTestJSON-1904508205-project] [instance: f392ba2b-2b88-4b1a-be61-0cf28ed1443a] Fetching instance by UUID {{(pid=129322) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:42:40.490395 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-86eead76-9b7d-4233-b005-e3c033f13238 tempest-VolumesSnapshotTestJSON-1904508205 tempest-VolumesSnapshotTestJSON-1904508205-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:42:40.490855 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-86eead76-9b7d-4233-b005-e3c033f13238 tempest-VolumesSnapshotTestJSON-1904508205 tempest-VolumesSnapshotTestJSON-1904508205-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:42:40.492030 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-86eead76-9b7d-4233-b005-e3c033f13238 tempest-VolumesSnapshotTestJSON-1904508205 tempest-VolumesSnapshotTestJSON-1904508205-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:42:40.492473 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-86eead76-9b7d-4233-b005-e3c033f13238 tempest-VolumesSnapshotTestJSON-1904508205 tempest-VolumesSnapshotTestJSON-1904508205-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:42:40.520633 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.compute.api [None req-86eead76-9b7d-4233-b005-e3c033f13238 tempest-VolumesSnapshotTestJSON-1904508205 tempest-VolumesSnapshotTestJSON-1904508205-project] [instance: f392ba2b-2b88-4b1a-be61-0cf28ed1443a] Going to try to terminate instance {{(pid=129322) delete /opt/stack/nova/nova/compute/api.py:2664}} May 26 12:42:40.542490 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.virt.hardware [None req-5086a420-2fe3-404b-90ad-b9743d3e20f4 tempest-TestShelveInstance-546397589 tempest-TestShelveInstance-546397589-project] Flavor limits 0:0:0 {{(pid=129321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 26 12:42:40.542972 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.virt.hardware [None req-5086a420-2fe3-404b-90ad-b9743d3e20f4 tempest-TestShelveInstance-546397589 tempest-TestShelveInstance-546397589-project] Image limits 0:0:0 {{(pid=129321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 26 12:42:40.544031 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.virt.hardware [None req-5086a420-2fe3-404b-90ad-b9743d3e20f4 tempest-TestShelveInstance-546397589 tempest-TestShelveInstance-546397589-project] Flavor pref 0:0:0 {{(pid=129321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 26 12:42:40.544031 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.virt.hardware [None req-5086a420-2fe3-404b-90ad-b9743d3e20f4 tempest-TestShelveInstance-546397589 tempest-TestShelveInstance-546397589-project] Image pref 0:0:0 {{(pid=129321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 26 12:42:40.545298 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.virt.hardware [None req-5086a420-2fe3-404b-90ad-b9743d3e20f4 tempest-TestShelveInstance-546397589 tempest-TestShelveInstance-546397589-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 26 12:42:40.546880 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG dbcounter [-] [129321] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=1 {{(pid=129321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:42:40.563455 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-5086a420-2fe3-404b-90ad-b9743d3e20f4 tempest-TestShelveInstance-546397589 tempest-TestShelveInstance-546397589-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:42:40.564372 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-5086a420-2fe3-404b-90ad-b9743d3e20f4 tempest-TestShelveInstance-546397589 tempest-TestShelveInstance-546397589-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:42:40.565867 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-5086a420-2fe3-404b-90ad-b9743d3e20f4 tempest-TestShelveInstance-546397589 tempest-TestShelveInstance-546397589-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:42:40.566692 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-5086a420-2fe3-404b-90ad-b9743d3e20f4 tempest-TestShelveInstance-546397589 tempest-TestShelveInstance-546397589-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:42:40.588815 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.quota [None req-5086a420-2fe3-404b-90ad-b9743d3e20f4 tempest-TestShelveInstance-546397589 tempest-TestShelveInstance-546397589-project] Getting quotas for project c1f2f503ef674a4b97f848b69f8b63c5. Resources: {'instances', 'cores', 'ram'} {{(pid=129321) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 26 12:42:40.595089 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.quota [None req-5086a420-2fe3-404b-90ad-b9743d3e20f4 tempest-TestShelveInstance-546397589 tempest-TestShelveInstance-546397589-project] Getting quotas for user 8d9bf2dcfce24386a1aaf9709d88da45 and project c1f2f503ef674a4b97f848b69f8b63c5. Resources: {'instances', 'cores', 'ram'} {{(pid=129321) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 26 12:42:40.628173 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: INFO nova.api.openstack.requestlog [None req-86eead76-9b7d-4233-b005-e3c033f13238 tempest-VolumesSnapshotTestJSON-1904508205 tempest-VolumesSnapshotTestJSON-1904508205-project] 10.222.0.75 "DELETE /compute/v2.1/servers/f392ba2b-2b88-4b1a-be61-0cf28ed1443a" status: 204 len: 0 microversion: 2.1 time: 0.148679 May 26 12:42:40.629022 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: [pid: 129322|app: 0|req: 244/470] 10.222.0.75 () {58 vars in 1238 bytes} [Thu May 26 12:42:40 2022] DELETE /compute/v2.1/servers/f392ba2b-2b88-4b1a-be61-0cf28ed1443a => generated 0 bytes in 151 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 26 12:42:40.634746 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi [None req-ff3bc70f-71ee-4b4f-a44d-75561b13c06d tempest-VolumesActionsTest-731506124 tempest-VolumesActionsTest-731506124-project] Calling method '>' {{(pid=129322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:42:40.635472 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.compute.api [None req-ff3bc70f-71ee-4b4f-a44d-75561b13c06d tempest-VolumesActionsTest-731506124 tempest-VolumesActionsTest-731506124-project] [instance: 2be10a9b-0300-40be-96eb-602b1ad4b05c] Fetching instance by UUID {{(pid=129322) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:42:40.643068 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-ff3bc70f-71ee-4b4f-a44d-75561b13c06d tempest-VolumesActionsTest-731506124 tempest-VolumesActionsTest-731506124-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:42:40.644762 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-ff3bc70f-71ee-4b4f-a44d-75561b13c06d tempest-VolumesActionsTest-731506124 tempest-VolumesActionsTest-731506124-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:42:40.644762 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-ff3bc70f-71ee-4b4f-a44d-75561b13c06d tempest-VolumesActionsTest-731506124 tempest-VolumesActionsTest-731506124-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:42:40.644976 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-ff3bc70f-71ee-4b4f-a44d-75561b13c06d tempest-VolumesActionsTest-731506124 tempest-VolumesActionsTest-731506124-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:42:40.669491 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.compute.api [None req-5086a420-2fe3-404b-90ad-b9743d3e20f4 tempest-TestShelveInstance-546397589 tempest-TestShelveInstance-546397589-project] Going to run 1 instances... {{(pid=129321) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 26 12:42:40.672010 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.compute.api [None req-5086a420-2fe3-404b-90ad-b9743d3e20f4 tempest-TestShelveInstance-546397589 tempest-TestShelveInstance-546397589-project] [instance: 05cf529d-df00-4ff9-b0d2-0e27563d2861] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='7a321a71-c7ea-4320-a379-61bc22616ad5',volume_size=None,volume_type=None)] {{(pid=129321) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 26 12:42:40.792447 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.policy [None req-ff3bc70f-71ee-4b4f-a44d-75561b13c06d tempest-VolumesActionsTest-731506124 tempest-VolumesActionsTest-731506124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f39e076a9e6b401db6de9a2846519591', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa93879e60e470185e8dd71efaaf1a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129322) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:42:40.806889 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: INFO nova.api.openstack.requestlog [None req-ff3bc70f-71ee-4b4f-a44d-75561b13c06d tempest-VolumesActionsTest-731506124 tempest-VolumesActionsTest-731506124-project] 10.222.0.75 "GET /compute/v2.1/servers/2be10a9b-0300-40be-96eb-602b1ad4b05c" status: 200 len: 1314 microversion: 2.1 time: 0.176347 May 26 12:42:40.814552 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: [pid: 129322|app: 0|req: 245/471] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 26 12:42:40 2022] GET /compute/v2.1/servers/2be10a9b-0300-40be-96eb-602b1ad4b05c => generated 1314 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:42:40.816898 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi [None req-449272da-e92c-4e4a-83a0-b8e27aaf8d05 tempest-VolumesSnapshotTestJSON-1904508205 tempest-VolumesSnapshotTestJSON-1904508205-project] Calling method '>' {{(pid=129322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:42:40.817525 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.compute.api [None req-449272da-e92c-4e4a-83a0-b8e27aaf8d05 tempest-VolumesSnapshotTestJSON-1904508205 tempest-VolumesSnapshotTestJSON-1904508205-project] [instance: f392ba2b-2b88-4b1a-be61-0cf28ed1443a] Fetching instance by UUID {{(pid=129322) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:42:40.818203 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: INFO nova.api.openstack.requestlog [None req-5086a420-2fe3-404b-90ad-b9743d3e20f4 tempest-TestShelveInstance-546397589 tempest-TestShelveInstance-546397589-project] 10.222.0.75 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.919980 May 26 12:42:40.823636 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: [pid: 129321|app: 0|req: 227/472] 10.222.0.75 () {60 vars in 1146 bytes} [Thu May 26 12:42:39 2022] POST /compute/v2.1/servers => generated 406 bytes in 922 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) May 26 12:42:40.825292 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-449272da-e92c-4e4a-83a0-b8e27aaf8d05 tempest-VolumesSnapshotTestJSON-1904508205 tempest-VolumesSnapshotTestJSON-1904508205-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:42:40.826063 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-449272da-e92c-4e4a-83a0-b8e27aaf8d05 tempest-VolumesSnapshotTestJSON-1904508205 tempest-VolumesSnapshotTestJSON-1904508205-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:42:40.827724 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-449272da-e92c-4e4a-83a0-b8e27aaf8d05 tempest-VolumesSnapshotTestJSON-1904508205 tempest-VolumesSnapshotTestJSON-1904508205-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:42:40.828204 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-449272da-e92c-4e4a-83a0-b8e27aaf8d05 tempest-VolumesSnapshotTestJSON-1904508205 tempest-VolumesSnapshotTestJSON-1904508205-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:42:40.829917 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi [None req-2e9e64b0-4393-498f-a88f-41e1f67e81c8 tempest-TestShelveInstance-546397589 tempest-TestShelveInstance-546397589-project] Calling method '>' {{(pid=129321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:42:40.830540 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.compute.api [None req-2e9e64b0-4393-498f-a88f-41e1f67e81c8 tempest-TestShelveInstance-546397589 tempest-TestShelveInstance-546397589-project] [instance: 05cf529d-df00-4ff9-b0d2-0e27563d2861] Fetching instance by UUID {{(pid=129321) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:42:40.903009 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.policy [None req-2e9e64b0-4393-498f-a88f-41e1f67e81c8 tempest-TestShelveInstance-546397589 tempest-TestShelveInstance-546397589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d9bf2dcfce24386a1aaf9709d88da45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1f2f503ef674a4b97f848b69f8b63c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129321) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:42:40.919600 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: INFO nova.api.openstack.requestlog [None req-2e9e64b0-4393-498f-a88f-41e1f67e81c8 tempest-TestShelveInstance-546397589 tempest-TestShelveInstance-546397589-project] 10.222.0.75 "GET /compute/v2.1/servers/05cf529d-df00-4ff9-b0d2-0e27563d2861" status: 200 len: 1087 microversion: 2.1 time: 0.093949 May 26 12:42:40.919600 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: [pid: 129321|app: 0|req: 228/473] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 26 12:42:40 2022] GET /compute/v2.1/servers/05cf529d-df00-4ff9-b0d2-0e27563d2861 => generated 1087 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:42:41.011026 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.policy [None req-449272da-e92c-4e4a-83a0-b8e27aaf8d05 tempest-VolumesSnapshotTestJSON-1904508205 tempest-VolumesSnapshotTestJSON-1904508205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '805854e5ce2e412fb9420afd63f73ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72bda4cbb07a43688506e01d06ba89c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129322) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:42:41.019362 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: INFO nova.api.openstack.requestlog [None req-449272da-e92c-4e4a-83a0-b8e27aaf8d05 tempest-VolumesSnapshotTestJSON-1904508205 tempest-VolumesSnapshotTestJSON-1904508205-project] 10.222.0.75 "GET /compute/v2.1/servers/f392ba2b-2b88-4b1a-be61-0cf28ed1443a" status: 200 len: 1513 microversion: 2.1 time: 0.209860 May 26 12:42:41.020165 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: [pid: 129322|app: 0|req: 246/474] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 26 12:42:40 2022] GET /compute/v2.1/servers/f392ba2b-2b88-4b1a-be61-0cf28ed1443a => generated 1513 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:42:41.054664 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi [None req-dbfd8b79-30e1-48c4-bd2f-93193fe4c9bd tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Calling method '>' {{(pid=129321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:42:41.055484 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.compute.api [None req-dbfd8b79-30e1-48c4-bd2f-93193fe4c9bd tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] [instance: bf2f6303-22b9-4cfa-8d4d-61d2503bc554] Fetching instance by UUID {{(pid=129321) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:42:41.067132 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-dbfd8b79-30e1-48c4-bd2f-93193fe4c9bd tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:42:41.067812 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-dbfd8b79-30e1-48c4-bd2f-93193fe4c9bd tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:42:41.068947 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-dbfd8b79-30e1-48c4-bd2f-93193fe4c9bd tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:42:41.069579 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-dbfd8b79-30e1-48c4-bd2f-93193fe4c9bd tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:42:41.079169 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG dbcounter [-] [129321] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=129321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:42:41.234036 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.policy [None req-dbfd8b79-30e1-48c4-bd2f-93193fe4c9bd tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e811736979c44b02b14fecb74c6bd7ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675272fb40d4847819f83ec04afecef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129321) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:42:41.243299 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.policy [None req-dbfd8b79-30e1-48c4-bd2f-93193fe4c9bd tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e811736979c44b02b14fecb74c6bd7ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675272fb40d4847819f83ec04afecef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129321) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:42:41.245054 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.policy [None req-dbfd8b79-30e1-48c4-bd2f-93193fe4c9bd tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e811736979c44b02b14fecb74c6bd7ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675272fb40d4847819f83ec04afecef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129321) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:42:41.246339 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: INFO nova.api.openstack.requestlog [None req-dbfd8b79-30e1-48c4-bd2f-93193fe4c9bd tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] 10.222.0.75 "GET /compute/v2.1/servers/bf2f6303-22b9-4cfa-8d4d-61d2503bc554" status: 200 len: 1725 microversion: 2.20 time: 0.195636 May 26 12:42:41.247059 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: [pid: 129321|app: 0|req: 229/475] 10.222.0.75 () {60 vars in 1276 bytes} [Thu May 26 12:42:41 2022] GET /compute/v2.1/servers/bf2f6303-22b9-4cfa-8d4d-61d2503bc554 => generated 1725 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 26 12:42:41.302025 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi [None req-d85bb973-f8ce-432f-b281-346831c6e21e tempest-TestMinimumBasicScenario-102576986 tempest-TestMinimumBasicScenario-102576986-project] Calling method '>' {{(pid=129322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:42:41.302646 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.compute.api [None req-d85bb973-f8ce-432f-b281-346831c6e21e tempest-TestMinimumBasicScenario-102576986 tempest-TestMinimumBasicScenario-102576986-project] [instance: 76661008-e6d3-4646-a9ba-d5d0e83a4b65] Fetching instance by UUID {{(pid=129322) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:42:41.309552 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-d85bb973-f8ce-432f-b281-346831c6e21e tempest-TestMinimumBasicScenario-102576986 tempest-TestMinimumBasicScenario-102576986-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:42:41.309998 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-d85bb973-f8ce-432f-b281-346831c6e21e tempest-TestMinimumBasicScenario-102576986 tempest-TestMinimumBasicScenario-102576986-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:42:41.310754 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-d85bb973-f8ce-432f-b281-346831c6e21e tempest-TestMinimumBasicScenario-102576986 tempest-TestMinimumBasicScenario-102576986-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:42:41.311174 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-d85bb973-f8ce-432f-b281-346831c6e21e tempest-TestMinimumBasicScenario-102576986 tempest-TestMinimumBasicScenario-102576986-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:42:41.446847 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.policy [None req-d85bb973-f8ce-432f-b281-346831c6e21e tempest-TestMinimumBasicScenario-102576986 tempest-TestMinimumBasicScenario-102576986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0352a80bdc174b9a9df4eca60b81eba4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fa2c4d6423444e487d259062656129b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129322) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:42:41.457683 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: INFO nova.api.openstack.requestlog [None req-d85bb973-f8ce-432f-b281-346831c6e21e tempest-TestMinimumBasicScenario-102576986 tempest-TestMinimumBasicScenario-102576986-project] 10.222.0.75 "GET /compute/v2.1/servers/76661008-e6d3-4646-a9ba-d5d0e83a4b65" status: 200 len: 1357 microversion: 2.1 time: 0.159656 May 26 12:42:41.458273 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: [pid: 129322|app: 0|req: 247/476] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 26 12:42:41 2022] GET /compute/v2.1/servers/76661008-e6d3-4646-a9ba-d5d0e83a4b65 => generated 1357 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:42:41.503259 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi [None req-d8d8d9a8-1bb1-408b-9eaf-e4550ef0dd68 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Calling method '>' {{(pid=129321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:42:41.503888 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.compute.api [None req-d8d8d9a8-1bb1-408b-9eaf-e4550ef0dd68 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] [instance: e911acec-b583-42eb-b5de-dee9573bad6c] Fetching instance by UUID {{(pid=129321) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:42:41.510563 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-d8d8d9a8-1bb1-408b-9eaf-e4550ef0dd68 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:42:41.511002 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-d8d8d9a8-1bb1-408b-9eaf-e4550ef0dd68 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:42:41.511803 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-d8d8d9a8-1bb1-408b-9eaf-e4550ef0dd68 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:42:41.512231 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-d8d8d9a8-1bb1-408b-9eaf-e4550ef0dd68 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:42:41.651796 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.policy [None req-d8d8d9a8-1bb1-408b-9eaf-e4550ef0dd68 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0431b1f25497443ba483b3c440669080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e36ab03283d4ce6a2fed5e111e03d34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129321) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:42:41.662130 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: INFO nova.api.openstack.requestlog [None req-d8d8d9a8-1bb1-408b-9eaf-e4550ef0dd68 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] 10.222.0.75 "GET /compute/v2.1/servers/e911acec-b583-42eb-b5de-dee9573bad6c" status: 200 len: 1565 microversion: 2.1 time: 0.162693 May 26 12:42:41.662728 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: [pid: 129321|app: 0|req: 230/477] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 26 12:42:41 2022] GET /compute/v2.1/servers/e911acec-b583-42eb-b5de-dee9573bad6c => generated 1565 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:42:41.678888 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi [None req-f67c5c3d-6dd2-412f-afcf-3250f9ec4bbe tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Calling method '>' {{(pid=129322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:42:41.679380 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.compute.api [None req-f67c5c3d-6dd2-412f-afcf-3250f9ec4bbe tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] [instance: e911acec-b583-42eb-b5de-dee9573bad6c] Fetching instance by UUID {{(pid=129322) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:42:41.686351 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-f67c5c3d-6dd2-412f-afcf-3250f9ec4bbe tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:42:41.686802 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-f67c5c3d-6dd2-412f-afcf-3250f9ec4bbe tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:42:41.687572 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-f67c5c3d-6dd2-412f-afcf-3250f9ec4bbe tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:42:41.688036 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-f67c5c3d-6dd2-412f-afcf-3250f9ec4bbe tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:42:41.772364 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: INFO nova.api.openstack.requestlog [None req-f67c5c3d-6dd2-412f-afcf-3250f9ec4bbe tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] 10.222.0.75 "GET /compute/v2.1/servers/e911acec-b583-42eb-b5de-dee9573bad6c/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.097354 May 26 12:42:41.772968 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: [pid: 129322|app: 0|req: 248/478] 10.222.0.75 () {58 vars in 1274 bytes} [Thu May 26 12:42:41 2022] GET /compute/v2.1/servers/e911acec-b583-42eb-b5de-dee9573bad6c/os-interface => generated 284 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 12:42:41.824944 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi [None req-0da97b68-7ccb-46e3-bcf1-5f87130fe512 tempest-VolumesActionsTest-731506124 tempest-VolumesActionsTest-731506124-project] Calling method '>' {{(pid=129321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:42:41.825886 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.compute.api [None req-0da97b68-7ccb-46e3-bcf1-5f87130fe512 tempest-VolumesActionsTest-731506124 tempest-VolumesActionsTest-731506124-project] [instance: 2be10a9b-0300-40be-96eb-602b1ad4b05c] Fetching instance by UUID {{(pid=129321) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:42:41.832880 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-0da97b68-7ccb-46e3-bcf1-5f87130fe512 tempest-VolumesActionsTest-731506124 tempest-VolumesActionsTest-731506124-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:42:41.833311 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-0da97b68-7ccb-46e3-bcf1-5f87130fe512 tempest-VolumesActionsTest-731506124 tempest-VolumesActionsTest-731506124-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:42:41.834059 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-0da97b68-7ccb-46e3-bcf1-5f87130fe512 tempest-VolumesActionsTest-731506124 tempest-VolumesActionsTest-731506124-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:42:41.834481 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-0da97b68-7ccb-46e3-bcf1-5f87130fe512 tempest-VolumesActionsTest-731506124 tempest-VolumesActionsTest-731506124-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:42:41.938019 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi [None req-d476da90-4ae2-4d2c-a684-b13938998ba7 tempest-TestShelveInstance-546397589 tempest-TestShelveInstance-546397589-project] Calling method '>' {{(pid=129322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:42:41.939089 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.compute.api [None req-d476da90-4ae2-4d2c-a684-b13938998ba7 tempest-TestShelveInstance-546397589 tempest-TestShelveInstance-546397589-project] [instance: 05cf529d-df00-4ff9-b0d2-0e27563d2861] Fetching instance by UUID {{(pid=129322) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:42:41.947015 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-d476da90-4ae2-4d2c-a684-b13938998ba7 tempest-TestShelveInstance-546397589 tempest-TestShelveInstance-546397589-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:42:41.947617 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-d476da90-4ae2-4d2c-a684-b13938998ba7 tempest-TestShelveInstance-546397589 tempest-TestShelveInstance-546397589-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:42:41.948463 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-d476da90-4ae2-4d2c-a684-b13938998ba7 tempest-TestShelveInstance-546397589 tempest-TestShelveInstance-546397589-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:42:41.948897 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-d476da90-4ae2-4d2c-a684-b13938998ba7 tempest-TestShelveInstance-546397589 tempest-TestShelveInstance-546397589-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:42:42.015036 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.policy [None req-d476da90-4ae2-4d2c-a684-b13938998ba7 tempest-TestShelveInstance-546397589 tempest-TestShelveInstance-546397589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d9bf2dcfce24386a1aaf9709d88da45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1f2f503ef674a4b97f848b69f8b63c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129322) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:42:42.022642 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: INFO nova.api.openstack.requestlog [None req-d476da90-4ae2-4d2c-a684-b13938998ba7 tempest-TestShelveInstance-546397589 tempest-TestShelveInstance-546397589-project] 10.222.0.75 "GET /compute/v2.1/servers/05cf529d-df00-4ff9-b0d2-0e27563d2861" status: 200 len: 1137 microversion: 2.1 time: 0.089190 May 26 12:42:42.023204 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: [pid: 129322|app: 0|req: 249/479] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 26 12:42:41 2022] GET /compute/v2.1/servers/05cf529d-df00-4ff9-b0d2-0e27563d2861 => generated 1137 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:42:42.037546 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi [None req-71ea6a45-58f5-4276-b7f9-60f4431893f9 tempest-VolumesSnapshotTestJSON-1904508205 tempest-VolumesSnapshotTestJSON-1904508205-project] Calling method '>' {{(pid=129322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:42:42.038237 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.compute.api [None req-71ea6a45-58f5-4276-b7f9-60f4431893f9 tempest-VolumesSnapshotTestJSON-1904508205 tempest-VolumesSnapshotTestJSON-1904508205-project] [instance: f392ba2b-2b88-4b1a-be61-0cf28ed1443a] Fetching instance by UUID {{(pid=129322) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:42:42.044887 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-71ea6a45-58f5-4276-b7f9-60f4431893f9 tempest-VolumesSnapshotTestJSON-1904508205 tempest-VolumesSnapshotTestJSON-1904508205-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:42:42.047937 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-71ea6a45-58f5-4276-b7f9-60f4431893f9 tempest-VolumesSnapshotTestJSON-1904508205 tempest-VolumesSnapshotTestJSON-1904508205-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:42:42.048818 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-71ea6a45-58f5-4276-b7f9-60f4431893f9 tempest-VolumesSnapshotTestJSON-1904508205 tempest-VolumesSnapshotTestJSON-1904508205-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:42:42.049481 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-71ea6a45-58f5-4276-b7f9-60f4431893f9 tempest-VolumesSnapshotTestJSON-1904508205 tempest-VolumesSnapshotTestJSON-1904508205-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:42:42.101941 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.policy [None req-0da97b68-7ccb-46e3-bcf1-5f87130fe512 tempest-VolumesActionsTest-731506124 tempest-VolumesActionsTest-731506124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f39e076a9e6b401db6de9a2846519591', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa93879e60e470185e8dd71efaaf1a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129321) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:42:42.112355 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: INFO nova.api.openstack.requestlog [None req-0da97b68-7ccb-46e3-bcf1-5f87130fe512 tempest-VolumesActionsTest-731506124 tempest-VolumesActionsTest-731506124-project] 10.222.0.75 "GET /compute/v2.1/servers/2be10a9b-0300-40be-96eb-602b1ad4b05c" status: 200 len: 1314 microversion: 2.1 time: 0.291253 May 26 12:42:42.112970 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: [pid: 129321|app: 0|req: 231/480] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 26 12:42:41 2022] GET /compute/v2.1/servers/2be10a9b-0300-40be-96eb-602b1ad4b05c => generated 1314 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:42:42.198136 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.policy [None req-71ea6a45-58f5-4276-b7f9-60f4431893f9 tempest-VolumesSnapshotTestJSON-1904508205 tempest-VolumesSnapshotTestJSON-1904508205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '805854e5ce2e412fb9420afd63f73ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72bda4cbb07a43688506e01d06ba89c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129322) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:42:42.206786 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: INFO nova.api.openstack.requestlog [None req-71ea6a45-58f5-4276-b7f9-60f4431893f9 tempest-VolumesSnapshotTestJSON-1904508205 tempest-VolumesSnapshotTestJSON-1904508205-project] 10.222.0.75 "GET /compute/v2.1/servers/f392ba2b-2b88-4b1a-be61-0cf28ed1443a" status: 200 len: 1513 microversion: 2.1 time: 0.173114 May 26 12:42:42.207386 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: [pid: 129322|app: 0|req: 250/481] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 26 12:42:42 2022] GET /compute/v2.1/servers/f392ba2b-2b88-4b1a-be61-0cf28ed1443a => generated 1513 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 12:42:42.267280 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi [None req-8abb1626-efc4-411a-9eec-65029da0898b tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Calling method '>' {{(pid=129321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:42:42.268074 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.compute.api [None req-8abb1626-efc4-411a-9eec-65029da0898b tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] [instance: bf2f6303-22b9-4cfa-8d4d-61d2503bc554] Fetching instance by UUID {{(pid=129321) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:42:42.274721 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-8abb1626-efc4-411a-9eec-65029da0898b tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:42:42.275189 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-8abb1626-efc4-411a-9eec-65029da0898b tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:42:42.275990 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-8abb1626-efc4-411a-9eec-65029da0898b tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:42:42.276413 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-8abb1626-efc4-411a-9eec-65029da0898b tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:42:42.475255 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi [None req-2c85e1af-aa27-4e7a-8c5a-8d21127ff10f tempest-TestMinimumBasicScenario-102576986 tempest-TestMinimumBasicScenario-102576986-project] Calling method '>' {{(pid=129322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:42:42.475916 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.compute.api [None req-2c85e1af-aa27-4e7a-8c5a-8d21127ff10f tempest-TestMinimumBasicScenario-102576986 tempest-TestMinimumBasicScenario-102576986-project] [instance: 76661008-e6d3-4646-a9ba-d5d0e83a4b65] Fetching instance by UUID {{(pid=129322) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:42:42.483063 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-2c85e1af-aa27-4e7a-8c5a-8d21127ff10f tempest-TestMinimumBasicScenario-102576986 tempest-TestMinimumBasicScenario-102576986-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:42:42.483502 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-2c85e1af-aa27-4e7a-8c5a-8d21127ff10f tempest-TestMinimumBasicScenario-102576986 tempest-TestMinimumBasicScenario-102576986-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:42:42.484318 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-2c85e1af-aa27-4e7a-8c5a-8d21127ff10f tempest-TestMinimumBasicScenario-102576986 tempest-TestMinimumBasicScenario-102576986-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:42:42.484747 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-2c85e1af-aa27-4e7a-8c5a-8d21127ff10f tempest-TestMinimumBasicScenario-102576986 tempest-TestMinimumBasicScenario-102576986-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:42:42.622766 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.policy [None req-2c85e1af-aa27-4e7a-8c5a-8d21127ff10f tempest-TestMinimumBasicScenario-102576986 tempest-TestMinimumBasicScenario-102576986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0352a80bdc174b9a9df4eca60b81eba4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fa2c4d6423444e487d259062656129b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129322) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:42:42.631521 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: INFO nova.api.openstack.requestlog [None req-2c85e1af-aa27-4e7a-8c5a-8d21127ff10f tempest-TestMinimumBasicScenario-102576986 tempest-TestMinimumBasicScenario-102576986-project] 10.222.0.75 "GET /compute/v2.1/servers/76661008-e6d3-4646-a9ba-d5d0e83a4b65" status: 200 len: 1357 microversion: 2.1 time: 0.160163 May 26 12:42:42.632141 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: [pid: 129322|app: 0|req: 251/482] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 26 12:42:42 2022] GET /compute/v2.1/servers/76661008-e6d3-4646-a9ba-d5d0e83a4b65 => generated 1357 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:42:42.805179 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.policy [None req-8abb1626-efc4-411a-9eec-65029da0898b tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e811736979c44b02b14fecb74c6bd7ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675272fb40d4847819f83ec04afecef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129321) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:42:42.828897 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.policy [None req-8abb1626-efc4-411a-9eec-65029da0898b tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e811736979c44b02b14fecb74c6bd7ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675272fb40d4847819f83ec04afecef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129321) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:42:42.830415 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.policy [None req-8abb1626-efc4-411a-9eec-65029da0898b tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e811736979c44b02b14fecb74c6bd7ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675272fb40d4847819f83ec04afecef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129321) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:42:42.831613 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: INFO nova.api.openstack.requestlog [None req-8abb1626-efc4-411a-9eec-65029da0898b tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] 10.222.0.75 "GET /compute/v2.1/servers/bf2f6303-22b9-4cfa-8d4d-61d2503bc554" status: 200 len: 1725 microversion: 2.20 time: 0.568800 May 26 12:42:42.832203 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: [pid: 129321|app: 0|req: 232/483] 10.222.0.75 () {60 vars in 1276 bytes} [Thu May 26 12:42:42 2022] GET /compute/v2.1/servers/bf2f6303-22b9-4cfa-8d4d-61d2503bc554 => generated 1725 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 12:42:43.040276 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi [None req-9d595ab0-dcef-4b42-8452-1fdc18e54b78 tempest-TestShelveInstance-546397589 tempest-TestShelveInstance-546397589-project] Calling method '>' {{(pid=129322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:42:43.041011 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.compute.api [None req-9d595ab0-dcef-4b42-8452-1fdc18e54b78 tempest-TestShelveInstance-546397589 tempest-TestShelveInstance-546397589-project] [instance: 05cf529d-df00-4ff9-b0d2-0e27563d2861] Fetching instance by UUID {{(pid=129322) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:42:43.048035 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-9d595ab0-dcef-4b42-8452-1fdc18e54b78 tempest-TestShelveInstance-546397589 tempest-TestShelveInstance-546397589-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:42:43.048565 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-9d595ab0-dcef-4b42-8452-1fdc18e54b78 tempest-TestShelveInstance-546397589 tempest-TestShelveInstance-546397589-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:42:43.049406 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-9d595ab0-dcef-4b42-8452-1fdc18e54b78 tempest-TestShelveInstance-546397589 tempest-TestShelveInstance-546397589-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:42:43.049945 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-9d595ab0-dcef-4b42-8452-1fdc18e54b78 tempest-TestShelveInstance-546397589 tempest-TestShelveInstance-546397589-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:42:43.111335 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.policy [None req-9d595ab0-dcef-4b42-8452-1fdc18e54b78 tempest-TestShelveInstance-546397589 tempest-TestShelveInstance-546397589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d9bf2dcfce24386a1aaf9709d88da45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1f2f503ef674a4b97f848b69f8b63c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129322) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:42:43.119179 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: INFO nova.api.openstack.requestlog [None req-9d595ab0-dcef-4b42-8452-1fdc18e54b78 tempest-TestShelveInstance-546397589 tempest-TestShelveInstance-546397589-project] 10.222.0.75 "GET /compute/v2.1/servers/05cf529d-df00-4ff9-b0d2-0e27563d2861" status: 200 len: 1137 microversion: 2.1 time: 0.082863 May 26 12:42:43.119957 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: [pid: 129322|app: 0|req: 252/484] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 26 12:42:43 2022] GET /compute/v2.1/servers/05cf529d-df00-4ff9-b0d2-0e27563d2861 => generated 1137 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:42:43.134320 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi [None req-12789297-08f5-40de-883d-053dede1ae1a tempest-VolumesActionsTest-731506124 tempest-VolumesActionsTest-731506124-project] Calling method '>' {{(pid=129321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:42:43.134951 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.compute.api [None req-12789297-08f5-40de-883d-053dede1ae1a tempest-VolumesActionsTest-731506124 tempest-VolumesActionsTest-731506124-project] [instance: 2be10a9b-0300-40be-96eb-602b1ad4b05c] Fetching instance by UUID {{(pid=129321) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:42:43.141252 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-12789297-08f5-40de-883d-053dede1ae1a tempest-VolumesActionsTest-731506124 tempest-VolumesActionsTest-731506124-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:42:43.141687 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-12789297-08f5-40de-883d-053dede1ae1a tempest-VolumesActionsTest-731506124 tempest-VolumesActionsTest-731506124-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:42:43.142441 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-12789297-08f5-40de-883d-053dede1ae1a tempest-VolumesActionsTest-731506124 tempest-VolumesActionsTest-731506124-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:42:43.142867 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-12789297-08f5-40de-883d-053dede1ae1a tempest-VolumesActionsTest-731506124 tempest-VolumesActionsTest-731506124-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:42:43.224432 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi [None req-812e8b5b-190c-4975-83b8-19e0318ac33a tempest-VolumesSnapshotTestJSON-1904508205 tempest-VolumesSnapshotTestJSON-1904508205-project] Calling method '>' {{(pid=129322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:42:43.225032 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.compute.api [None req-812e8b5b-190c-4975-83b8-19e0318ac33a tempest-VolumesSnapshotTestJSON-1904508205 tempest-VolumesSnapshotTestJSON-1904508205-project] [instance: f392ba2b-2b88-4b1a-be61-0cf28ed1443a] Fetching instance by UUID {{(pid=129322) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:42:43.231452 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-812e8b5b-190c-4975-83b8-19e0318ac33a tempest-VolumesSnapshotTestJSON-1904508205 tempest-VolumesSnapshotTestJSON-1904508205-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:42:43.231921 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-812e8b5b-190c-4975-83b8-19e0318ac33a tempest-VolumesSnapshotTestJSON-1904508205 tempest-VolumesSnapshotTestJSON-1904508205-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:42:43.232670 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-812e8b5b-190c-4975-83b8-19e0318ac33a tempest-VolumesSnapshotTestJSON-1904508205 tempest-VolumesSnapshotTestJSON-1904508205-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:42:43.233095 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-812e8b5b-190c-4975-83b8-19e0318ac33a tempest-VolumesSnapshotTestJSON-1904508205 tempest-VolumesSnapshotTestJSON-1904508205-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:42:43.353556 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.policy [None req-12789297-08f5-40de-883d-053dede1ae1a tempest-VolumesActionsTest-731506124 tempest-VolumesActionsTest-731506124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f39e076a9e6b401db6de9a2846519591', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa93879e60e470185e8dd71efaaf1a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129321) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:42:43.362176 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: INFO nova.api.openstack.requestlog [None req-12789297-08f5-40de-883d-053dede1ae1a tempest-VolumesActionsTest-731506124 tempest-VolumesActionsTest-731506124-project] 10.222.0.75 "GET /compute/v2.1/servers/2be10a9b-0300-40be-96eb-602b1ad4b05c" status: 200 len: 1498 microversion: 2.1 time: 0.231647 May 26 12:42:43.376331 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: [pid: 129321|app: 0|req: 233/485] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 26 12:42:43 2022] GET /compute/v2.1/servers/2be10a9b-0300-40be-96eb-602b1ad4b05c => generated 1498 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:42:43.386405 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi [req-ef95e84d-f846-4066-98b2-d00833682c72 req-90b09f54-8902-45a9-baf6-df62e1d9cf71 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e911acec-b583-42eb-b5de-dee9573bad6c", "tag": "fc5a0b73-9cdf-4e1b-8b93-f12bfc2ac6a4"}]} {{(pid=129321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 12:42:43.388672 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.policy [None req-812e8b5b-190c-4975-83b8-19e0318ac33a tempest-VolumesSnapshotTestJSON-1904508205 tempest-VolumesSnapshotTestJSON-1904508205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '805854e5ce2e412fb9420afd63f73ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72bda4cbb07a43688506e01d06ba89c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129322) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:42:43.396291 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [req-ef95e84d-f846-4066-98b2-d00833682c72 req-90b09f54-8902-45a9-baf6-df62e1d9cf71 service nova] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:42:43.397170 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [req-ef95e84d-f846-4066-98b2-d00833682c72 req-90b09f54-8902-45a9-baf6-df62e1d9cf71 service nova] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:42:43.402287 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: INFO nova.api.openstack.requestlog [None req-812e8b5b-190c-4975-83b8-19e0318ac33a tempest-VolumesSnapshotTestJSON-1904508205 tempest-VolumesSnapshotTestJSON-1904508205-project] 10.222.0.75 "GET /compute/v2.1/servers/f392ba2b-2b88-4b1a-be61-0cf28ed1443a" status: 200 len: 1513 microversion: 2.1 time: 0.181592 May 26 12:42:43.405979 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: [pid: 129322|app: 0|req: 253/486] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 26 12:42:43 2022] GET /compute/v2.1/servers/f392ba2b-2b88-4b1a-be61-0cf28ed1443a => generated 1513 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:42:43.417939 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: INFO nova.api.openstack.compute.server_external_events [req-ef95e84d-f846-4066-98b2-d00833682c72 req-90b09f54-8902-45a9-baf6-df62e1d9cf71 service nova] Creating event network-changed:fc5a0b73-9cdf-4e1b-8b93-f12bfc2ac6a4 for instance e911acec-b583-42eb-b5de-dee9573bad6c on hv-cinder-81966 May 26 12:42:43.423214 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: INFO nova.api.openstack.requestlog [req-ef95e84d-f846-4066-98b2-d00833682c72 req-90b09f54-8902-45a9-baf6-df62e1d9cf71 service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042670 May 26 12:42:43.423855 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: [pid: 129321|app: 0|req: 234/487] 10.222.0.75 () {64 vars in 1317 bytes} [Thu May 26 12:42:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 12:42:43.649552 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi [None req-c09bce3c-b375-44ec-8676-a417ce0346ef tempest-TestMinimumBasicScenario-102576986 tempest-TestMinimumBasicScenario-102576986-project] Calling method '>' {{(pid=129322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:42:43.650402 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.compute.api [None req-c09bce3c-b375-44ec-8676-a417ce0346ef tempest-TestMinimumBasicScenario-102576986 tempest-TestMinimumBasicScenario-102576986-project] [instance: 76661008-e6d3-4646-a9ba-d5d0e83a4b65] Fetching instance by UUID {{(pid=129322) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:42:43.658093 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-c09bce3c-b375-44ec-8676-a417ce0346ef tempest-TestMinimumBasicScenario-102576986 tempest-TestMinimumBasicScenario-102576986-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:42:43.658537 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-c09bce3c-b375-44ec-8676-a417ce0346ef tempest-TestMinimumBasicScenario-102576986 tempest-TestMinimumBasicScenario-102576986-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:42:43.659324 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-c09bce3c-b375-44ec-8676-a417ce0346ef tempest-TestMinimumBasicScenario-102576986 tempest-TestMinimumBasicScenario-102576986-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:42:43.659785 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-c09bce3c-b375-44ec-8676-a417ce0346ef tempest-TestMinimumBasicScenario-102576986 tempest-TestMinimumBasicScenario-102576986-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:42:43.809173 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.policy [None req-c09bce3c-b375-44ec-8676-a417ce0346ef tempest-TestMinimumBasicScenario-102576986 tempest-TestMinimumBasicScenario-102576986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0352a80bdc174b9a9df4eca60b81eba4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fa2c4d6423444e487d259062656129b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129322) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:42:43.817236 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: INFO nova.api.openstack.requestlog [None req-c09bce3c-b375-44ec-8676-a417ce0346ef tempest-TestMinimumBasicScenario-102576986 tempest-TestMinimumBasicScenario-102576986-project] 10.222.0.75 "GET /compute/v2.1/servers/76661008-e6d3-4646-a9ba-d5d0e83a4b65" status: 200 len: 1357 microversion: 2.1 time: 0.172032 May 26 12:42:43.818005 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: [pid: 129322|app: 0|req: 254/488] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 26 12:42:43 2022] GET /compute/v2.1/servers/76661008-e6d3-4646-a9ba-d5d0e83a4b65 => generated 1357 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:42:43.850638 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi [None req-b95f02de-ad7c-4a1f-b40b-588c87dfc32a tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Calling method '>' {{(pid=129321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:42:43.851400 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.compute.api [None req-b95f02de-ad7c-4a1f-b40b-588c87dfc32a tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] [instance: bf2f6303-22b9-4cfa-8d4d-61d2503bc554] Fetching instance by UUID {{(pid=129321) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:42:43.858594 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-b95f02de-ad7c-4a1f-b40b-588c87dfc32a tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:42:43.859250 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-b95f02de-ad7c-4a1f-b40b-588c87dfc32a tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:42:43.860230 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-b95f02de-ad7c-4a1f-b40b-588c87dfc32a tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:42:43.860671 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-b95f02de-ad7c-4a1f-b40b-588c87dfc32a tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:42:43.971419 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi [None req-98543395-da57-4505-9c0a-55e7ceed3eec tempest-VolumesActionsTest-731506124 tempest-VolumesActionsTest-731506124-project] Calling method '>' {{(pid=129322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:42:43.971943 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.compute.api [None req-98543395-da57-4505-9c0a-55e7ceed3eec tempest-VolumesActionsTest-731506124 tempest-VolumesActionsTest-731506124-project] [instance: 2be10a9b-0300-40be-96eb-602b1ad4b05c] Fetching instance by UUID {{(pid=129322) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:42:43.978110 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-98543395-da57-4505-9c0a-55e7ceed3eec tempest-VolumesActionsTest-731506124 tempest-VolumesActionsTest-731506124-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:42:43.978921 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-98543395-da57-4505-9c0a-55e7ceed3eec tempest-VolumesActionsTest-731506124 tempest-VolumesActionsTest-731506124-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:42:43.979356 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-98543395-da57-4505-9c0a-55e7ceed3eec tempest-VolumesActionsTest-731506124 tempest-VolumesActionsTest-731506124-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:42:43.979828 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-98543395-da57-4505-9c0a-55e7ceed3eec tempest-VolumesActionsTest-731506124 tempest-VolumesActionsTest-731506124-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:42:44.007692 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.compute.api [None req-98543395-da57-4505-9c0a-55e7ceed3eec tempest-VolumesActionsTest-731506124 tempest-VolumesActionsTest-731506124-project] [instance: 2be10a9b-0300-40be-96eb-602b1ad4b05c] Going to try to terminate instance {{(pid=129322) delete /opt/stack/nova/nova/compute/api.py:2664}} May 26 12:42:44.021096 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.policy [None req-b95f02de-ad7c-4a1f-b40b-588c87dfc32a tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e811736979c44b02b14fecb74c6bd7ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675272fb40d4847819f83ec04afecef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129321) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:42:44.035854 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.policy [None req-b95f02de-ad7c-4a1f-b40b-588c87dfc32a tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e811736979c44b02b14fecb74c6bd7ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675272fb40d4847819f83ec04afecef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129321) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:42:44.037516 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.policy [None req-b95f02de-ad7c-4a1f-b40b-588c87dfc32a tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e811736979c44b02b14fecb74c6bd7ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675272fb40d4847819f83ec04afecef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129321) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:42:44.038687 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: INFO nova.api.openstack.requestlog [None req-b95f02de-ad7c-4a1f-b40b-588c87dfc32a tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] 10.222.0.75 "GET /compute/v2.1/servers/bf2f6303-22b9-4cfa-8d4d-61d2503bc554" status: 200 len: 1725 microversion: 2.20 time: 0.192583 May 26 12:42:44.039443 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: [pid: 129321|app: 0|req: 235/489] 10.222.0.75 () {60 vars in 1276 bytes} [Thu May 26 12:42:43 2022] GET /compute/v2.1/servers/bf2f6303-22b9-4cfa-8d4d-61d2503bc554 => generated 1725 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 12:42:44.059161 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG dbcounter [-] [129322] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=129322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:42:44.098708 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: INFO nova.api.openstack.requestlog [None req-98543395-da57-4505-9c0a-55e7ceed3eec tempest-VolumesActionsTest-731506124 tempest-VolumesActionsTest-731506124-project] 10.222.0.75 "DELETE /compute/v2.1/servers/2be10a9b-0300-40be-96eb-602b1ad4b05c" status: 204 len: 0 microversion: 2.1 time: 0.130995 May 26 12:42:44.099475 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: [pid: 129322|app: 0|req: 255/490] 10.222.0.75 () {58 vars in 1238 bytes} [Thu May 26 12:42:43 2022] DELETE /compute/v2.1/servers/2be10a9b-0300-40be-96eb-602b1ad4b05c => generated 0 bytes in 133 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) May 26 12:42:44.107797 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi [None req-ca3a8f72-5be4-456d-a49e-b0f4b13cb905 tempest-VolumesActionsTest-731506124 tempest-VolumesActionsTest-731506124-project] Calling method '>' {{(pid=129321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:42:44.108907 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.compute.api [None req-ca3a8f72-5be4-456d-a49e-b0f4b13cb905 tempest-VolumesActionsTest-731506124 tempest-VolumesActionsTest-731506124-project] [instance: 2be10a9b-0300-40be-96eb-602b1ad4b05c] Fetching instance by UUID {{(pid=129321) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:42:44.115624 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-ca3a8f72-5be4-456d-a49e-b0f4b13cb905 tempest-VolumesActionsTest-731506124 tempest-VolumesActionsTest-731506124-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:42:44.116099 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-ca3a8f72-5be4-456d-a49e-b0f4b13cb905 tempest-VolumesActionsTest-731506124 tempest-VolumesActionsTest-731506124-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:42:44.116863 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-ca3a8f72-5be4-456d-a49e-b0f4b13cb905 tempest-VolumesActionsTest-731506124 tempest-VolumesActionsTest-731506124-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:42:44.117314 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-ca3a8f72-5be4-456d-a49e-b0f4b13cb905 tempest-VolumesActionsTest-731506124 tempest-VolumesActionsTest-731506124-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:42:44.137374 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi [None req-5d94782e-eb45-495d-8ea6-3a1755fdaee7 tempest-TestShelveInstance-546397589 tempest-TestShelveInstance-546397589-project] Calling method '>' {{(pid=129322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:42:44.138140 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.compute.api [None req-5d94782e-eb45-495d-8ea6-3a1755fdaee7 tempest-TestShelveInstance-546397589 tempest-TestShelveInstance-546397589-project] [instance: 05cf529d-df00-4ff9-b0d2-0e27563d2861] Fetching instance by UUID {{(pid=129322) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:42:44.144478 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-5d94782e-eb45-495d-8ea6-3a1755fdaee7 tempest-TestShelveInstance-546397589 tempest-TestShelveInstance-546397589-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:42:44.144927 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-5d94782e-eb45-495d-8ea6-3a1755fdaee7 tempest-TestShelveInstance-546397589 tempest-TestShelveInstance-546397589-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:42:44.145681 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-5d94782e-eb45-495d-8ea6-3a1755fdaee7 tempest-TestShelveInstance-546397589 tempest-TestShelveInstance-546397589-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:42:44.146112 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-5d94782e-eb45-495d-8ea6-3a1755fdaee7 tempest-TestShelveInstance-546397589 tempest-TestShelveInstance-546397589-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:42:44.210746 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.policy [None req-5d94782e-eb45-495d-8ea6-3a1755fdaee7 tempest-TestShelveInstance-546397589 tempest-TestShelveInstance-546397589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d9bf2dcfce24386a1aaf9709d88da45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1f2f503ef674a4b97f848b69f8b63c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129322) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:42:44.219490 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: INFO nova.api.openstack.requestlog [None req-5d94782e-eb45-495d-8ea6-3a1755fdaee7 tempest-TestShelveInstance-546397589 tempest-TestShelveInstance-546397589-project] 10.222.0.75 "GET /compute/v2.1/servers/05cf529d-df00-4ff9-b0d2-0e27563d2861" status: 200 len: 1129 microversion: 2.1 time: 0.086378 May 26 12:42:44.223583 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: [pid: 129322|app: 0|req: 256/491] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 26 12:42:44 2022] GET /compute/v2.1/servers/05cf529d-df00-4ff9-b0d2-0e27563d2861 => generated 1129 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 12:42:44.262110 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.policy [None req-ca3a8f72-5be4-456d-a49e-b0f4b13cb905 tempest-VolumesActionsTest-731506124 tempest-VolumesActionsTest-731506124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f39e076a9e6b401db6de9a2846519591', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa93879e60e470185e8dd71efaaf1a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129321) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:42:44.273675 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: INFO nova.api.openstack.requestlog [None req-ca3a8f72-5be4-456d-a49e-b0f4b13cb905 tempest-VolumesActionsTest-731506124 tempest-VolumesActionsTest-731506124-project] 10.222.0.75 "GET /compute/v2.1/servers/2be10a9b-0300-40be-96eb-602b1ad4b05c" status: 200 len: 1504 microversion: 2.1 time: 0.169786 May 26 12:42:44.274617 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: [pid: 129321|app: 0|req: 236/492] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 26 12:42:44 2022] GET /compute/v2.1/servers/2be10a9b-0300-40be-96eb-602b1ad4b05c => generated 1504 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:42:44.423908 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi [None req-7b2af68a-f94d-4d6b-b1fe-2ef454a5de0e tempest-VolumesSnapshotTestJSON-1904508205 tempest-VolumesSnapshotTestJSON-1904508205-project] Calling method '>' {{(pid=129322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:42:44.424788 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.compute.api [None req-7b2af68a-f94d-4d6b-b1fe-2ef454a5de0e tempest-VolumesSnapshotTestJSON-1904508205 tempest-VolumesSnapshotTestJSON-1904508205-project] [instance: f392ba2b-2b88-4b1a-be61-0cf28ed1443a] Fetching instance by UUID {{(pid=129322) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:42:44.431975 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-7b2af68a-f94d-4d6b-b1fe-2ef454a5de0e tempest-VolumesSnapshotTestJSON-1904508205 tempest-VolumesSnapshotTestJSON-1904508205-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:42:44.432171 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-7b2af68a-f94d-4d6b-b1fe-2ef454a5de0e tempest-VolumesSnapshotTestJSON-1904508205 tempest-VolumesSnapshotTestJSON-1904508205-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:42:44.432997 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-7b2af68a-f94d-4d6b-b1fe-2ef454a5de0e tempest-VolumesSnapshotTestJSON-1904508205 tempest-VolumesSnapshotTestJSON-1904508205-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:42:44.433592 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-7b2af68a-f94d-4d6b-b1fe-2ef454a5de0e tempest-VolumesSnapshotTestJSON-1904508205 tempest-VolumesSnapshotTestJSON-1904508205-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:42:44.608117 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.policy [None req-7b2af68a-f94d-4d6b-b1fe-2ef454a5de0e tempest-VolumesSnapshotTestJSON-1904508205 tempest-VolumesSnapshotTestJSON-1904508205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '805854e5ce2e412fb9420afd63f73ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72bda4cbb07a43688506e01d06ba89c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129322) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:42:44.618390 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: INFO nova.api.openstack.requestlog [None req-7b2af68a-f94d-4d6b-b1fe-2ef454a5de0e tempest-VolumesSnapshotTestJSON-1904508205 tempest-VolumesSnapshotTestJSON-1904508205-project] 10.222.0.75 "GET /compute/v2.1/servers/f392ba2b-2b88-4b1a-be61-0cf28ed1443a" status: 200 len: 1513 microversion: 2.1 time: 0.199866 May 26 12:42:44.619086 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: [pid: 129322|app: 0|req: 257/493] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 26 12:42:44 2022] GET /compute/v2.1/servers/f392ba2b-2b88-4b1a-be61-0cf28ed1443a => generated 1513 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:42:44.834324 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi [None req-996a5324-560b-4db1-bff7-7ef622de6354 tempest-TestMinimumBasicScenario-102576986 tempest-TestMinimumBasicScenario-102576986-project] Calling method '>' {{(pid=129321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:42:44.834925 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.compute.api [None req-996a5324-560b-4db1-bff7-7ef622de6354 tempest-TestMinimumBasicScenario-102576986 tempest-TestMinimumBasicScenario-102576986-project] [instance: 76661008-e6d3-4646-a9ba-d5d0e83a4b65] Fetching instance by UUID {{(pid=129321) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:42:44.841362 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-996a5324-560b-4db1-bff7-7ef622de6354 tempest-TestMinimumBasicScenario-102576986 tempest-TestMinimumBasicScenario-102576986-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:42:44.841797 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-996a5324-560b-4db1-bff7-7ef622de6354 tempest-TestMinimumBasicScenario-102576986 tempest-TestMinimumBasicScenario-102576986-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:42:44.842701 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-996a5324-560b-4db1-bff7-7ef622de6354 tempest-TestMinimumBasicScenario-102576986 tempest-TestMinimumBasicScenario-102576986-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:42:44.843065 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-996a5324-560b-4db1-bff7-7ef622de6354 tempest-TestMinimumBasicScenario-102576986 tempest-TestMinimumBasicScenario-102576986-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:42:44.986253 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.policy [None req-996a5324-560b-4db1-bff7-7ef622de6354 tempest-TestMinimumBasicScenario-102576986 tempest-TestMinimumBasicScenario-102576986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0352a80bdc174b9a9df4eca60b81eba4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fa2c4d6423444e487d259062656129b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129321) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:42:44.998054 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: INFO nova.api.openstack.requestlog [None req-996a5324-560b-4db1-bff7-7ef622de6354 tempest-TestMinimumBasicScenario-102576986 tempest-TestMinimumBasicScenario-102576986-project] 10.222.0.75 "GET /compute/v2.1/servers/76661008-e6d3-4646-a9ba-d5d0e83a4b65" status: 200 len: 1357 microversion: 2.1 time: 0.167383 May 26 12:42:44.999263 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: [pid: 129321|app: 0|req: 237/494] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 26 12:42:44 2022] GET /compute/v2.1/servers/76661008-e6d3-4646-a9ba-d5d0e83a4b65 => generated 1357 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:42:45.061431 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi [None req-91a40b10-1cfb-48fc-add9-75de2651dba0 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Calling method '>' {{(pid=129322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:42:45.063169 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.compute.api [None req-91a40b10-1cfb-48fc-add9-75de2651dba0 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] [instance: bf2f6303-22b9-4cfa-8d4d-61d2503bc554] Fetching instance by UUID {{(pid=129322) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:42:45.071757 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-91a40b10-1cfb-48fc-add9-75de2651dba0 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:42:45.072209 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-91a40b10-1cfb-48fc-add9-75de2651dba0 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:42:45.072965 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-91a40b10-1cfb-48fc-add9-75de2651dba0 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:42:45.073391 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-91a40b10-1cfb-48fc-add9-75de2651dba0 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:42:45.219991 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.policy [None req-91a40b10-1cfb-48fc-add9-75de2651dba0 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e811736979c44b02b14fecb74c6bd7ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675272fb40d4847819f83ec04afecef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129322) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:42:45.228712 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.policy [None req-91a40b10-1cfb-48fc-add9-75de2651dba0 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e811736979c44b02b14fecb74c6bd7ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675272fb40d4847819f83ec04afecef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129322) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:42:45.230246 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.policy [None req-91a40b10-1cfb-48fc-add9-75de2651dba0 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e811736979c44b02b14fecb74c6bd7ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675272fb40d4847819f83ec04afecef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129322) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:42:45.231436 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: INFO nova.api.openstack.requestlog [None req-91a40b10-1cfb-48fc-add9-75de2651dba0 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] 10.222.0.75 "GET /compute/v2.1/servers/bf2f6303-22b9-4cfa-8d4d-61d2503bc554" status: 200 len: 1725 microversion: 2.20 time: 0.176353 May 26 12:42:45.231998 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: [pid: 129322|app: 0|req: 258/495] 10.222.0.75 () {60 vars in 1276 bytes} [Thu May 26 12:42:45 2022] GET /compute/v2.1/servers/bf2f6303-22b9-4cfa-8d4d-61d2503bc554 => generated 1725 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 12:42:45.237600 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi [None req-61adb122-6476-4204-9794-c7051aa1b68f tempest-TestShelveInstance-546397589 tempest-TestShelveInstance-546397589-project] Calling method '>' {{(pid=129321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:42:45.238218 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.compute.api [None req-61adb122-6476-4204-9794-c7051aa1b68f tempest-TestShelveInstance-546397589 tempest-TestShelveInstance-546397589-project] [instance: 05cf529d-df00-4ff9-b0d2-0e27563d2861] Fetching instance by UUID {{(pid=129321) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:42:45.245423 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-61adb122-6476-4204-9794-c7051aa1b68f tempest-TestShelveInstance-546397589 tempest-TestShelveInstance-546397589-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:42:45.246113 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-61adb122-6476-4204-9794-c7051aa1b68f tempest-TestShelveInstance-546397589 tempest-TestShelveInstance-546397589-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:42:45.247345 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-61adb122-6476-4204-9794-c7051aa1b68f tempest-TestShelveInstance-546397589 tempest-TestShelveInstance-546397589-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:42:45.248070 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-61adb122-6476-4204-9794-c7051aa1b68f tempest-TestShelveInstance-546397589 tempest-TestShelveInstance-546397589-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:42:45.297073 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi [None req-a734cca8-6d68-4197-8a0f-8488499258c3 tempest-VolumesActionsTest-731506124 tempest-VolumesActionsTest-731506124-project] Calling method '>' {{(pid=129322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:42:45.297962 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.compute.api [None req-a734cca8-6d68-4197-8a0f-8488499258c3 tempest-VolumesActionsTest-731506124 tempest-VolumesActionsTest-731506124-project] [instance: 2be10a9b-0300-40be-96eb-602b1ad4b05c] Fetching instance by UUID {{(pid=129322) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:42:45.309543 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-a734cca8-6d68-4197-8a0f-8488499258c3 tempest-VolumesActionsTest-731506124 tempest-VolumesActionsTest-731506124-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:42:45.310281 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-a734cca8-6d68-4197-8a0f-8488499258c3 tempest-VolumesActionsTest-731506124 tempest-VolumesActionsTest-731506124-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:42:45.311881 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-a734cca8-6d68-4197-8a0f-8488499258c3 tempest-VolumesActionsTest-731506124 tempest-VolumesActionsTest-731506124-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:42:45.312215 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-a734cca8-6d68-4197-8a0f-8488499258c3 tempest-VolumesActionsTest-731506124 tempest-VolumesActionsTest-731506124-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:42:45.333227 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.policy [None req-61adb122-6476-4204-9794-c7051aa1b68f tempest-TestShelveInstance-546397589 tempest-TestShelveInstance-546397589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d9bf2dcfce24386a1aaf9709d88da45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1f2f503ef674a4b97f848b69f8b63c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129321) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:42:45.341150 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: INFO nova.api.openstack.requestlog [None req-61adb122-6476-4204-9794-c7051aa1b68f tempest-TestShelveInstance-546397589 tempest-TestShelveInstance-546397589-project] 10.222.0.75 "GET /compute/v2.1/servers/05cf529d-df00-4ff9-b0d2-0e27563d2861" status: 200 len: 1129 microversion: 2.1 time: 0.107636 May 26 12:42:45.341738 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: [pid: 129321|app: 0|req: 238/496] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 26 12:42:45 2022] GET /compute/v2.1/servers/05cf529d-df00-4ff9-b0d2-0e27563d2861 => generated 1129 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:42:45.451173 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.policy [None req-a734cca8-6d68-4197-8a0f-8488499258c3 tempest-VolumesActionsTest-731506124 tempest-VolumesActionsTest-731506124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f39e076a9e6b401db6de9a2846519591', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa93879e60e470185e8dd71efaaf1a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129322) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:42:45.459318 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: INFO nova.api.openstack.requestlog [None req-a734cca8-6d68-4197-8a0f-8488499258c3 tempest-VolumesActionsTest-731506124 tempest-VolumesActionsTest-731506124-project] 10.222.0.75 "GET /compute/v2.1/servers/2be10a9b-0300-40be-96eb-602b1ad4b05c" status: 200 len: 1504 microversion: 2.1 time: 0.169944 May 26 12:42:45.459914 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: [pid: 129322|app: 0|req: 259/497] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 26 12:42:45 2022] GET /compute/v2.1/servers/2be10a9b-0300-40be-96eb-602b1ad4b05c => generated 1504 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 12:42:45.637162 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi [None req-25a94538-54e9-4112-9a75-276992ad035d tempest-VolumesSnapshotTestJSON-1904508205 tempest-VolumesSnapshotTestJSON-1904508205-project] Calling method '>' {{(pid=129321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:42:45.637714 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.compute.api [None req-25a94538-54e9-4112-9a75-276992ad035d tempest-VolumesSnapshotTestJSON-1904508205 tempest-VolumesSnapshotTestJSON-1904508205-project] [instance: f392ba2b-2b88-4b1a-be61-0cf28ed1443a] Fetching instance by UUID {{(pid=129321) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:42:45.644561 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-25a94538-54e9-4112-9a75-276992ad035d tempest-VolumesSnapshotTestJSON-1904508205 tempest-VolumesSnapshotTestJSON-1904508205-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:42:45.645002 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-25a94538-54e9-4112-9a75-276992ad035d tempest-VolumesSnapshotTestJSON-1904508205 tempest-VolumesSnapshotTestJSON-1904508205-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:42:45.645764 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-25a94538-54e9-4112-9a75-276992ad035d tempest-VolumesSnapshotTestJSON-1904508205 tempest-VolumesSnapshotTestJSON-1904508205-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:42:45.646185 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-25a94538-54e9-4112-9a75-276992ad035d tempest-VolumesSnapshotTestJSON-1904508205 tempest-VolumesSnapshotTestJSON-1904508205-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:42:45.788979 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.policy [None req-25a94538-54e9-4112-9a75-276992ad035d tempest-VolumesSnapshotTestJSON-1904508205 tempest-VolumesSnapshotTestJSON-1904508205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '805854e5ce2e412fb9420afd63f73ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72bda4cbb07a43688506e01d06ba89c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129321) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:42:45.800169 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: INFO nova.api.openstack.requestlog [None req-25a94538-54e9-4112-9a75-276992ad035d tempest-VolumesSnapshotTestJSON-1904508205 tempest-VolumesSnapshotTestJSON-1904508205-project] 10.222.0.75 "GET /compute/v2.1/servers/f392ba2b-2b88-4b1a-be61-0cf28ed1443a" status: 200 len: 1513 microversion: 2.1 time: 0.167029 May 26 12:42:45.800771 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: [pid: 129321|app: 0|req: 239/498] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 26 12:42:45 2022] GET /compute/v2.1/servers/f392ba2b-2b88-4b1a-be61-0cf28ed1443a => generated 1513 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:42:46.022993 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi [None req-de2c5405-cde1-49c0-9702-3dd299c758ed tempest-TestMinimumBasicScenario-102576986 tempest-TestMinimumBasicScenario-102576986-project] Calling method '>' {{(pid=129322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:42:46.024575 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.compute.api [None req-de2c5405-cde1-49c0-9702-3dd299c758ed tempest-TestMinimumBasicScenario-102576986 tempest-TestMinimumBasicScenario-102576986-project] [instance: 76661008-e6d3-4646-a9ba-d5d0e83a4b65] Fetching instance by UUID {{(pid=129322) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:42:46.034664 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-de2c5405-cde1-49c0-9702-3dd299c758ed tempest-TestMinimumBasicScenario-102576986 tempest-TestMinimumBasicScenario-102576986-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:42:46.047912 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-de2c5405-cde1-49c0-9702-3dd299c758ed tempest-TestMinimumBasicScenario-102576986 tempest-TestMinimumBasicScenario-102576986-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:42:46.049249 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-de2c5405-cde1-49c0-9702-3dd299c758ed tempest-TestMinimumBasicScenario-102576986 tempest-TestMinimumBasicScenario-102576986-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:42:46.049783 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-de2c5405-cde1-49c0-9702-3dd299c758ed tempest-TestMinimumBasicScenario-102576986 tempest-TestMinimumBasicScenario-102576986-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:42:46.212129 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.policy [None req-de2c5405-cde1-49c0-9702-3dd299c758ed tempest-TestMinimumBasicScenario-102576986 tempest-TestMinimumBasicScenario-102576986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0352a80bdc174b9a9df4eca60b81eba4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fa2c4d6423444e487d259062656129b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129322) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:42:46.221926 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: INFO nova.api.openstack.requestlog [None req-de2c5405-cde1-49c0-9702-3dd299c758ed tempest-TestMinimumBasicScenario-102576986 tempest-TestMinimumBasicScenario-102576986-project] 10.222.0.75 "GET /compute/v2.1/servers/76661008-e6d3-4646-a9ba-d5d0e83a4b65" status: 200 len: 1357 microversion: 2.1 time: 0.205160 May 26 12:42:46.222497 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: [pid: 129322|app: 0|req: 260/499] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 26 12:42:46 2022] GET /compute/v2.1/servers/76661008-e6d3-4646-a9ba-d5d0e83a4b65 => generated 1357 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:42:46.250532 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi [None req-51cc679d-945c-453d-a4c7-1bd7fb72cf87 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Calling method '>' {{(pid=129321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:42:46.251138 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.compute.api [None req-51cc679d-945c-453d-a4c7-1bd7fb72cf87 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] [instance: bf2f6303-22b9-4cfa-8d4d-61d2503bc554] Fetching instance by UUID {{(pid=129321) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:42:46.257861 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-51cc679d-945c-453d-a4c7-1bd7fb72cf87 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:42:46.258302 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-51cc679d-945c-453d-a4c7-1bd7fb72cf87 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:42:46.259025 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-51cc679d-945c-453d-a4c7-1bd7fb72cf87 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:42:46.259484 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-51cc679d-945c-453d-a4c7-1bd7fb72cf87 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:42:46.359054 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi [None req-1a20ee7e-1b32-4cbb-9bc3-6bf1fd37348f tempest-TestShelveInstance-546397589 tempest-TestShelveInstance-546397589-project] Calling method '>' {{(pid=129322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:42:46.360150 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.compute.api [None req-1a20ee7e-1b32-4cbb-9bc3-6bf1fd37348f tempest-TestShelveInstance-546397589 tempest-TestShelveInstance-546397589-project] [instance: 05cf529d-df00-4ff9-b0d2-0e27563d2861] Fetching instance by UUID {{(pid=129322) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:42:46.367273 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-1a20ee7e-1b32-4cbb-9bc3-6bf1fd37348f tempest-TestShelveInstance-546397589 tempest-TestShelveInstance-546397589-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:42:46.367783 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-1a20ee7e-1b32-4cbb-9bc3-6bf1fd37348f tempest-TestShelveInstance-546397589 tempest-TestShelveInstance-546397589-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:42:46.368650 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-1a20ee7e-1b32-4cbb-9bc3-6bf1fd37348f tempest-TestShelveInstance-546397589 tempest-TestShelveInstance-546397589-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:42:46.369115 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-1a20ee7e-1b32-4cbb-9bc3-6bf1fd37348f tempest-TestShelveInstance-546397589 tempest-TestShelveInstance-546397589-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:42:46.436863 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.policy [None req-1a20ee7e-1b32-4cbb-9bc3-6bf1fd37348f tempest-TestShelveInstance-546397589 tempest-TestShelveInstance-546397589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d9bf2dcfce24386a1aaf9709d88da45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1f2f503ef674a4b97f848b69f8b63c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129322) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:42:46.444979 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: INFO nova.api.openstack.requestlog [None req-1a20ee7e-1b32-4cbb-9bc3-6bf1fd37348f tempest-TestShelveInstance-546397589 tempest-TestShelveInstance-546397589-project] 10.222.0.75 "GET /compute/v2.1/servers/05cf529d-df00-4ff9-b0d2-0e27563d2861" status: 200 len: 1185 microversion: 2.1 time: 0.090452 May 26 12:42:46.445584 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: [pid: 129322|app: 0|req: 261/500] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 26 12:42:46 2022] GET /compute/v2.1/servers/05cf529d-df00-4ff9-b0d2-0e27563d2861 => generated 1185 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:42:46.447164 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.policy [None req-51cc679d-945c-453d-a4c7-1bd7fb72cf87 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e811736979c44b02b14fecb74c6bd7ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675272fb40d4847819f83ec04afecef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129321) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:42:46.455240 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.policy [None req-51cc679d-945c-453d-a4c7-1bd7fb72cf87 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e811736979c44b02b14fecb74c6bd7ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675272fb40d4847819f83ec04afecef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129321) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:42:46.456766 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.policy [None req-51cc679d-945c-453d-a4c7-1bd7fb72cf87 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e811736979c44b02b14fecb74c6bd7ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675272fb40d4847819f83ec04afecef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129321) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:42:46.457978 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: INFO nova.api.openstack.requestlog [None req-51cc679d-945c-453d-a4c7-1bd7fb72cf87 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] 10.222.0.75 "GET /compute/v2.1/servers/bf2f6303-22b9-4cfa-8d4d-61d2503bc554" status: 200 len: 1725 microversion: 2.20 time: 0.211492 May 26 12:42:46.458538 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: [pid: 129321|app: 0|req: 240/501] 10.222.0.75 () {60 vars in 1276 bytes} [Thu May 26 12:42:46 2022] GET /compute/v2.1/servers/bf2f6303-22b9-4cfa-8d4d-61d2503bc554 => generated 1725 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 12:42:46.477295 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi [None req-884c086b-a1b7-4ac7-87ce-af7393e50c33 tempest-VolumesActionsTest-731506124 tempest-VolumesActionsTest-731506124-project] Calling method '>' {{(pid=129322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:42:46.478433 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.compute.api [None req-884c086b-a1b7-4ac7-87ce-af7393e50c33 tempest-VolumesActionsTest-731506124 tempest-VolumesActionsTest-731506124-project] [instance: 2be10a9b-0300-40be-96eb-602b1ad4b05c] Fetching instance by UUID {{(pid=129322) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:42:46.485567 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-884c086b-a1b7-4ac7-87ce-af7393e50c33 tempest-VolumesActionsTest-731506124 tempest-VolumesActionsTest-731506124-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:42:46.486014 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-884c086b-a1b7-4ac7-87ce-af7393e50c33 tempest-VolumesActionsTest-731506124 tempest-VolumesActionsTest-731506124-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:42:46.486821 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-884c086b-a1b7-4ac7-87ce-af7393e50c33 tempest-VolumesActionsTest-731506124 tempest-VolumesActionsTest-731506124-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:42:46.487229 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-884c086b-a1b7-4ac7-87ce-af7393e50c33 tempest-VolumesActionsTest-731506124 tempest-VolumesActionsTest-731506124-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:42:46.642958 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.policy [None req-884c086b-a1b7-4ac7-87ce-af7393e50c33 tempest-VolumesActionsTest-731506124 tempest-VolumesActionsTest-731506124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f39e076a9e6b401db6de9a2846519591', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa93879e60e470185e8dd71efaaf1a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129322) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:42:46.657794 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: INFO nova.api.openstack.requestlog [None req-884c086b-a1b7-4ac7-87ce-af7393e50c33 tempest-VolumesActionsTest-731506124 tempest-VolumesActionsTest-731506124-project] 10.222.0.75 "GET /compute/v2.1/servers/2be10a9b-0300-40be-96eb-602b1ad4b05c" status: 200 len: 1504 microversion: 2.1 time: 0.183768 May 26 12:42:46.658778 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: [pid: 129322|app: 0|req: 262/502] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 26 12:42:46 2022] GET /compute/v2.1/servers/2be10a9b-0300-40be-96eb-602b1ad4b05c => generated 1504 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:42:46.821830 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi [None req-96246f97-6f56-4646-ac92-a50db22035c6 tempest-VolumesSnapshotTestJSON-1904508205 tempest-VolumesSnapshotTestJSON-1904508205-project] Calling method '>' {{(pid=129321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:42:46.823996 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.compute.api [None req-96246f97-6f56-4646-ac92-a50db22035c6 tempest-VolumesSnapshotTestJSON-1904508205 tempest-VolumesSnapshotTestJSON-1904508205-project] [instance: f392ba2b-2b88-4b1a-be61-0cf28ed1443a] Fetching instance by UUID {{(pid=129321) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:42:46.834643 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-96246f97-6f56-4646-ac92-a50db22035c6 tempest-VolumesSnapshotTestJSON-1904508205 tempest-VolumesSnapshotTestJSON-1904508205-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:42:46.835374 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-96246f97-6f56-4646-ac92-a50db22035c6 tempest-VolumesSnapshotTestJSON-1904508205 tempest-VolumesSnapshotTestJSON-1904508205-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:42:46.836603 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-96246f97-6f56-4646-ac92-a50db22035c6 tempest-VolumesSnapshotTestJSON-1904508205 tempest-VolumesSnapshotTestJSON-1904508205-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:42:46.837244 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-96246f97-6f56-4646-ac92-a50db22035c6 tempest-VolumesSnapshotTestJSON-1904508205 tempest-VolumesSnapshotTestJSON-1904508205-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:42:47.199033 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi [req-cd7890e5-8db3-40f8-a5ef-66b15c467354 req-51a7c8c8-c6dd-4eb3-bd28-4e55bb3cb0dd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f392ba2b-2b88-4b1a-be61-0cf28ed1443a", "name": "network-vif-deleted", "tag": "10bca8e7-0bd1-4264-811e-ec4cb5f9c2bd"}]} {{(pid=129322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 12:42:47.209869 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [req-cd7890e5-8db3-40f8-a5ef-66b15c467354 req-51a7c8c8-c6dd-4eb3-bd28-4e55bb3cb0dd service nova] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:42:47.210537 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [req-cd7890e5-8db3-40f8-a5ef-66b15c467354 req-51a7c8c8-c6dd-4eb3-bd28-4e55bb3cb0dd service nova] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:42:47.223256 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: INFO nova.api.openstack.compute.server_external_events [req-cd7890e5-8db3-40f8-a5ef-66b15c467354 req-51a7c8c8-c6dd-4eb3-bd28-4e55bb3cb0dd service nova] Creating event network-vif-deleted:10bca8e7-0bd1-4264-811e-ec4cb5f9c2bd for instance f392ba2b-2b88-4b1a-be61-0cf28ed1443a on hv-cinder-81966 May 26 12:42:47.228336 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: INFO nova.api.openstack.requestlog [req-cd7890e5-8db3-40f8-a5ef-66b15c467354 req-51a7c8c8-c6dd-4eb3-bd28-4e55bb3cb0dd service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032994 May 26 12:42:47.229254 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: [pid: 129322|app: 0|req: 263/503] 10.222.0.75 () {64 vars in 1317 bytes} [Thu May 26 12:42:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 12:42:47.239279 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi [None req-1a4f7aa6-cda9-4645-b3d1-141c4988b4ed tempest-TestMinimumBasicScenario-102576986 tempest-TestMinimumBasicScenario-102576986-project] Calling method '>' {{(pid=129322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:42:47.240110 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.compute.api [None req-1a4f7aa6-cda9-4645-b3d1-141c4988b4ed tempest-TestMinimumBasicScenario-102576986 tempest-TestMinimumBasicScenario-102576986-project] [instance: 76661008-e6d3-4646-a9ba-d5d0e83a4b65] Fetching instance by UUID {{(pid=129322) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:42:47.247301 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-1a4f7aa6-cda9-4645-b3d1-141c4988b4ed tempest-TestMinimumBasicScenario-102576986 tempest-TestMinimumBasicScenario-102576986-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:42:47.247803 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-1a4f7aa6-cda9-4645-b3d1-141c4988b4ed tempest-TestMinimumBasicScenario-102576986 tempest-TestMinimumBasicScenario-102576986-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:42:47.248555 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-1a4f7aa6-cda9-4645-b3d1-141c4988b4ed tempest-TestMinimumBasicScenario-102576986 tempest-TestMinimumBasicScenario-102576986-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:42:47.249238 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-1a4f7aa6-cda9-4645-b3d1-141c4988b4ed tempest-TestMinimumBasicScenario-102576986 tempest-TestMinimumBasicScenario-102576986-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:42:47.395899 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.policy [None req-1a4f7aa6-cda9-4645-b3d1-141c4988b4ed tempest-TestMinimumBasicScenario-102576986 tempest-TestMinimumBasicScenario-102576986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0352a80bdc174b9a9df4eca60b81eba4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fa2c4d6423444e487d259062656129b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129322) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:42:47.410564 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: INFO nova.api.openstack.requestlog [None req-1a4f7aa6-cda9-4645-b3d1-141c4988b4ed tempest-TestMinimumBasicScenario-102576986 tempest-TestMinimumBasicScenario-102576986-project] 10.222.0.75 "GET /compute/v2.1/servers/76661008-e6d3-4646-a9ba-d5d0e83a4b65" status: 200 len: 1357 microversion: 2.1 time: 0.175510 May 26 12:42:47.411844 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: [pid: 129322|app: 0|req: 264/504] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 26 12:42:47 2022] GET /compute/v2.1/servers/76661008-e6d3-4646-a9ba-d5d0e83a4b65 => generated 1357 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 12:42:47.466471 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi [None req-8b4d7726-8c48-490c-9f1a-e93b78083d6e tempest-TestShelveInstance-546397589 tempest-TestShelveInstance-546397589-project] Calling method '>' {{(pid=129322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:42:47.467730 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.compute.api [None req-8b4d7726-8c48-490c-9f1a-e93b78083d6e tempest-TestShelveInstance-546397589 tempest-TestShelveInstance-546397589-project] [instance: 05cf529d-df00-4ff9-b0d2-0e27563d2861] Fetching instance by UUID {{(pid=129322) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:42:47.478166 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-8b4d7726-8c48-490c-9f1a-e93b78083d6e tempest-TestShelveInstance-546397589 tempest-TestShelveInstance-546397589-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:42:47.478915 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-8b4d7726-8c48-490c-9f1a-e93b78083d6e tempest-TestShelveInstance-546397589 tempest-TestShelveInstance-546397589-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:42:47.479958 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-8b4d7726-8c48-490c-9f1a-e93b78083d6e tempest-TestShelveInstance-546397589 tempest-TestShelveInstance-546397589-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:42:47.480546 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-8b4d7726-8c48-490c-9f1a-e93b78083d6e tempest-TestShelveInstance-546397589 tempest-TestShelveInstance-546397589-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:42:47.552572 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.policy [None req-8b4d7726-8c48-490c-9f1a-e93b78083d6e tempest-TestShelveInstance-546397589 tempest-TestShelveInstance-546397589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d9bf2dcfce24386a1aaf9709d88da45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1f2f503ef674a4b97f848b69f8b63c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129322) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:42:47.560311 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: INFO nova.api.openstack.requestlog [None req-8b4d7726-8c48-490c-9f1a-e93b78083d6e tempest-TestShelveInstance-546397589 tempest-TestShelveInstance-546397589-project] 10.222.0.75 "GET /compute/v2.1/servers/05cf529d-df00-4ff9-b0d2-0e27563d2861" status: 200 len: 1203 microversion: 2.1 time: 0.100458 May 26 12:42:47.560907 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: [pid: 129322|app: 0|req: 265/505] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 26 12:42:47 2022] GET /compute/v2.1/servers/05cf529d-df00-4ff9-b0d2-0e27563d2861 => generated 1203 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:42:47.565904 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi [None req-62f8d6e7-03d3-4769-8606-e0ef9f26f1ac tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Calling method '>' {{(pid=129322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:42:47.566620 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.compute.api [None req-62f8d6e7-03d3-4769-8606-e0ef9f26f1ac tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] [instance: bf2f6303-22b9-4cfa-8d4d-61d2503bc554] Fetching instance by UUID {{(pid=129322) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:42:47.574378 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-62f8d6e7-03d3-4769-8606-e0ef9f26f1ac tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:42:47.574819 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-62f8d6e7-03d3-4769-8606-e0ef9f26f1ac tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:42:47.576354 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-62f8d6e7-03d3-4769-8606-e0ef9f26f1ac tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:42:47.577269 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-62f8d6e7-03d3-4769-8606-e0ef9f26f1ac tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:42:47.742088 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.policy [None req-62f8d6e7-03d3-4769-8606-e0ef9f26f1ac tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e811736979c44b02b14fecb74c6bd7ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675272fb40d4847819f83ec04afecef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129322) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:42:47.751201 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.policy [None req-62f8d6e7-03d3-4769-8606-e0ef9f26f1ac tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e811736979c44b02b14fecb74c6bd7ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675272fb40d4847819f83ec04afecef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129322) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:42:47.751368 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.policy [None req-96246f97-6f56-4646-ac92-a50db22035c6 tempest-VolumesSnapshotTestJSON-1904508205 tempest-VolumesSnapshotTestJSON-1904508205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '805854e5ce2e412fb9420afd63f73ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72bda4cbb07a43688506e01d06ba89c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129321) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:42:47.753655 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.policy [None req-62f8d6e7-03d3-4769-8606-e0ef9f26f1ac tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e811736979c44b02b14fecb74c6bd7ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675272fb40d4847819f83ec04afecef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129322) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:42:47.755067 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: INFO nova.api.openstack.requestlog [None req-62f8d6e7-03d3-4769-8606-e0ef9f26f1ac tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] 10.222.0.75 "GET /compute/v2.1/servers/bf2f6303-22b9-4cfa-8d4d-61d2503bc554" status: 200 len: 1725 microversion: 2.20 time: 0.192960 May 26 12:42:47.755910 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: [pid: 129322|app: 0|req: 266/506] 10.222.0.75 () {60 vars in 1276 bytes} [Thu May 26 12:42:47 2022] GET /compute/v2.1/servers/bf2f6303-22b9-4cfa-8d4d-61d2503bc554 => generated 1725 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 12:42:47.760974 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: INFO nova.api.openstack.requestlog [None req-96246f97-6f56-4646-ac92-a50db22035c6 tempest-VolumesSnapshotTestJSON-1904508205 tempest-VolumesSnapshotTestJSON-1904508205-project] 10.222.0.75 "GET /compute/v2.1/servers/f392ba2b-2b88-4b1a-be61-0cf28ed1443a" status: 200 len: 1513 microversion: 2.1 time: 0.945868 May 26 12:42:47.761600 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi [req-1ba76084-5de4-4860-883e-41861d49b3f9 req-834c2b70-10de-41a7-9f91-a2aad77d2006 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2be10a9b-0300-40be-96eb-602b1ad4b05c", "name": "network-vif-unplugged", "status": "completed", "tag": "e3e9d691-3b6e-416b-a1d1-d3fb6069ade1"}]} {{(pid=129322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 12:42:47.763399 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: [pid: 129321|app: 0|req: 241/507] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 26 12:42:46 2022] GET /compute/v2.1/servers/f392ba2b-2b88-4b1a-be61-0cf28ed1443a => generated 1513 bytes in 950 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 12:42:47.770597 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi [None req-4ab05d50-f075-459e-a343-73eb1e2fe11c tempest-VolumesActionsTest-731506124 tempest-VolumesActionsTest-731506124-project] Calling method '>' {{(pid=129321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:42:47.772293 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.compute.api [None req-4ab05d50-f075-459e-a343-73eb1e2fe11c tempest-VolumesActionsTest-731506124 tempest-VolumesActionsTest-731506124-project] [instance: 2be10a9b-0300-40be-96eb-602b1ad4b05c] Fetching instance by UUID {{(pid=129321) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:42:47.779081 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [req-1ba76084-5de4-4860-883e-41861d49b3f9 req-834c2b70-10de-41a7-9f91-a2aad77d2006 service nova] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:42:47.780076 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [req-1ba76084-5de4-4860-883e-41861d49b3f9 req-834c2b70-10de-41a7-9f91-a2aad77d2006 service nova] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:42:47.781575 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-4ab05d50-f075-459e-a343-73eb1e2fe11c tempest-VolumesActionsTest-731506124 tempest-VolumesActionsTest-731506124-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:42:47.782182 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-4ab05d50-f075-459e-a343-73eb1e2fe11c tempest-VolumesActionsTest-731506124 tempest-VolumesActionsTest-731506124-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:42:47.782964 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-4ab05d50-f075-459e-a343-73eb1e2fe11c tempest-VolumesActionsTest-731506124 tempest-VolumesActionsTest-731506124-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:42:47.783583 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-4ab05d50-f075-459e-a343-73eb1e2fe11c tempest-VolumesActionsTest-731506124 tempest-VolumesActionsTest-731506124-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:42:47.809888 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: INFO nova.api.openstack.compute.server_external_events [req-1ba76084-5de4-4860-883e-41861d49b3f9 req-834c2b70-10de-41a7-9f91-a2aad77d2006 service nova] Creating event network-vif-unplugged:e3e9d691-3b6e-416b-a1d1-d3fb6069ade1 for instance 2be10a9b-0300-40be-96eb-602b1ad4b05c on hv-cinder-81966 May 26 12:42:47.823077 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: INFO nova.api.openstack.requestlog [req-1ba76084-5de4-4860-883e-41861d49b3f9 req-834c2b70-10de-41a7-9f91-a2aad77d2006 service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.065473 May 26 12:42:47.824457 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: [pid: 129322|app: 0|req: 267/508] 10.222.0.75 () {64 vars in 1317 bytes} [Thu May 26 12:42:47 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 12:42:48.078373 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.policy [None req-4ab05d50-f075-459e-a343-73eb1e2fe11c tempest-VolumesActionsTest-731506124 tempest-VolumesActionsTest-731506124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f39e076a9e6b401db6de9a2846519591', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa93879e60e470185e8dd71efaaf1a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129321) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:42:48.086337 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: INFO nova.api.openstack.requestlog [None req-4ab05d50-f075-459e-a343-73eb1e2fe11c tempest-VolumesActionsTest-731506124 tempest-VolumesActionsTest-731506124-project] 10.222.0.75 "GET /compute/v2.1/servers/2be10a9b-0300-40be-96eb-602b1ad4b05c" status: 200 len: 1504 microversion: 2.1 time: 0.321860 May 26 12:42:48.086936 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: [pid: 129321|app: 0|req: 242/509] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 26 12:42:47 2022] GET /compute/v2.1/servers/2be10a9b-0300-40be-96eb-602b1ad4b05c => generated 1504 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:42:48.287061 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi [req-e3123f91-e892-4d84-8a73-30f044a1e266 req-5bc9874d-da11-4ffd-8360-f876f154cbfa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2be10a9b-0300-40be-96eb-602b1ad4b05c", "name": "network-vif-deleted", "tag": "e3e9d691-3b6e-416b-a1d1-d3fb6069ade1"}]} {{(pid=129322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 12:42:48.296013 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [req-e3123f91-e892-4d84-8a73-30f044a1e266 req-5bc9874d-da11-4ffd-8360-f876f154cbfa service nova] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:42:48.296426 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [req-e3123f91-e892-4d84-8a73-30f044a1e266 req-5bc9874d-da11-4ffd-8360-f876f154cbfa service nova] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:42:48.307663 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: INFO nova.api.openstack.compute.server_external_events [req-e3123f91-e892-4d84-8a73-30f044a1e266 req-5bc9874d-da11-4ffd-8360-f876f154cbfa service nova] Creating event network-vif-deleted:e3e9d691-3b6e-416b-a1d1-d3fb6069ade1 for instance 2be10a9b-0300-40be-96eb-602b1ad4b05c on hv-cinder-81966 May 26 12:42:48.312879 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: INFO nova.api.openstack.requestlog [req-e3123f91-e892-4d84-8a73-30f044a1e266 req-5bc9874d-da11-4ffd-8360-f876f154cbfa service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029869 May 26 12:42:48.313462 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: [pid: 129322|app: 0|req: 268/510] 10.222.0.75 () {64 vars in 1317 bytes} [Thu May 26 12:42:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 12:42:48.432936 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi [None req-06af3ac2-506a-4b5c-b179-900e068d8273 tempest-TestMinimumBasicScenario-102576986 tempest-TestMinimumBasicScenario-102576986-project] Calling method '>' {{(pid=129321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:42:48.433900 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.compute.api [None req-06af3ac2-506a-4b5c-b179-900e068d8273 tempest-TestMinimumBasicScenario-102576986 tempest-TestMinimumBasicScenario-102576986-project] [instance: 76661008-e6d3-4646-a9ba-d5d0e83a4b65] Fetching instance by UUID {{(pid=129321) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:42:48.442633 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-06af3ac2-506a-4b5c-b179-900e068d8273 tempest-TestMinimumBasicScenario-102576986 tempest-TestMinimumBasicScenario-102576986-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:42:48.443225 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-06af3ac2-506a-4b5c-b179-900e068d8273 tempest-TestMinimumBasicScenario-102576986 tempest-TestMinimumBasicScenario-102576986-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:42:48.444138 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-06af3ac2-506a-4b5c-b179-900e068d8273 tempest-TestMinimumBasicScenario-102576986 tempest-TestMinimumBasicScenario-102576986-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:42:48.444722 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-06af3ac2-506a-4b5c-b179-900e068d8273 tempest-TestMinimumBasicScenario-102576986 tempest-TestMinimumBasicScenario-102576986-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:42:48.578097 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi [None req-2c09c7b9-4957-42b7-8fd6-0120e23242ca tempest-TestShelveInstance-546397589 tempest-TestShelveInstance-546397589-project] Calling method '>' {{(pid=129322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:42:48.578476 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.policy [None req-06af3ac2-506a-4b5c-b179-900e068d8273 tempest-TestMinimumBasicScenario-102576986 tempest-TestMinimumBasicScenario-102576986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0352a80bdc174b9a9df4eca60b81eba4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fa2c4d6423444e487d259062656129b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129321) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:42:48.578797 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.compute.api [None req-2c09c7b9-4957-42b7-8fd6-0120e23242ca tempest-TestShelveInstance-546397589 tempest-TestShelveInstance-546397589-project] [instance: 05cf529d-df00-4ff9-b0d2-0e27563d2861] Fetching instance by UUID {{(pid=129322) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:42:48.585314 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-2c09c7b9-4957-42b7-8fd6-0120e23242ca tempest-TestShelveInstance-546397589 tempest-TestShelveInstance-546397589-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:42:48.585760 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-2c09c7b9-4957-42b7-8fd6-0120e23242ca tempest-TestShelveInstance-546397589 tempest-TestShelveInstance-546397589-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:42:48.586533 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-2c09c7b9-4957-42b7-8fd6-0120e23242ca tempest-TestShelveInstance-546397589 tempest-TestShelveInstance-546397589-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:42:48.586641 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: INFO nova.api.openstack.requestlog [None req-06af3ac2-506a-4b5c-b179-900e068d8273 tempest-TestMinimumBasicScenario-102576986 tempest-TestMinimumBasicScenario-102576986-project] 10.222.0.75 "GET /compute/v2.1/servers/76661008-e6d3-4646-a9ba-d5d0e83a4b65" status: 200 len: 1357 microversion: 2.1 time: 0.160398 May 26 12:42:48.586964 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-2c09c7b9-4957-42b7-8fd6-0120e23242ca tempest-TestShelveInstance-546397589 tempest-TestShelveInstance-546397589-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:42:48.591592 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: [pid: 129321|app: 0|req: 243/511] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 26 12:42:48 2022] GET /compute/v2.1/servers/76661008-e6d3-4646-a9ba-d5d0e83a4b65 => generated 1357 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:42:48.650439 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.policy [None req-2c09c7b9-4957-42b7-8fd6-0120e23242ca tempest-TestShelveInstance-546397589 tempest-TestShelveInstance-546397589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d9bf2dcfce24386a1aaf9709d88da45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1f2f503ef674a4b97f848b69f8b63c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129322) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:42:48.659107 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: INFO nova.api.openstack.requestlog [None req-2c09c7b9-4957-42b7-8fd6-0120e23242ca tempest-TestShelveInstance-546397589 tempest-TestShelveInstance-546397589-project] 10.222.0.75 "GET /compute/v2.1/servers/05cf529d-df00-4ff9-b0d2-0e27563d2861" status: 200 len: 1203 microversion: 2.1 time: 0.085504 May 26 12:42:48.659721 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: [pid: 129322|app: 0|req: 269/512] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 26 12:42:48 2022] GET /compute/v2.1/servers/05cf529d-df00-4ff9-b0d2-0e27563d2861 => generated 1203 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:42:48.788753 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi [None req-79af9975-90b8-4353-a9e8-0520aacf7a57 tempest-VolumesSnapshotTestJSON-1904508205 tempest-VolumesSnapshotTestJSON-1904508205-project] Calling method '>' {{(pid=129321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:42:48.789725 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.compute.api [None req-79af9975-90b8-4353-a9e8-0520aacf7a57 tempest-VolumesSnapshotTestJSON-1904508205 tempest-VolumesSnapshotTestJSON-1904508205-project] [instance: f392ba2b-2b88-4b1a-be61-0cf28ed1443a] Fetching instance by UUID {{(pid=129321) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:42:48.791104 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi [None req-a991b487-8f63-4dc5-9d70-ef117c1fb5c4 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Calling method '>' {{(pid=129322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:42:48.791802 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.compute.api [None req-a991b487-8f63-4dc5-9d70-ef117c1fb5c4 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] [instance: bf2f6303-22b9-4cfa-8d4d-61d2503bc554] Fetching instance by UUID {{(pid=129322) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:42:48.796388 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-79af9975-90b8-4353-a9e8-0520aacf7a57 tempest-VolumesSnapshotTestJSON-1904508205 tempest-VolumesSnapshotTestJSON-1904508205-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:42:48.796868 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-79af9975-90b8-4353-a9e8-0520aacf7a57 tempest-VolumesSnapshotTestJSON-1904508205 tempest-VolumesSnapshotTestJSON-1904508205-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:42:48.797639 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-79af9975-90b8-4353-a9e8-0520aacf7a57 tempest-VolumesSnapshotTestJSON-1904508205 tempest-VolumesSnapshotTestJSON-1904508205-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:42:48.797910 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-a991b487-8f63-4dc5-9d70-ef117c1fb5c4 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:42:48.798084 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-79af9975-90b8-4353-a9e8-0520aacf7a57 tempest-VolumesSnapshotTestJSON-1904508205 tempest-VolumesSnapshotTestJSON-1904508205-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:42:48.798373 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-a991b487-8f63-4dc5-9d70-ef117c1fb5c4 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:42:48.799135 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-a991b487-8f63-4dc5-9d70-ef117c1fb5c4 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:42:48.799562 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-a991b487-8f63-4dc5-9d70-ef117c1fb5c4 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:42:48.829835 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-79af9975-90b8-4353-a9e8-0520aacf7a57 tempest-VolumesSnapshotTestJSON-1904508205 tempest-VolumesSnapshotTestJSON-1904508205-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:42:48.830278 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-79af9975-90b8-4353-a9e8-0520aacf7a57 tempest-VolumesSnapshotTestJSON-1904508205 tempest-VolumesSnapshotTestJSON-1904508205-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:42:48.830727 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.objects.instance [None req-79af9975-90b8-4353-a9e8-0520aacf7a57 tempest-VolumesSnapshotTestJSON-1904508205 tempest-VolumesSnapshotTestJSON-1904508205-project] Lazy-loading 'fault' on Instance uuid f392ba2b-2b88-4b1a-be61-0cf28ed1443a {{(pid=129321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 26 12:42:48.881171 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.policy [None req-79af9975-90b8-4353-a9e8-0520aacf7a57 tempest-VolumesSnapshotTestJSON-1904508205 tempest-VolumesSnapshotTestJSON-1904508205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '805854e5ce2e412fb9420afd63f73ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72bda4cbb07a43688506e01d06ba89c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129321) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:42:48.890469 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: INFO nova.api.openstack.requestlog [None req-79af9975-90b8-4353-a9e8-0520aacf7a57 tempest-VolumesSnapshotTestJSON-1904508205 tempest-VolumesSnapshotTestJSON-1904508205-project] 10.222.0.75 "GET /compute/v2.1/servers/f392ba2b-2b88-4b1a-be61-0cf28ed1443a" status: 200 len: 1309 microversion: 2.1 time: 0.108036 May 26 12:42:48.891448 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: [pid: 129321|app: 0|req: 244/513] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 26 12:42:48 2022] GET /compute/v2.1/servers/f392ba2b-2b88-4b1a-be61-0cf28ed1443a => generated 1309 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:42:48.933493 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.policy [None req-a991b487-8f63-4dc5-9d70-ef117c1fb5c4 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e811736979c44b02b14fecb74c6bd7ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675272fb40d4847819f83ec04afecef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129322) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:42:48.941741 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.policy [None req-a991b487-8f63-4dc5-9d70-ef117c1fb5c4 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e811736979c44b02b14fecb74c6bd7ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675272fb40d4847819f83ec04afecef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129322) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:42:48.943202 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.policy [None req-a991b487-8f63-4dc5-9d70-ef117c1fb5c4 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e811736979c44b02b14fecb74c6bd7ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675272fb40d4847819f83ec04afecef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129322) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:42:48.944380 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: INFO nova.api.openstack.requestlog [None req-a991b487-8f63-4dc5-9d70-ef117c1fb5c4 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] 10.222.0.75 "GET /compute/v2.1/servers/bf2f6303-22b9-4cfa-8d4d-61d2503bc554" status: 200 len: 1725 microversion: 2.20 time: 0.158795 May 26 12:42:48.944938 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: [pid: 129322|app: 0|req: 270/514] 10.222.0.75 () {60 vars in 1276 bytes} [Thu May 26 12:42:48 2022] GET /compute/v2.1/servers/bf2f6303-22b9-4cfa-8d4d-61d2503bc554 => generated 1725 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 12:42:49.108342 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi [None req-79862af1-1566-431b-8b2f-a23908200e19 tempest-VolumesActionsTest-731506124 tempest-VolumesActionsTest-731506124-project] Calling method '>' {{(pid=129321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:42:49.108941 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.compute.api [None req-79862af1-1566-431b-8b2f-a23908200e19 tempest-VolumesActionsTest-731506124 tempest-VolumesActionsTest-731506124-project] [instance: 2be10a9b-0300-40be-96eb-602b1ad4b05c] Fetching instance by UUID {{(pid=129321) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:42:49.115857 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-79862af1-1566-431b-8b2f-a23908200e19 tempest-VolumesActionsTest-731506124 tempest-VolumesActionsTest-731506124-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:42:49.116306 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-79862af1-1566-431b-8b2f-a23908200e19 tempest-VolumesActionsTest-731506124 tempest-VolumesActionsTest-731506124-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:42:49.117145 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-79862af1-1566-431b-8b2f-a23908200e19 tempest-VolumesActionsTest-731506124 tempest-VolumesActionsTest-731506124-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:42:49.117580 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-79862af1-1566-431b-8b2f-a23908200e19 tempest-VolumesActionsTest-731506124 tempest-VolumesActionsTest-731506124-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:42:49.182514 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.policy [None req-79862af1-1566-431b-8b2f-a23908200e19 tempest-VolumesActionsTest-731506124 tempest-VolumesActionsTest-731506124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f39e076a9e6b401db6de9a2846519591', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa93879e60e470185e8dd71efaaf1a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129321) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:42:49.191221 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: INFO nova.api.openstack.requestlog [None req-79862af1-1566-431b-8b2f-a23908200e19 tempest-VolumesActionsTest-731506124 tempest-VolumesActionsTest-731506124-project] 10.222.0.75 "GET /compute/v2.1/servers/2be10a9b-0300-40be-96eb-602b1ad4b05c" status: 200 len: 1462 microversion: 2.1 time: 0.089502 May 26 12:42:49.191848 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: [pid: 129321|app: 0|req: 245/515] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 26 12:42:49 2022] GET /compute/v2.1/servers/2be10a9b-0300-40be-96eb-602b1ad4b05c => generated 1462 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:42:49.604120 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi [None req-daff1e77-78be-4bb0-9f55-99c5d9944404 tempest-TestMinimumBasicScenario-102576986 tempest-TestMinimumBasicScenario-102576986-project] Calling method '>' {{(pid=129322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:42:49.604903 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.compute.api [None req-daff1e77-78be-4bb0-9f55-99c5d9944404 tempest-TestMinimumBasicScenario-102576986 tempest-TestMinimumBasicScenario-102576986-project] [instance: 76661008-e6d3-4646-a9ba-d5d0e83a4b65] Fetching instance by UUID {{(pid=129322) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:42:49.613444 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-daff1e77-78be-4bb0-9f55-99c5d9944404 tempest-TestMinimumBasicScenario-102576986 tempest-TestMinimumBasicScenario-102576986-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:42:49.613917 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-daff1e77-78be-4bb0-9f55-99c5d9944404 tempest-TestMinimumBasicScenario-102576986 tempest-TestMinimumBasicScenario-102576986-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:42:49.614699 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-daff1e77-78be-4bb0-9f55-99c5d9944404 tempest-TestMinimumBasicScenario-102576986 tempest-TestMinimumBasicScenario-102576986-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:42:49.615152 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-daff1e77-78be-4bb0-9f55-99c5d9944404 tempest-TestMinimumBasicScenario-102576986 tempest-TestMinimumBasicScenario-102576986-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:42:49.678308 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi [None req-781d9f1c-c95c-4740-9f98-d730aeebdd2a tempest-TestShelveInstance-546397589 tempest-TestShelveInstance-546397589-project] Calling method '>' {{(pid=129321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:42:49.678858 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.compute.api [None req-781d9f1c-c95c-4740-9f98-d730aeebdd2a tempest-TestShelveInstance-546397589 tempest-TestShelveInstance-546397589-project] [instance: 05cf529d-df00-4ff9-b0d2-0e27563d2861] Fetching instance by UUID {{(pid=129321) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:42:49.685559 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-781d9f1c-c95c-4740-9f98-d730aeebdd2a tempest-TestShelveInstance-546397589 tempest-TestShelveInstance-546397589-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:42:49.686012 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-781d9f1c-c95c-4740-9f98-d730aeebdd2a tempest-TestShelveInstance-546397589 tempest-TestShelveInstance-546397589-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:42:49.686838 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-781d9f1c-c95c-4740-9f98-d730aeebdd2a tempest-TestShelveInstance-546397589 tempest-TestShelveInstance-546397589-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:42:49.687413 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-781d9f1c-c95c-4740-9f98-d730aeebdd2a tempest-TestShelveInstance-546397589 tempest-TestShelveInstance-546397589-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:42:49.690215 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG dbcounter [-] [129321] Writing DB stats nova_cell1:SELECT=100 {{(pid=129321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:42:49.765182 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.policy [None req-781d9f1c-c95c-4740-9f98-d730aeebdd2a tempest-TestShelveInstance-546397589 tempest-TestShelveInstance-546397589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d9bf2dcfce24386a1aaf9709d88da45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1f2f503ef674a4b97f848b69f8b63c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129321) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:42:49.769201 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.policy [None req-daff1e77-78be-4bb0-9f55-99c5d9944404 tempest-TestMinimumBasicScenario-102576986 tempest-TestMinimumBasicScenario-102576986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0352a80bdc174b9a9df4eca60b81eba4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fa2c4d6423444e487d259062656129b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129322) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:42:49.774170 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: INFO nova.api.openstack.requestlog [None req-781d9f1c-c95c-4740-9f98-d730aeebdd2a tempest-TestShelveInstance-546397589 tempest-TestShelveInstance-546397589-project] 10.222.0.75 "GET /compute/v2.1/servers/05cf529d-df00-4ff9-b0d2-0e27563d2861" status: 200 len: 1203 microversion: 2.1 time: 0.099948 May 26 12:42:49.775553 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: [pid: 129321|app: 0|req: 246/516] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 26 12:42:49 2022] GET /compute/v2.1/servers/05cf529d-df00-4ff9-b0d2-0e27563d2861 => generated 1203 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 12:42:49.778572 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: INFO nova.api.openstack.requestlog [None req-daff1e77-78be-4bb0-9f55-99c5d9944404 tempest-TestMinimumBasicScenario-102576986 tempest-TestMinimumBasicScenario-102576986-project] 10.222.0.75 "GET /compute/v2.1/servers/76661008-e6d3-4646-a9ba-d5d0e83a4b65" status: 200 len: 1357 microversion: 2.1 time: 0.179528 May 26 12:42:49.779237 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: [pid: 129322|app: 0|req: 271/517] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 26 12:42:49 2022] GET /compute/v2.1/servers/76661008-e6d3-4646-a9ba-d5d0e83a4b65 => generated 1357 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:42:49.909986 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi [None req-69cfa0ed-3423-438a-a3c1-81f10e0cd11e tempest-VolumesSnapshotTestJSON-1904508205 tempest-VolumesSnapshotTestJSON-1904508205-project] Calling method '>' {{(pid=129321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:42:49.910876 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.compute.api [None req-69cfa0ed-3423-438a-a3c1-81f10e0cd11e tempest-VolumesSnapshotTestJSON-1904508205 tempest-VolumesSnapshotTestJSON-1904508205-project] [instance: f392ba2b-2b88-4b1a-be61-0cf28ed1443a] Fetching instance by UUID {{(pid=129321) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:42:49.919350 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-69cfa0ed-3423-438a-a3c1-81f10e0cd11e tempest-VolumesSnapshotTestJSON-1904508205 tempest-VolumesSnapshotTestJSON-1904508205-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:42:49.919835 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-69cfa0ed-3423-438a-a3c1-81f10e0cd11e tempest-VolumesSnapshotTestJSON-1904508205 tempest-VolumesSnapshotTestJSON-1904508205-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:42:49.920593 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-69cfa0ed-3423-438a-a3c1-81f10e0cd11e tempest-VolumesSnapshotTestJSON-1904508205 tempest-VolumesSnapshotTestJSON-1904508205-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:42:49.921019 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-69cfa0ed-3423-438a-a3c1-81f10e0cd11e tempest-VolumesSnapshotTestJSON-1904508205 tempest-VolumesSnapshotTestJSON-1904508205-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:42:49.958457 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-69cfa0ed-3423-438a-a3c1-81f10e0cd11e tempest-VolumesSnapshotTestJSON-1904508205 tempest-VolumesSnapshotTestJSON-1904508205-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:42:49.958916 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-69cfa0ed-3423-438a-a3c1-81f10e0cd11e tempest-VolumesSnapshotTestJSON-1904508205 tempest-VolumesSnapshotTestJSON-1904508205-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:42:49.959389 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.objects.instance [None req-69cfa0ed-3423-438a-a3c1-81f10e0cd11e tempest-VolumesSnapshotTestJSON-1904508205 tempest-VolumesSnapshotTestJSON-1904508205-project] Lazy-loading 'fault' on Instance uuid f392ba2b-2b88-4b1a-be61-0cf28ed1443a {{(pid=129321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 26 12:42:49.963454 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi [None req-94805ab4-fe66-4cc4-b6c3-e4c273f99d5d tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Calling method '>' {{(pid=129322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:42:49.964518 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.compute.api [None req-94805ab4-fe66-4cc4-b6c3-e4c273f99d5d tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] [instance: bf2f6303-22b9-4cfa-8d4d-61d2503bc554] Fetching instance by UUID {{(pid=129322) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:42:49.972274 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-94805ab4-fe66-4cc4-b6c3-e4c273f99d5d tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:42:49.972806 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-94805ab4-fe66-4cc4-b6c3-e4c273f99d5d tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:42:49.973637 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-94805ab4-fe66-4cc4-b6c3-e4c273f99d5d tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:42:49.974150 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-94805ab4-fe66-4cc4-b6c3-e4c273f99d5d tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:42:50.004285 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.policy [None req-69cfa0ed-3423-438a-a3c1-81f10e0cd11e tempest-VolumesSnapshotTestJSON-1904508205 tempest-VolumesSnapshotTestJSON-1904508205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '805854e5ce2e412fb9420afd63f73ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72bda4cbb07a43688506e01d06ba89c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129321) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:42:50.012406 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: INFO nova.api.openstack.requestlog [None req-69cfa0ed-3423-438a-a3c1-81f10e0cd11e tempest-VolumesSnapshotTestJSON-1904508205 tempest-VolumesSnapshotTestJSON-1904508205-project] 10.222.0.75 "GET /compute/v2.1/servers/f392ba2b-2b88-4b1a-be61-0cf28ed1443a" status: 200 len: 1309 microversion: 2.1 time: 0.107393 May 26 12:42:50.012980 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: [pid: 129321|app: 0|req: 247/518] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 26 12:42:49 2022] GET /compute/v2.1/servers/f392ba2b-2b88-4b1a-be61-0cf28ed1443a => generated 1309 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:42:50.130152 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.policy [None req-94805ab4-fe66-4cc4-b6c3-e4c273f99d5d tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e811736979c44b02b14fecb74c6bd7ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675272fb40d4847819f83ec04afecef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129322) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:42:50.142791 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.policy [None req-94805ab4-fe66-4cc4-b6c3-e4c273f99d5d tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e811736979c44b02b14fecb74c6bd7ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675272fb40d4847819f83ec04afecef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129322) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:42:50.145137 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.policy [None req-94805ab4-fe66-4cc4-b6c3-e4c273f99d5d tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e811736979c44b02b14fecb74c6bd7ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675272fb40d4847819f83ec04afecef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129322) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:42:50.146872 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: INFO nova.api.openstack.requestlog [None req-94805ab4-fe66-4cc4-b6c3-e4c273f99d5d tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] 10.222.0.75 "GET /compute/v2.1/servers/bf2f6303-22b9-4cfa-8d4d-61d2503bc554" status: 200 len: 1725 microversion: 2.20 time: 0.188052 May 26 12:42:50.147687 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: [pid: 129322|app: 0|req: 272/519] 10.222.0.75 () {60 vars in 1276 bytes} [Thu May 26 12:42:49 2022] GET /compute/v2.1/servers/bf2f6303-22b9-4cfa-8d4d-61d2503bc554 => generated 1725 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 12:42:50.216992 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi [None req-2e4950cf-cfed-4fe6-99b8-6a840a86f8ae tempest-VolumesActionsTest-731506124 tempest-VolumesActionsTest-731506124-project] Calling method '>' {{(pid=129321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:42:50.217804 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.compute.api [None req-2e4950cf-cfed-4fe6-99b8-6a840a86f8ae tempest-VolumesActionsTest-731506124 tempest-VolumesActionsTest-731506124-project] [instance: 2be10a9b-0300-40be-96eb-602b1ad4b05c] Fetching instance by UUID {{(pid=129321) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:42:50.224507 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-2e4950cf-cfed-4fe6-99b8-6a840a86f8ae tempest-VolumesActionsTest-731506124 tempest-VolumesActionsTest-731506124-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:42:50.224953 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-2e4950cf-cfed-4fe6-99b8-6a840a86f8ae tempest-VolumesActionsTest-731506124 tempest-VolumesActionsTest-731506124-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:42:50.225761 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-2e4950cf-cfed-4fe6-99b8-6a840a86f8ae tempest-VolumesActionsTest-731506124 tempest-VolumesActionsTest-731506124-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:42:50.226197 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-2e4950cf-cfed-4fe6-99b8-6a840a86f8ae tempest-VolumesActionsTest-731506124 tempest-VolumesActionsTest-731506124-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:42:50.299077 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.policy [None req-2e4950cf-cfed-4fe6-99b8-6a840a86f8ae tempest-VolumesActionsTest-731506124 tempest-VolumesActionsTest-731506124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f39e076a9e6b401db6de9a2846519591', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa93879e60e470185e8dd71efaaf1a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129321) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:42:50.310892 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: INFO nova.api.openstack.requestlog [None req-2e4950cf-cfed-4fe6-99b8-6a840a86f8ae tempest-VolumesActionsTest-731506124 tempest-VolumesActionsTest-731506124-project] 10.222.0.75 "GET /compute/v2.1/servers/2be10a9b-0300-40be-96eb-602b1ad4b05c" status: 200 len: 1462 microversion: 2.1 time: 0.099399 May 26 12:42:50.311756 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: [pid: 129321|app: 0|req: 248/520] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 26 12:42:50 2022] GET /compute/v2.1/servers/2be10a9b-0300-40be-96eb-602b1ad4b05c => generated 1462 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:42:50.795767 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi [None req-a919503c-ea09-4d11-b64c-0a5fa469f818 tempest-TestMinimumBasicScenario-102576986 tempest-TestMinimumBasicScenario-102576986-project] Calling method '>' {{(pid=129321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:42:50.796388 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.compute.api [None req-a919503c-ea09-4d11-b64c-0a5fa469f818 tempest-TestMinimumBasicScenario-102576986 tempest-TestMinimumBasicScenario-102576986-project] [instance: 76661008-e6d3-4646-a9ba-d5d0e83a4b65] Fetching instance by UUID {{(pid=129321) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:42:50.799721 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi [None req-4a7bdd18-636a-4d8f-ad44-9d6772b0bcb3 tempest-TestShelveInstance-546397589 tempest-TestShelveInstance-546397589-project] Calling method '>' {{(pid=129322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:42:50.800323 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.compute.api [None req-4a7bdd18-636a-4d8f-ad44-9d6772b0bcb3 tempest-TestShelveInstance-546397589 tempest-TestShelveInstance-546397589-project] [instance: 05cf529d-df00-4ff9-b0d2-0e27563d2861] Fetching instance by UUID {{(pid=129322) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:42:50.803215 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG dbcounter [-] [129322] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=2 {{(pid=129322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:42:50.804922 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG dbcounter [-] [129321] Writing DB stats nova_cell0:SELECT=2 {{(pid=129321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:42:50.812487 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-a919503c-ea09-4d11-b64c-0a5fa469f818 tempest-TestMinimumBasicScenario-102576986 tempest-TestMinimumBasicScenario-102576986-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:42:50.812716 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-4a7bdd18-636a-4d8f-ad44-9d6772b0bcb3 tempest-TestShelveInstance-546397589 tempest-TestShelveInstance-546397589-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:42:50.813048 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-4a7bdd18-636a-4d8f-ad44-9d6772b0bcb3 tempest-TestShelveInstance-546397589 tempest-TestShelveInstance-546397589-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:42:50.813214 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-a919503c-ea09-4d11-b64c-0a5fa469f818 tempest-TestMinimumBasicScenario-102576986 tempest-TestMinimumBasicScenario-102576986-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:42:50.814009 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-a919503c-ea09-4d11-b64c-0a5fa469f818 tempest-TestMinimumBasicScenario-102576986 tempest-TestMinimumBasicScenario-102576986-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:42:50.814507 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-a919503c-ea09-4d11-b64c-0a5fa469f818 tempest-TestMinimumBasicScenario-102576986 tempest-TestMinimumBasicScenario-102576986-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:42:50.814644 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-4a7bdd18-636a-4d8f-ad44-9d6772b0bcb3 tempest-TestShelveInstance-546397589 tempest-TestShelveInstance-546397589-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:42:50.815181 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-4a7bdd18-636a-4d8f-ad44-9d6772b0bcb3 tempest-TestShelveInstance-546397589 tempest-TestShelveInstance-546397589-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:42:50.894497 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.policy [None req-4a7bdd18-636a-4d8f-ad44-9d6772b0bcb3 tempest-TestShelveInstance-546397589 tempest-TestShelveInstance-546397589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d9bf2dcfce24386a1aaf9709d88da45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1f2f503ef674a4b97f848b69f8b63c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129322) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:42:50.902860 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: INFO nova.api.openstack.requestlog [None req-4a7bdd18-636a-4d8f-ad44-9d6772b0bcb3 tempest-TestShelveInstance-546397589 tempest-TestShelveInstance-546397589-project] 10.222.0.75 "GET /compute/v2.1/servers/05cf529d-df00-4ff9-b0d2-0e27563d2861" status: 200 len: 1191 microversion: 2.1 time: 0.114555 May 26 12:42:50.903491 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: [pid: 129322|app: 0|req: 273/521] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 26 12:42:50 2022] GET /compute/v2.1/servers/05cf529d-df00-4ff9-b0d2-0e27563d2861 => generated 1191 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:42:50.915222 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG dbcounter [-] [129321] Writing DB stats nova_cell0:SELECT=8 {{(pid=129321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:42:51.029098 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi [None req-2207414f-ac4e-4e8e-bdea-25b1033eaa58 tempest-VolumesSnapshotTestJSON-1904508205 tempest-VolumesSnapshotTestJSON-1904508205-project] Calling method '>' {{(pid=129322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:42:51.029902 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.compute.api [None req-2207414f-ac4e-4e8e-bdea-25b1033eaa58 tempest-VolumesSnapshotTestJSON-1904508205 tempest-VolumesSnapshotTestJSON-1904508205-project] [instance: f392ba2b-2b88-4b1a-be61-0cf28ed1443a] Fetching instance by UUID {{(pid=129322) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:42:51.036200 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-2207414f-ac4e-4e8e-bdea-25b1033eaa58 tempest-VolumesSnapshotTestJSON-1904508205 tempest-VolumesSnapshotTestJSON-1904508205-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:42:51.036722 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-2207414f-ac4e-4e8e-bdea-25b1033eaa58 tempest-VolumesSnapshotTestJSON-1904508205 tempest-VolumesSnapshotTestJSON-1904508205-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:42:51.037569 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-2207414f-ac4e-4e8e-bdea-25b1033eaa58 tempest-VolumesSnapshotTestJSON-1904508205 tempest-VolumesSnapshotTestJSON-1904508205-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:42:51.038196 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-2207414f-ac4e-4e8e-bdea-25b1033eaa58 tempest-VolumesSnapshotTestJSON-1904508205 tempest-VolumesSnapshotTestJSON-1904508205-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:42:51.040896 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG dbcounter [-] [129322] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=129322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:42:51.070883 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: INFO nova.api.openstack.wsgi [None req-2207414f-ac4e-4e8e-bdea-25b1033eaa58 tempest-VolumesSnapshotTestJSON-1904508205 tempest-VolumesSnapshotTestJSON-1904508205-project] HTTP exception thrown: Instance f392ba2b-2b88-4b1a-be61-0cf28ed1443a could not be found. May 26 12:42:51.073145 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi [None req-2207414f-ac4e-4e8e-bdea-25b1033eaa58 tempest-VolumesSnapshotTestJSON-1904508205 tempest-VolumesSnapshotTestJSON-1904508205-project] Request method failure captured: May 26 12:42:51.073145 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: request: GET /compute/v2.1/servers/f392ba2b-2b88-4b1a-be61-0cf28ed1443a HTTP/1.1 May 26 12:42:51.073145 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: Accept: application/json May 26 12:42:51.073145 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: Accept-Encoding: identity May 26 12:42:51.073145 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: Connection: close May 26 12:42:51.073145 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: Content-Length: 0 May 26 12:42:51.073145 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: Content-Type: application/json May 26 12:42:51.073145 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: Host: 10.222.0.75 May 26 12:42:51.073145 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: Openstack-System-Scope: None May 26 12:42:51.073145 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: User-Agent: python-urllib3/1.26.9 May 26 12:42:51.073145 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: X-Auth-Token: gAAAAABij3UCpGl_3b01EqImWSm_Fgfw-fNLTcgm9GImZkxUHOXAF_LWSvGIksirXIlogDT_yiAwbxYfic8jEGGDJY-m_uoMLRMiyvh0NINeHQZ0T0dU_8WZE89MuqaoT2cMYBZtAAeFvWYagX4utJYJ0qPy8EtBvPxYQxZRpdLIpcZCAtwjHvQ May 26 12:42:51.073145 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: X-Domain-Id: None May 26 12:42:51.073145 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: X-Domain-Name: None May 26 12:42:51.073145 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: X-Identity-Status: Confirmed May 26 12:42:51.073145 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: X-Is-Admin-Project: True May 26 12:42:51.073145 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: X-Project-Domain-Id: default May 26 12:42:51.073145 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: X-Project-Domain-Name: Default May 26 12:42:51.073145 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: X-Project-Id: 72bda4cbb07a43688506e01d06ba89c2 May 26 12:42:51.073145 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1904508205 May 26 12:42:51.073145 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: X-Role: member,reader May 26 12:42:51.073145 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: X-Roles: member,reader May 26 12:42:51.074590 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/72bda4cbb07a43688506e01d06ba89c2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.75:8080", "publicURL": "http://10.222.0.75:8080/v1/AUTH_72bda4cbb07a43688506e01d06ba89c2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2/72bda4cbb07a43688506e01d06ba89c2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/72bda4cbb07a43688506e01d06ba89c2"}]}] May 26 12:42:51.074590 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: X-Tenant: tempest-VolumesSnapshotTestJSON-1904508205 May 26 12:42:51.074590 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: X-Tenant-Id: 72bda4cbb07a43688506e01d06ba89c2 May 26 12:42:51.074590 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1904508205 May 26 12:42:51.074590 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: X-User: tempest-VolumesSnapshotTestJSON-1904508205-project May 26 12:42:51.074590 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: X-User-Domain-Id: default May 26 12:42:51.074590 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: X-User-Domain-Name: Default May 26 12:42:51.074590 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: X-User-Id: 805854e5ce2e412fb9420afd63f73ee6 May 26 12:42:51.074590 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: X-User-Name: tempest-VolumesSnapshotTestJSON-1904508205-project May 26 12:42:51.074590 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: method: > May 26 12:42:51.074590 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: exception: Instance f392ba2b-2b88-4b1a-be61-0cf28ed1443a could not be found. May 26 12:42:51.074590 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: action_args: {'id': 'f392ba2b-2b88-4b1a-be61-0cf28ed1443a'} May 26 12:42:51.075668 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: {{(pid=129322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 12:42:51.075668 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 12:42:51.075668 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 26 12:42:51.075668 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 26 12:42:51.075668 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 26 12:42:51.075668 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 26 12:42:51.075668 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 26 12:42:51.075668 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 26 12:42:51.075668 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 26 12:42:51.075668 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 26 12:42:51.075668 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f392ba2b-2b88-4b1a-be61-0cf28ed1443a could not be found. May 26 12:42:51.075668 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi May 26 12:42:51.075668 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 12:42:51.075668 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi May 26 12:42:51.075668 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 12:42:51.075668 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 12:42:51.075668 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 12:42:51.075668 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 12:42:51.075668 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 12:42:51.075668 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 12:42:51.077111 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 12:42:51.077111 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 26 12:42:51.077111 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 26 12:42:51.077111 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 26 12:42:51.077111 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 26 12:42:51.077111 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 26 12:42:51.077111 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 12:42:51.077111 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f392ba2b-2b88-4b1a-be61-0cf28ed1443a could not be found. May 26 12:42:51.077111 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi May 26 12:42:51.077111 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 12:42:51.077111 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi May 26 12:42:51.077111 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 12:42:51.077111 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 12:42:51.077111 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 12:42:51.077111 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 12:42:51.077111 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 12:42:51.077111 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f392ba2b-2b88-4b1a-be61-0cf28ed1443a could not be found. May 26 12:42:51.077111 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi May 26 12:42:51.078329 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi [None req-2207414f-ac4e-4e8e-bdea-25b1033eaa58 tempest-VolumesSnapshotTestJSON-1904508205 tempest-VolumesSnapshotTestJSON-1904508205-project] Returning 404 to user: Instance f392ba2b-2b88-4b1a-be61-0cf28ed1443a could not be found. {{(pid=129322) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 12:42:51.078329 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: INFO nova.api.openstack.requestlog [None req-2207414f-ac4e-4e8e-bdea-25b1033eaa58 tempest-VolumesSnapshotTestJSON-1904508205 tempest-VolumesSnapshotTestJSON-1904508205-project] 10.222.0.75 "GET /compute/v2.1/servers/f392ba2b-2b88-4b1a-be61-0cf28ed1443a" status: 404 len: 111 microversion: 2.1 time: 0.049896 May 26 12:42:51.078329 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: [pid: 129322|app: 0|req: 274/522] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 26 12:42:51 2022] GET /compute/v2.1/servers/f392ba2b-2b88-4b1a-be61-0cf28ed1443a => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 26 12:42:51.081149 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.policy [None req-a919503c-ea09-4d11-b64c-0a5fa469f818 tempest-TestMinimumBasicScenario-102576986 tempest-TestMinimumBasicScenario-102576986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0352a80bdc174b9a9df4eca60b81eba4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fa2c4d6423444e487d259062656129b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129321) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:42:51.094488 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: INFO nova.api.openstack.requestlog [None req-a919503c-ea09-4d11-b64c-0a5fa469f818 tempest-TestMinimumBasicScenario-102576986 tempest-TestMinimumBasicScenario-102576986-project] 10.222.0.75 "GET /compute/v2.1/servers/76661008-e6d3-4646-a9ba-d5d0e83a4b65" status: 200 len: 1357 microversion: 2.1 time: 0.302673 May 26 12:42:51.095284 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: [pid: 129321|app: 0|req: 249/523] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 26 12:42:50 2022] GET /compute/v2.1/servers/76661008-e6d3-4646-a9ba-d5d0e83a4b65 => generated 1357 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:42:51.169300 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi [None req-93770914-982f-4308-b560-e0d3846394aa tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Calling method '>' {{(pid=129322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:42:51.169907 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.compute.api [None req-93770914-982f-4308-b560-e0d3846394aa tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] [instance: bf2f6303-22b9-4cfa-8d4d-61d2503bc554] Fetching instance by UUID {{(pid=129322) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:42:51.179990 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-93770914-982f-4308-b560-e0d3846394aa tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:42:51.180433 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-93770914-982f-4308-b560-e0d3846394aa tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:42:51.181205 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-93770914-982f-4308-b560-e0d3846394aa tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:42:51.181806 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-93770914-982f-4308-b560-e0d3846394aa tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:42:51.337909 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi [None req-c2522e90-a9e2-4098-9cdd-428931fb9ea9 tempest-VolumesActionsTest-731506124 tempest-VolumesActionsTest-731506124-project] Calling method '>' {{(pid=129321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:42:51.340720 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.compute.api [None req-c2522e90-a9e2-4098-9cdd-428931fb9ea9 tempest-VolumesActionsTest-731506124 tempest-VolumesActionsTest-731506124-project] [instance: 2be10a9b-0300-40be-96eb-602b1ad4b05c] Fetching instance by UUID {{(pid=129321) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:42:51.357867 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-c2522e90-a9e2-4098-9cdd-428931fb9ea9 tempest-VolumesActionsTest-731506124 tempest-VolumesActionsTest-731506124-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:42:51.377932 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-c2522e90-a9e2-4098-9cdd-428931fb9ea9 tempest-VolumesActionsTest-731506124 tempest-VolumesActionsTest-731506124-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:42:51.379159 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-c2522e90-a9e2-4098-9cdd-428931fb9ea9 tempest-VolumesActionsTest-731506124 tempest-VolumesActionsTest-731506124-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:42:51.380124 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.policy [None req-93770914-982f-4308-b560-e0d3846394aa tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e811736979c44b02b14fecb74c6bd7ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675272fb40d4847819f83ec04afecef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129322) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:42:51.380782 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-c2522e90-a9e2-4098-9cdd-428931fb9ea9 tempest-VolumesActionsTest-731506124 tempest-VolumesActionsTest-731506124-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:42:51.393572 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.policy [None req-93770914-982f-4308-b560-e0d3846394aa tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e811736979c44b02b14fecb74c6bd7ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675272fb40d4847819f83ec04afecef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129322) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:42:51.395706 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.policy [None req-93770914-982f-4308-b560-e0d3846394aa tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e811736979c44b02b14fecb74c6bd7ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675272fb40d4847819f83ec04afecef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129322) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:42:51.397035 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: INFO nova.api.openstack.requestlog [None req-93770914-982f-4308-b560-e0d3846394aa tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] 10.222.0.75 "GET /compute/v2.1/servers/bf2f6303-22b9-4cfa-8d4d-61d2503bc554" status: 200 len: 1725 microversion: 2.20 time: 0.232035 May 26 12:42:51.413933 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: [pid: 129322|app: 0|req: 275/524] 10.222.0.75 () {60 vars in 1276 bytes} [Thu May 26 12:42:51 2022] GET /compute/v2.1/servers/bf2f6303-22b9-4cfa-8d4d-61d2503bc554 => generated 1725 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 12:42:51.417391 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: INFO nova.api.openstack.wsgi [None req-c2522e90-a9e2-4098-9cdd-428931fb9ea9 tempest-VolumesActionsTest-731506124 tempest-VolumesActionsTest-731506124-project] HTTP exception thrown: Instance 2be10a9b-0300-40be-96eb-602b1ad4b05c could not be found. May 26 12:42:51.419877 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi [None req-c2522e90-a9e2-4098-9cdd-428931fb9ea9 tempest-VolumesActionsTest-731506124 tempest-VolumesActionsTest-731506124-project] Request method failure captured: May 26 12:42:51.419877 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: request: GET /compute/v2.1/servers/2be10a9b-0300-40be-96eb-602b1ad4b05c HTTP/1.1 May 26 12:42:51.419877 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: Accept: application/json May 26 12:42:51.419877 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: Accept-Encoding: identity May 26 12:42:51.419877 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: Connection: close May 26 12:42:51.419877 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: Content-Length: 0 May 26 12:42:51.419877 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: Content-Type: application/json May 26 12:42:51.419877 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: Host: 10.222.0.75 May 26 12:42:51.419877 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: Openstack-System-Scope: None May 26 12:42:51.419877 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: User-Agent: python-urllib3/1.26.9 May 26 12:42:51.419877 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: X-Auth-Token: gAAAAABij3WCYJlZSEeK71zmOEeiB2Vk2q7v2Efm6wlf-SbvkS3YiHLenQrvkqoY4w88HPjpmZBfe_H8VAzWqRh2rmcLg1u_Xy5ulDPlKShP1p8TZ6yK83QCjfTknL2ofeNtsx0dfdDfdoxUHW0QsO6JrvEaGpqTh8AdrtNvwCXoDIqAEnmX7Xg May 26 12:42:51.419877 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: X-Domain-Id: None May 26 12:42:51.419877 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: X-Domain-Name: None May 26 12:42:51.419877 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: X-Identity-Status: Confirmed May 26 12:42:51.419877 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: X-Is-Admin-Project: True May 26 12:42:51.419877 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: X-Project-Domain-Id: default May 26 12:42:51.419877 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: X-Project-Domain-Name: Default May 26 12:42:51.419877 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: X-Project-Id: ffa93879e60e470185e8dd71efaaf1a9 May 26 12:42:51.419877 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: X-Project-Name: tempest-VolumesActionsTest-731506124 May 26 12:42:51.419877 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: X-Role: member,reader May 26 12:42:51.419877 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: X-Roles: member,reader May 26 12:42:51.421542 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/ffa93879e60e470185e8dd71efaaf1a9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.75:8080", "publicURL": "http://10.222.0.75:8080/v1/AUTH_ffa93879e60e470185e8dd71efaaf1a9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2/ffa93879e60e470185e8dd71efaaf1a9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/ffa93879e60e470185e8dd71efaaf1a9"}]}] May 26 12:42:51.421542 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: X-Tenant: tempest-VolumesActionsTest-731506124 May 26 12:42:51.421542 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: X-Tenant-Id: ffa93879e60e470185e8dd71efaaf1a9 May 26 12:42:51.421542 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: X-Tenant-Name: tempest-VolumesActionsTest-731506124 May 26 12:42:51.421542 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: X-User: tempest-VolumesActionsTest-731506124-project May 26 12:42:51.421542 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: X-User-Domain-Id: default May 26 12:42:51.421542 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: X-User-Domain-Name: Default May 26 12:42:51.421542 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: X-User-Id: f39e076a9e6b401db6de9a2846519591 May 26 12:42:51.421542 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: X-User-Name: tempest-VolumesActionsTest-731506124-project May 26 12:42:51.421542 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: method: > May 26 12:42:51.421542 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: exception: Instance 2be10a9b-0300-40be-96eb-602b1ad4b05c could not be found. May 26 12:42:51.421542 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: action_args: {'id': '2be10a9b-0300-40be-96eb-602b1ad4b05c'} May 26 12:42:51.422662 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: {{(pid=129321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 12:42:51.422662 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 12:42:51.422662 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 26 12:42:51.422662 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 26 12:42:51.422662 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 26 12:42:51.422662 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 26 12:42:51.422662 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 26 12:42:51.422662 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 26 12:42:51.422662 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 26 12:42:51.422662 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 26 12:42:51.422662 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2be10a9b-0300-40be-96eb-602b1ad4b05c could not be found. May 26 12:42:51.422662 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi May 26 12:42:51.422662 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 12:42:51.422662 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi May 26 12:42:51.422662 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 12:42:51.422662 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 12:42:51.422662 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 12:42:51.422662 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 12:42:51.422662 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 12:42:51.422662 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 12:42:51.424242 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 12:42:51.424242 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 26 12:42:51.424242 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 26 12:42:51.424242 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 26 12:42:51.424242 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 26 12:42:51.424242 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 26 12:42:51.424242 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 12:42:51.424242 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2be10a9b-0300-40be-96eb-602b1ad4b05c could not be found. May 26 12:42:51.424242 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi May 26 12:42:51.424242 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 12:42:51.424242 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi May 26 12:42:51.424242 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 12:42:51.424242 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 12:42:51.424242 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 12:42:51.424242 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 12:42:51.424242 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 12:42:51.424242 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2be10a9b-0300-40be-96eb-602b1ad4b05c could not be found. May 26 12:42:51.424242 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi May 26 12:42:51.427384 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi [None req-c2522e90-a9e2-4098-9cdd-428931fb9ea9 tempest-VolumesActionsTest-731506124 tempest-VolumesActionsTest-731506124-project] Returning 404 to user: Instance 2be10a9b-0300-40be-96eb-602b1ad4b05c could not be found. {{(pid=129321) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 12:42:51.429035 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: INFO nova.api.openstack.requestlog [None req-c2522e90-a9e2-4098-9cdd-428931fb9ea9 tempest-VolumesActionsTest-731506124 tempest-VolumesActionsTest-731506124-project] 10.222.0.75 "GET /compute/v2.1/servers/2be10a9b-0300-40be-96eb-602b1ad4b05c" status: 404 len: 111 microversion: 2.1 time: 0.097797 May 26 12:42:51.429624 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: [pid: 129321|app: 0|req: 250/525] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 26 12:42:51 2022] GET /compute/v2.1/servers/2be10a9b-0300-40be-96eb-602b1ad4b05c => generated 111 bytes in 99 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 26 12:42:51.562986 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi [None req-189abcb0-0504-4864-b25d-c1dc8e4fc011 tempest-VolumesActionsTest-731506124 tempest-VolumesActionsTest-731506124-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1692324127", "imageRef": "1e3c323d-d797-4e6d-bd9a-482d90084b0c", "flavorRef": "452", "networks": [{"uuid": "83770523-1304-41d2-9774-40ab1498ec55"}]}} {{(pid=129322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 12:42:51.620728 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.network.neutron [None req-189abcb0-0504-4864-b25d-c1dc8e4fc011 tempest-VolumesActionsTest-731506124 tempest-VolumesActionsTest-731506124-project] validate_networks() for [('83770523-1304-41d2-9774-40ab1498ec55', None, None, None, None, None)] {{(pid=129322) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 26 12:42:51.921354 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi [None req-f19351bf-b775-4120-94fa-68fdc37b4d0c tempest-TestShelveInstance-546397589 tempest-TestShelveInstance-546397589-project] Calling method '>' {{(pid=129321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:42:51.923315 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.compute.api [None req-f19351bf-b775-4120-94fa-68fdc37b4d0c tempest-TestShelveInstance-546397589 tempest-TestShelveInstance-546397589-project] [instance: 05cf529d-df00-4ff9-b0d2-0e27563d2861] Fetching instance by UUID {{(pid=129321) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:42:51.931811 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-f19351bf-b775-4120-94fa-68fdc37b4d0c tempest-TestShelveInstance-546397589 tempest-TestShelveInstance-546397589-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:42:51.932250 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-f19351bf-b775-4120-94fa-68fdc37b4d0c tempest-TestShelveInstance-546397589 tempest-TestShelveInstance-546397589-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:42:51.933217 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-f19351bf-b775-4120-94fa-68fdc37b4d0c tempest-TestShelveInstance-546397589 tempest-TestShelveInstance-546397589-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:42:51.933797 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-f19351bf-b775-4120-94fa-68fdc37b4d0c tempest-TestShelveInstance-546397589 tempest-TestShelveInstance-546397589-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:42:52.143146 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.policy [None req-f19351bf-b775-4120-94fa-68fdc37b4d0c tempest-TestShelveInstance-546397589 tempest-TestShelveInstance-546397589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d9bf2dcfce24386a1aaf9709d88da45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1f2f503ef674a4b97f848b69f8b63c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129321) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:42:52.153481 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: INFO nova.api.openstack.requestlog [None req-f19351bf-b775-4120-94fa-68fdc37b4d0c tempest-TestShelveInstance-546397589 tempest-TestShelveInstance-546397589-project] 10.222.0.75 "GET /compute/v2.1/servers/05cf529d-df00-4ff9-b0d2-0e27563d2861" status: 200 len: 1259 microversion: 2.1 time: 0.236714 May 26 12:42:52.154775 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: [pid: 129321|app: 0|req: 251/526] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 26 12:42:51 2022] GET /compute/v2.1/servers/05cf529d-df00-4ff9-b0d2-0e27563d2861 => generated 1259 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:42:52.160472 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi [req-f25fdc34-fb61-4e1f-8992-770d122851bf req-9a427e36-45dd-4b10-9786-fee1e0de42df service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "05cf529d-df00-4ff9-b0d2-0e27563d2861", "tag": "6408ddad-3849-44bf-b29b-b7e4852f543d"}]} {{(pid=129321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 12:42:52.170792 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [req-f25fdc34-fb61-4e1f-8992-770d122851bf req-9a427e36-45dd-4b10-9786-fee1e0de42df service nova] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:42:52.171410 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [req-f25fdc34-fb61-4e1f-8992-770d122851bf req-9a427e36-45dd-4b10-9786-fee1e0de42df service nova] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:42:52.184558 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: INFO nova.api.openstack.compute.server_external_events [req-f25fdc34-fb61-4e1f-8992-770d122851bf req-9a427e36-45dd-4b10-9786-fee1e0de42df service nova] Creating event network-changed:6408ddad-3849-44bf-b29b-b7e4852f543d for instance 05cf529d-df00-4ff9-b0d2-0e27563d2861 on hv-cinder-81966 May 26 12:42:52.190364 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: INFO nova.api.openstack.requestlog [req-f25fdc34-fb61-4e1f-8992-770d122851bf req-9a427e36-45dd-4b10-9786-fee1e0de42df service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033813 May 26 12:42:52.191129 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: [pid: 129321|app: 0|req: 252/527] 10.222.0.75 () {64 vars in 1317 bytes} [Thu May 26 12:42:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 12:42:52.197256 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi [None req-69163ab9-4964-447a-8945-f3bfa536458a tempest-TestMinimumBasicScenario-102576986 tempest-TestMinimumBasicScenario-102576986-project] Calling method '>' {{(pid=129321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:42:52.198081 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.compute.api [None req-69163ab9-4964-447a-8945-f3bfa536458a tempest-TestMinimumBasicScenario-102576986 tempest-TestMinimumBasicScenario-102576986-project] [instance: 76661008-e6d3-4646-a9ba-d5d0e83a4b65] Fetching instance by UUID {{(pid=129321) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:42:52.205481 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-69163ab9-4964-447a-8945-f3bfa536458a tempest-TestMinimumBasicScenario-102576986 tempest-TestMinimumBasicScenario-102576986-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:42:52.205932 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-69163ab9-4964-447a-8945-f3bfa536458a tempest-TestMinimumBasicScenario-102576986 tempest-TestMinimumBasicScenario-102576986-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:42:52.206737 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-69163ab9-4964-447a-8945-f3bfa536458a tempest-TestMinimumBasicScenario-102576986 tempest-TestMinimumBasicScenario-102576986-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:42:52.207197 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-69163ab9-4964-447a-8945-f3bfa536458a tempest-TestMinimumBasicScenario-102576986 tempest-TestMinimumBasicScenario-102576986-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:42:52.230371 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.virt.hardware [None req-189abcb0-0504-4864-b25d-c1dc8e4fc011 tempest-VolumesActionsTest-731506124 tempest-VolumesActionsTest-731506124-project] Flavor limits 0:0:0 {{(pid=129322) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 26 12:42:52.230904 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.virt.hardware [None req-189abcb0-0504-4864-b25d-c1dc8e4fc011 tempest-VolumesActionsTest-731506124 tempest-VolumesActionsTest-731506124-project] Image limits 0:0:0 {{(pid=129322) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 26 12:42:52.231412 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.virt.hardware [None req-189abcb0-0504-4864-b25d-c1dc8e4fc011 tempest-VolumesActionsTest-731506124 tempest-VolumesActionsTest-731506124-project] Flavor pref 0:0:0 {{(pid=129322) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 26 12:42:52.231844 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.virt.hardware [None req-189abcb0-0504-4864-b25d-c1dc8e4fc011 tempest-VolumesActionsTest-731506124 tempest-VolumesActionsTest-731506124-project] Image pref 0:0:0 {{(pid=129322) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 26 12:42:52.232299 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.virt.hardware [None req-189abcb0-0504-4864-b25d-c1dc8e4fc011 tempest-VolumesActionsTest-731506124 tempest-VolumesActionsTest-731506124-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129322) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 26 12:42:52.242589 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-189abcb0-0504-4864-b25d-c1dc8e4fc011 tempest-VolumesActionsTest-731506124 tempest-VolumesActionsTest-731506124-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:42:52.243378 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-189abcb0-0504-4864-b25d-c1dc8e4fc011 tempest-VolumesActionsTest-731506124 tempest-VolumesActionsTest-731506124-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:42:52.243900 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-189abcb0-0504-4864-b25d-c1dc8e4fc011 tempest-VolumesActionsTest-731506124 tempest-VolumesActionsTest-731506124-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:42:52.244313 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-189abcb0-0504-4864-b25d-c1dc8e4fc011 tempest-VolumesActionsTest-731506124 tempest-VolumesActionsTest-731506124-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:42:52.262350 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.quota [None req-189abcb0-0504-4864-b25d-c1dc8e4fc011 tempest-VolumesActionsTest-731506124 tempest-VolumesActionsTest-731506124-project] Getting quotas for project ffa93879e60e470185e8dd71efaaf1a9. Resources: {'instances', 'cores', 'ram'} {{(pid=129322) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 26 12:42:52.266717 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.quota [None req-189abcb0-0504-4864-b25d-c1dc8e4fc011 tempest-VolumesActionsTest-731506124 tempest-VolumesActionsTest-731506124-project] Getting quotas for user f39e076a9e6b401db6de9a2846519591 and project ffa93879e60e470185e8dd71efaaf1a9. Resources: {'instances', 'cores', 'ram'} {{(pid=129322) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 26 12:42:52.278690 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.compute.api [None req-189abcb0-0504-4864-b25d-c1dc8e4fc011 tempest-VolumesActionsTest-731506124 tempest-VolumesActionsTest-731506124-project] Going to run 1 instances... {{(pid=129322) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 26 12:42:52.281058 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.compute.api [None req-189abcb0-0504-4864-b25d-c1dc8e4fc011 tempest-VolumesActionsTest-731506124 tempest-VolumesActionsTest-731506124-project] [instance: 3fd057be-56c1-462d-8ea2-9ca668166ccf] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1e3c323d-d797-4e6d-bd9a-482d90084b0c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129322) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 26 12:42:52.325847 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: INFO nova.api.openstack.requestlog [None req-189abcb0-0504-4864-b25d-c1dc8e4fc011 tempest-VolumesActionsTest-731506124 tempest-VolumesActionsTest-731506124-project] 10.222.0.75 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.767025 May 26 12:42:52.326609 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: [pid: 129322|app: 0|req: 276/528] 10.222.0.75 () {60 vars in 1146 bytes} [Thu May 26 12:42:51 2022] POST /compute/v2.1/servers => generated 380 bytes in 768 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 26 12:42:52.336826 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi [None req-931cf971-192c-4bf9-8ef5-8538559fdd47 tempest-VolumesActionsTest-731506124 tempest-VolumesActionsTest-731506124-project] Calling method '>' {{(pid=129322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:42:52.337537 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.compute.api [None req-931cf971-192c-4bf9-8ef5-8538559fdd47 tempest-VolumesActionsTest-731506124 tempest-VolumesActionsTest-731506124-project] [instance: 3fd057be-56c1-462d-8ea2-9ca668166ccf] Fetching instance by UUID {{(pid=129322) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:42:52.377962 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.policy [None req-69163ab9-4964-447a-8945-f3bfa536458a tempest-TestMinimumBasicScenario-102576986 tempest-TestMinimumBasicScenario-102576986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0352a80bdc174b9a9df4eca60b81eba4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fa2c4d6423444e487d259062656129b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129321) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:42:52.386281 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: INFO nova.api.openstack.requestlog [None req-69163ab9-4964-447a-8945-f3bfa536458a tempest-TestMinimumBasicScenario-102576986 tempest-TestMinimumBasicScenario-102576986-project] 10.222.0.75 "GET /compute/v2.1/servers/76661008-e6d3-4646-a9ba-d5d0e83a4b65" status: 200 len: 1357 microversion: 2.1 time: 0.193728 May 26 12:42:52.387182 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: [pid: 129321|app: 0|req: 253/529] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 26 12:42:52 2022] GET /compute/v2.1/servers/76661008-e6d3-4646-a9ba-d5d0e83a4b65 => generated 1357 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:42:52.393226 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.policy [None req-931cf971-192c-4bf9-8ef5-8538559fdd47 tempest-VolumesActionsTest-731506124 tempest-VolumesActionsTest-731506124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f39e076a9e6b401db6de9a2846519591', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa93879e60e470185e8dd71efaaf1a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129322) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:42:52.400986 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: INFO nova.api.openstack.requestlog [None req-931cf971-192c-4bf9-8ef5-8538559fdd47 tempest-VolumesActionsTest-731506124 tempest-VolumesActionsTest-731506124-project] 10.222.0.75 "GET /compute/v2.1/servers/3fd057be-56c1-462d-8ea2-9ca668166ccf" status: 200 len: 1214 microversion: 2.1 time: 0.068313 May 26 12:42:52.401548 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: [pid: 129322|app: 0|req: 277/530] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 26 12:42:52 2022] GET /compute/v2.1/servers/3fd057be-56c1-462d-8ea2-9ca668166ccf => generated 1214 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 12:42:52.416694 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi [None req-80438691-7591-4dbc-a04b-64b4032cc95c tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Calling method '>' {{(pid=129321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:42:52.417302 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.compute.api [None req-80438691-7591-4dbc-a04b-64b4032cc95c tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] [instance: bf2f6303-22b9-4cfa-8d4d-61d2503bc554] Fetching instance by UUID {{(pid=129321) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:42:52.427352 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-80438691-7591-4dbc-a04b-64b4032cc95c tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:42:52.428030 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-80438691-7591-4dbc-a04b-64b4032cc95c tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:42:52.428960 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-80438691-7591-4dbc-a04b-64b4032cc95c tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:42:52.429539 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-80438691-7591-4dbc-a04b-64b4032cc95c tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:42:52.572922 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.policy [None req-80438691-7591-4dbc-a04b-64b4032cc95c tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e811736979c44b02b14fecb74c6bd7ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675272fb40d4847819f83ec04afecef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129321) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:42:52.581915 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.policy [None req-80438691-7591-4dbc-a04b-64b4032cc95c tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e811736979c44b02b14fecb74c6bd7ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675272fb40d4847819f83ec04afecef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129321) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:42:52.583414 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.policy [None req-80438691-7591-4dbc-a04b-64b4032cc95c tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e811736979c44b02b14fecb74c6bd7ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675272fb40d4847819f83ec04afecef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129321) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:42:52.584633 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: INFO nova.api.openstack.requestlog [None req-80438691-7591-4dbc-a04b-64b4032cc95c tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] 10.222.0.75 "GET /compute/v2.1/servers/bf2f6303-22b9-4cfa-8d4d-61d2503bc554" status: 200 len: 1725 microversion: 2.20 time: 0.171887 May 26 12:42:52.585208 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: [pid: 129321|app: 0|req: 254/531] 10.222.0.75 () {60 vars in 1276 bytes} [Thu May 26 12:42:52 2022] GET /compute/v2.1/servers/bf2f6303-22b9-4cfa-8d4d-61d2503bc554 => generated 1725 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 12:42:53.170614 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi [None req-1f3ab01d-8f9c-4855-aa57-daf7d4aa8844 tempest-TestShelveInstance-546397589 tempest-TestShelveInstance-546397589-project] Calling method '>' {{(pid=129322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:42:53.171305 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.compute.api [None req-1f3ab01d-8f9c-4855-aa57-daf7d4aa8844 tempest-TestShelveInstance-546397589 tempest-TestShelveInstance-546397589-project] [instance: 05cf529d-df00-4ff9-b0d2-0e27563d2861] Fetching instance by UUID {{(pid=129322) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:42:53.179953 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-1f3ab01d-8f9c-4855-aa57-daf7d4aa8844 tempest-TestShelveInstance-546397589 tempest-TestShelveInstance-546397589-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:42:53.180410 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-1f3ab01d-8f9c-4855-aa57-daf7d4aa8844 tempest-TestShelveInstance-546397589 tempest-TestShelveInstance-546397589-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:42:53.181227 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-1f3ab01d-8f9c-4855-aa57-daf7d4aa8844 tempest-TestShelveInstance-546397589 tempest-TestShelveInstance-546397589-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:42:53.181668 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-1f3ab01d-8f9c-4855-aa57-daf7d4aa8844 tempest-TestShelveInstance-546397589 tempest-TestShelveInstance-546397589-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:42:53.331735 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.policy [None req-1f3ab01d-8f9c-4855-aa57-daf7d4aa8844 tempest-TestShelveInstance-546397589 tempest-TestShelveInstance-546397589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d9bf2dcfce24386a1aaf9709d88da45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1f2f503ef674a4b97f848b69f8b63c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129322) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:42:53.339579 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: INFO nova.api.openstack.requestlog [None req-1f3ab01d-8f9c-4855-aa57-daf7d4aa8844 tempest-TestShelveInstance-546397589 tempest-TestShelveInstance-546397589-project] 10.222.0.75 "GET /compute/v2.1/servers/05cf529d-df00-4ff9-b0d2-0e27563d2861" status: 200 len: 1259 microversion: 2.1 time: 0.172929 May 26 12:42:53.340145 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: [pid: 129322|app: 0|req: 278/532] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 26 12:42:53 2022] GET /compute/v2.1/servers/05cf529d-df00-4ff9-b0d2-0e27563d2861 => generated 1259 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:42:53.402827 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi [None req-b6484add-bf0b-4d97-85b6-fe06753015c0 tempest-TestMinimumBasicScenario-102576986 tempest-TestMinimumBasicScenario-102576986-project] Calling method '>' {{(pid=129321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:42:53.403415 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.compute.api [None req-b6484add-bf0b-4d97-85b6-fe06753015c0 tempest-TestMinimumBasicScenario-102576986 tempest-TestMinimumBasicScenario-102576986-project] [instance: 76661008-e6d3-4646-a9ba-d5d0e83a4b65] Fetching instance by UUID {{(pid=129321) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:42:53.410897 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-b6484add-bf0b-4d97-85b6-fe06753015c0 tempest-TestMinimumBasicScenario-102576986 tempest-TestMinimumBasicScenario-102576986-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:42:53.411343 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-b6484add-bf0b-4d97-85b6-fe06753015c0 tempest-TestMinimumBasicScenario-102576986 tempest-TestMinimumBasicScenario-102576986-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:42:53.412145 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-b6484add-bf0b-4d97-85b6-fe06753015c0 tempest-TestMinimumBasicScenario-102576986 tempest-TestMinimumBasicScenario-102576986-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:42:53.412579 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-b6484add-bf0b-4d97-85b6-fe06753015c0 tempest-TestMinimumBasicScenario-102576986 tempest-TestMinimumBasicScenario-102576986-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:42:53.418192 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi [None req-21e371dd-9c12-4c40-abdd-30ac0739f000 tempest-VolumesActionsTest-731506124 tempest-VolumesActionsTest-731506124-project] Calling method '>' {{(pid=129322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:42:53.418799 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.compute.api [None req-21e371dd-9c12-4c40-abdd-30ac0739f000 tempest-VolumesActionsTest-731506124 tempest-VolumesActionsTest-731506124-project] [instance: 3fd057be-56c1-462d-8ea2-9ca668166ccf] Fetching instance by UUID {{(pid=129322) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:42:53.425298 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-21e371dd-9c12-4c40-abdd-30ac0739f000 tempest-VolumesActionsTest-731506124 tempest-VolumesActionsTest-731506124-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:42:53.425672 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-21e371dd-9c12-4c40-abdd-30ac0739f000 tempest-VolumesActionsTest-731506124 tempest-VolumesActionsTest-731506124-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:42:53.426421 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-21e371dd-9c12-4c40-abdd-30ac0739f000 tempest-VolumesActionsTest-731506124 tempest-VolumesActionsTest-731506124-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:42:53.426845 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-21e371dd-9c12-4c40-abdd-30ac0739f000 tempest-VolumesActionsTest-731506124 tempest-VolumesActionsTest-731506124-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:42:53.488555 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.policy [None req-21e371dd-9c12-4c40-abdd-30ac0739f000 tempest-VolumesActionsTest-731506124 tempest-VolumesActionsTest-731506124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f39e076a9e6b401db6de9a2846519591', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa93879e60e470185e8dd71efaaf1a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129322) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:42:53.496515 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: INFO nova.api.openstack.requestlog [None req-21e371dd-9c12-4c40-abdd-30ac0739f000 tempest-VolumesActionsTest-731506124 tempest-VolumesActionsTest-731506124-project] 10.222.0.75 "GET /compute/v2.1/servers/3fd057be-56c1-462d-8ea2-9ca668166ccf" status: 200 len: 1218 microversion: 2.1 time: 0.082174 May 26 12:42:53.497164 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: [pid: 129322|app: 0|req: 279/533] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 26 12:42:53 2022] GET /compute/v2.1/servers/3fd057be-56c1-462d-8ea2-9ca668166ccf => generated 1218 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:42:53.550144 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.policy [None req-b6484add-bf0b-4d97-85b6-fe06753015c0 tempest-TestMinimumBasicScenario-102576986 tempest-TestMinimumBasicScenario-102576986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0352a80bdc174b9a9df4eca60b81eba4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fa2c4d6423444e487d259062656129b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129321) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:42:53.557806 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: INFO nova.api.openstack.requestlog [None req-b6484add-bf0b-4d97-85b6-fe06753015c0 tempest-TestMinimumBasicScenario-102576986 tempest-TestMinimumBasicScenario-102576986-project] 10.222.0.75 "GET /compute/v2.1/servers/76661008-e6d3-4646-a9ba-d5d0e83a4b65" status: 200 len: 1357 microversion: 2.1 time: 0.159294 May 26 12:42:53.558376 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: [pid: 129321|app: 0|req: 255/534] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 26 12:42:53 2022] GET /compute/v2.1/servers/76661008-e6d3-4646-a9ba-d5d0e83a4b65 => generated 1357 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:42:53.602695 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi [None req-f76efbe2-b39e-430b-a446-3409c8499e3e tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Calling method '>' {{(pid=129322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:42:53.603387 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.compute.api [None req-f76efbe2-b39e-430b-a446-3409c8499e3e tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] [instance: bf2f6303-22b9-4cfa-8d4d-61d2503bc554] Fetching instance by UUID {{(pid=129322) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:42:53.611196 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-f76efbe2-b39e-430b-a446-3409c8499e3e tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:42:53.611791 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-f76efbe2-b39e-430b-a446-3409c8499e3e tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:42:53.612574 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-f76efbe2-b39e-430b-a446-3409c8499e3e tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:42:53.613005 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-f76efbe2-b39e-430b-a446-3409c8499e3e tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:42:53.750888 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.policy [None req-f76efbe2-b39e-430b-a446-3409c8499e3e tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e811736979c44b02b14fecb74c6bd7ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675272fb40d4847819f83ec04afecef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129322) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:42:53.759085 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.policy [None req-f76efbe2-b39e-430b-a446-3409c8499e3e tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e811736979c44b02b14fecb74c6bd7ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675272fb40d4847819f83ec04afecef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129322) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:42:53.760633 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.policy [None req-f76efbe2-b39e-430b-a446-3409c8499e3e tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e811736979c44b02b14fecb74c6bd7ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675272fb40d4847819f83ec04afecef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129322) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:42:53.761793 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: INFO nova.api.openstack.requestlog [None req-f76efbe2-b39e-430b-a446-3409c8499e3e tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] 10.222.0.75 "GET /compute/v2.1/servers/bf2f6303-22b9-4cfa-8d4d-61d2503bc554" status: 200 len: 1725 microversion: 2.20 time: 0.163020 May 26 12:42:53.762385 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: [pid: 129322|app: 0|req: 280/535] 10.222.0.75 () {60 vars in 1276 bytes} [Thu May 26 12:42:53 2022] GET /compute/v2.1/servers/bf2f6303-22b9-4cfa-8d4d-61d2503bc554 => generated 1725 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 12:42:54.360605 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi [None req-dbc28e49-b1dd-403b-8393-727b56298173 tempest-TestShelveInstance-546397589 tempest-TestShelveInstance-546397589-project] Calling method '>' {{(pid=129321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:42:54.361605 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.compute.api [None req-dbc28e49-b1dd-403b-8393-727b56298173 tempest-TestShelveInstance-546397589 tempest-TestShelveInstance-546397589-project] [instance: 05cf529d-df00-4ff9-b0d2-0e27563d2861] Fetching instance by UUID {{(pid=129321) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:42:54.372622 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-dbc28e49-b1dd-403b-8393-727b56298173 tempest-TestShelveInstance-546397589 tempest-TestShelveInstance-546397589-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:42:54.373400 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-dbc28e49-b1dd-403b-8393-727b56298173 tempest-TestShelveInstance-546397589 tempest-TestShelveInstance-546397589-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:42:54.374822 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-dbc28e49-b1dd-403b-8393-727b56298173 tempest-TestShelveInstance-546397589 tempest-TestShelveInstance-546397589-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:42:54.375612 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-dbc28e49-b1dd-403b-8393-727b56298173 tempest-TestShelveInstance-546397589 tempest-TestShelveInstance-546397589-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:42:54.519000 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi [None req-4fec7f59-95d8-47f3-a954-70a60ea1c595 tempest-VolumesActionsTest-731506124 tempest-VolumesActionsTest-731506124-project] Calling method '>' {{(pid=129322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:42:54.520141 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.compute.api [None req-4fec7f59-95d8-47f3-a954-70a60ea1c595 tempest-VolumesActionsTest-731506124 tempest-VolumesActionsTest-731506124-project] [instance: 3fd057be-56c1-462d-8ea2-9ca668166ccf] Fetching instance by UUID {{(pid=129322) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:42:54.532696 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-4fec7f59-95d8-47f3-a954-70a60ea1c595 tempest-VolumesActionsTest-731506124 tempest-VolumesActionsTest-731506124-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:42:54.533852 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-4fec7f59-95d8-47f3-a954-70a60ea1c595 tempest-VolumesActionsTest-731506124 tempest-VolumesActionsTest-731506124-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:42:54.535449 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-4fec7f59-95d8-47f3-a954-70a60ea1c595 tempest-VolumesActionsTest-731506124 tempest-VolumesActionsTest-731506124-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:42:54.536974 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-4fec7f59-95d8-47f3-a954-70a60ea1c595 tempest-VolumesActionsTest-731506124 tempest-VolumesActionsTest-731506124-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:42:54.574606 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.policy [None req-dbc28e49-b1dd-403b-8393-727b56298173 tempest-TestShelveInstance-546397589 tempest-TestShelveInstance-546397589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d9bf2dcfce24386a1aaf9709d88da45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1f2f503ef674a4b97f848b69f8b63c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129321) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:42:54.587270 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: INFO nova.api.openstack.requestlog [None req-dbc28e49-b1dd-403b-8393-727b56298173 tempest-TestShelveInstance-546397589 tempest-TestShelveInstance-546397589-project] 10.222.0.75 "GET /compute/v2.1/servers/05cf529d-df00-4ff9-b0d2-0e27563d2861" status: 200 len: 1259 microversion: 2.1 time: 0.233642 May 26 12:42:54.588346 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: [pid: 129321|app: 0|req: 256/536] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 26 12:42:54 2022] GET /compute/v2.1/servers/05cf529d-df00-4ff9-b0d2-0e27563d2861 => generated 1259 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:42:54.594349 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi [None req-c24f13f3-4cae-46cd-a3fa-28d63b9ce3dd tempest-TestMinimumBasicScenario-102576986 tempest-TestMinimumBasicScenario-102576986-project] Calling method '>' {{(pid=129321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:42:54.594833 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.compute.api [None req-c24f13f3-4cae-46cd-a3fa-28d63b9ce3dd tempest-TestMinimumBasicScenario-102576986 tempest-TestMinimumBasicScenario-102576986-project] [instance: 76661008-e6d3-4646-a9ba-d5d0e83a4b65] Fetching instance by UUID {{(pid=129321) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:42:54.605723 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-c24f13f3-4cae-46cd-a3fa-28d63b9ce3dd tempest-TestMinimumBasicScenario-102576986 tempest-TestMinimumBasicScenario-102576986-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:42:54.605723 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-c24f13f3-4cae-46cd-a3fa-28d63b9ce3dd tempest-TestMinimumBasicScenario-102576986 tempest-TestMinimumBasicScenario-102576986-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:42:54.605723 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-c24f13f3-4cae-46cd-a3fa-28d63b9ce3dd tempest-TestMinimumBasicScenario-102576986 tempest-TestMinimumBasicScenario-102576986-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:42:54.605723 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-c24f13f3-4cae-46cd-a3fa-28d63b9ce3dd tempest-TestMinimumBasicScenario-102576986 tempest-TestMinimumBasicScenario-102576986-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:42:54.645472 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.policy [None req-4fec7f59-95d8-47f3-a954-70a60ea1c595 tempest-VolumesActionsTest-731506124 tempest-VolumesActionsTest-731506124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f39e076a9e6b401db6de9a2846519591', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa93879e60e470185e8dd71efaaf1a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129322) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:42:54.659754 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: INFO nova.api.openstack.requestlog [None req-4fec7f59-95d8-47f3-a954-70a60ea1c595 tempest-VolumesActionsTest-731506124 tempest-VolumesActionsTest-731506124-project] 10.222.0.75 "GET /compute/v2.1/servers/3fd057be-56c1-462d-8ea2-9ca668166ccf" status: 200 len: 1218 microversion: 2.1 time: 0.148383 May 26 12:42:54.661029 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: [pid: 129322|app: 0|req: 281/537] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 26 12:42:54 2022] GET /compute/v2.1/servers/3fd057be-56c1-462d-8ea2-9ca668166ccf => generated 1218 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 12:42:54.786087 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi [None req-90e001ea-b5a3-447a-8a91-cf18bf72e1d3 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Calling method '>' {{(pid=129322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:42:54.790581 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.compute.api [None req-90e001ea-b5a3-447a-8a91-cf18bf72e1d3 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] [instance: bf2f6303-22b9-4cfa-8d4d-61d2503bc554] Fetching instance by UUID {{(pid=129322) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:42:54.803856 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.policy [None req-c24f13f3-4cae-46cd-a3fa-28d63b9ce3dd tempest-TestMinimumBasicScenario-102576986 tempest-TestMinimumBasicScenario-102576986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0352a80bdc174b9a9df4eca60b81eba4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fa2c4d6423444e487d259062656129b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129321) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:42:54.806323 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-90e001ea-b5a3-447a-8a91-cf18bf72e1d3 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:42:54.807244 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-90e001ea-b5a3-447a-8a91-cf18bf72e1d3 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:42:54.808666 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-90e001ea-b5a3-447a-8a91-cf18bf72e1d3 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:42:54.809381 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-90e001ea-b5a3-447a-8a91-cf18bf72e1d3 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:42:54.812617 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: INFO nova.api.openstack.requestlog [None req-c24f13f3-4cae-46cd-a3fa-28d63b9ce3dd tempest-TestMinimumBasicScenario-102576986 tempest-TestMinimumBasicScenario-102576986-project] 10.222.0.75 "GET /compute/v2.1/servers/76661008-e6d3-4646-a9ba-d5d0e83a4b65" status: 200 len: 1357 microversion: 2.1 time: 0.223187 May 26 12:42:54.813342 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: [pid: 129321|app: 0|req: 257/538] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 26 12:42:54 2022] GET /compute/v2.1/servers/76661008-e6d3-4646-a9ba-d5d0e83a4b65 => generated 1357 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:42:54.994681 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.policy [None req-90e001ea-b5a3-447a-8a91-cf18bf72e1d3 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e811736979c44b02b14fecb74c6bd7ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675272fb40d4847819f83ec04afecef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129322) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:42:55.003513 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.policy [None req-90e001ea-b5a3-447a-8a91-cf18bf72e1d3 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e811736979c44b02b14fecb74c6bd7ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675272fb40d4847819f83ec04afecef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129322) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:42:55.005357 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.policy [None req-90e001ea-b5a3-447a-8a91-cf18bf72e1d3 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e811736979c44b02b14fecb74c6bd7ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675272fb40d4847819f83ec04afecef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129322) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:42:55.006526 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: INFO nova.api.openstack.requestlog [None req-90e001ea-b5a3-447a-8a91-cf18bf72e1d3 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] 10.222.0.75 "GET /compute/v2.1/servers/bf2f6303-22b9-4cfa-8d4d-61d2503bc554" status: 200 len: 1725 microversion: 2.20 time: 0.228149 May 26 12:42:55.007081 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: [pid: 129322|app: 0|req: 282/539] 10.222.0.75 () {60 vars in 1276 bytes} [Thu May 26 12:42:54 2022] GET /compute/v2.1/servers/bf2f6303-22b9-4cfa-8d4d-61d2503bc554 => generated 1725 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 12:42:55.610861 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi [None req-3c4ef19e-2114-44b6-b1fd-1715adba75bc tempest-TestShelveInstance-546397589 tempest-TestShelveInstance-546397589-project] Calling method '>' {{(pid=129321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:42:55.611466 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.compute.api [None req-3c4ef19e-2114-44b6-b1fd-1715adba75bc tempest-TestShelveInstance-546397589 tempest-TestShelveInstance-546397589-project] [instance: 05cf529d-df00-4ff9-b0d2-0e27563d2861] Fetching instance by UUID {{(pid=129321) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:42:55.618731 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-3c4ef19e-2114-44b6-b1fd-1715adba75bc tempest-TestShelveInstance-546397589 tempest-TestShelveInstance-546397589-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:42:55.619180 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-3c4ef19e-2114-44b6-b1fd-1715adba75bc tempest-TestShelveInstance-546397589 tempest-TestShelveInstance-546397589-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:42:55.619989 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-3c4ef19e-2114-44b6-b1fd-1715adba75bc tempest-TestShelveInstance-546397589 tempest-TestShelveInstance-546397589-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:42:55.620426 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-3c4ef19e-2114-44b6-b1fd-1715adba75bc tempest-TestShelveInstance-546397589 tempest-TestShelveInstance-546397589-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:42:55.684736 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi [None req-7d6e4045-afb5-4efd-b5d6-e8ddc299cc62 tempest-VolumesActionsTest-731506124 tempest-VolumesActionsTest-731506124-project] Calling method '>' {{(pid=129322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:42:55.684736 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.compute.api [None req-7d6e4045-afb5-4efd-b5d6-e8ddc299cc62 tempest-VolumesActionsTest-731506124 tempest-VolumesActionsTest-731506124-project] [instance: 3fd057be-56c1-462d-8ea2-9ca668166ccf] Fetching instance by UUID {{(pid=129322) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:42:55.691752 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-7d6e4045-afb5-4efd-b5d6-e8ddc299cc62 tempest-VolumesActionsTest-731506124 tempest-VolumesActionsTest-731506124-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:42:55.692318 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-7d6e4045-afb5-4efd-b5d6-e8ddc299cc62 tempest-VolumesActionsTest-731506124 tempest-VolumesActionsTest-731506124-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:42:55.693104 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-7d6e4045-afb5-4efd-b5d6-e8ddc299cc62 tempest-VolumesActionsTest-731506124 tempest-VolumesActionsTest-731506124-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:42:55.693685 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-7d6e4045-afb5-4efd-b5d6-e8ddc299cc62 tempest-VolumesActionsTest-731506124 tempest-VolumesActionsTest-731506124-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:42:55.756695 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.policy [None req-7d6e4045-afb5-4efd-b5d6-e8ddc299cc62 tempest-VolumesActionsTest-731506124 tempest-VolumesActionsTest-731506124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f39e076a9e6b401db6de9a2846519591', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa93879e60e470185e8dd71efaaf1a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129322) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:42:55.759855 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.policy [None req-3c4ef19e-2114-44b6-b1fd-1715adba75bc tempest-TestShelveInstance-546397589 tempest-TestShelveInstance-546397589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d9bf2dcfce24386a1aaf9709d88da45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1f2f503ef674a4b97f848b69f8b63c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129321) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:42:55.764985 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: INFO nova.api.openstack.requestlog [None req-7d6e4045-afb5-4efd-b5d6-e8ddc299cc62 tempest-VolumesActionsTest-731506124 tempest-VolumesActionsTest-731506124-project] 10.222.0.75 "GET /compute/v2.1/servers/3fd057be-56c1-462d-8ea2-9ca668166ccf" status: 200 len: 1210 microversion: 2.1 time: 0.085012 May 26 12:42:55.765572 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: [pid: 129322|app: 0|req: 283/540] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 26 12:42:55 2022] GET /compute/v2.1/servers/3fd057be-56c1-462d-8ea2-9ca668166ccf => generated 1210 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:42:55.768164 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: INFO nova.api.openstack.requestlog [None req-3c4ef19e-2114-44b6-b1fd-1715adba75bc tempest-TestShelveInstance-546397589 tempest-TestShelveInstance-546397589-project] 10.222.0.75 "GET /compute/v2.1/servers/05cf529d-df00-4ff9-b0d2-0e27563d2861" status: 200 len: 1259 microversion: 2.1 time: 0.161442 May 26 12:42:55.768773 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: [pid: 129321|app: 0|req: 258/541] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 26 12:42:55 2022] GET /compute/v2.1/servers/05cf529d-df00-4ff9-b0d2-0e27563d2861 => generated 1259 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:42:55.836494 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi [None req-8de1251c-9bd0-469c-be7c-d65e05f82a5c tempest-TestMinimumBasicScenario-102576986 tempest-TestMinimumBasicScenario-102576986-project] Calling method '>' {{(pid=129322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:42:55.837108 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.compute.api [None req-8de1251c-9bd0-469c-be7c-d65e05f82a5c tempest-TestMinimumBasicScenario-102576986 tempest-TestMinimumBasicScenario-102576986-project] [instance: 76661008-e6d3-4646-a9ba-d5d0e83a4b65] Fetching instance by UUID {{(pid=129322) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:42:55.843913 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-8de1251c-9bd0-469c-be7c-d65e05f82a5c tempest-TestMinimumBasicScenario-102576986 tempest-TestMinimumBasicScenario-102576986-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:42:55.844633 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-8de1251c-9bd0-469c-be7c-d65e05f82a5c tempest-TestMinimumBasicScenario-102576986 tempest-TestMinimumBasicScenario-102576986-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:42:55.845474 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-8de1251c-9bd0-469c-be7c-d65e05f82a5c tempest-TestMinimumBasicScenario-102576986 tempest-TestMinimumBasicScenario-102576986-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:42:55.845957 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-8de1251c-9bd0-469c-be7c-d65e05f82a5c tempest-TestMinimumBasicScenario-102576986 tempest-TestMinimumBasicScenario-102576986-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:42:55.991508 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.policy [None req-8de1251c-9bd0-469c-be7c-d65e05f82a5c tempest-TestMinimumBasicScenario-102576986 tempest-TestMinimumBasicScenario-102576986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0352a80bdc174b9a9df4eca60b81eba4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fa2c4d6423444e487d259062656129b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129322) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:42:55.999465 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: INFO nova.api.openstack.requestlog [None req-8de1251c-9bd0-469c-be7c-d65e05f82a5c tempest-TestMinimumBasicScenario-102576986 tempest-TestMinimumBasicScenario-102576986-project] 10.222.0.75 "GET /compute/v2.1/servers/76661008-e6d3-4646-a9ba-d5d0e83a4b65" status: 200 len: 1357 microversion: 2.1 time: 0.167026 May 26 12:42:56.000264 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: [pid: 129322|app: 0|req: 284/542] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 26 12:42:55 2022] GET /compute/v2.1/servers/76661008-e6d3-4646-a9ba-d5d0e83a4b65 => generated 1357 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:42:56.031097 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi [None req-817655b0-bc91-42fa-af1b-7baa46c2eece tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Calling method '>' {{(pid=129321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:42:56.031839 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.compute.api [None req-817655b0-bc91-42fa-af1b-7baa46c2eece tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] [instance: bf2f6303-22b9-4cfa-8d4d-61d2503bc554] Fetching instance by UUID {{(pid=129321) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:42:56.038106 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-817655b0-bc91-42fa-af1b-7baa46c2eece tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:42:56.038558 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-817655b0-bc91-42fa-af1b-7baa46c2eece tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:42:56.039393 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-817655b0-bc91-42fa-af1b-7baa46c2eece tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:42:56.040296 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-817655b0-bc91-42fa-af1b-7baa46c2eece tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:42:56.239034 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.policy [None req-817655b0-bc91-42fa-af1b-7baa46c2eece tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e811736979c44b02b14fecb74c6bd7ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675272fb40d4847819f83ec04afecef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129321) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:42:56.247427 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.policy [None req-817655b0-bc91-42fa-af1b-7baa46c2eece tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e811736979c44b02b14fecb74c6bd7ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675272fb40d4847819f83ec04afecef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129321) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:42:56.248964 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.policy [None req-817655b0-bc91-42fa-af1b-7baa46c2eece tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e811736979c44b02b14fecb74c6bd7ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675272fb40d4847819f83ec04afecef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129321) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:42:56.250144 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: INFO nova.api.openstack.requestlog [None req-817655b0-bc91-42fa-af1b-7baa46c2eece tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] 10.222.0.75 "GET /compute/v2.1/servers/bf2f6303-22b9-4cfa-8d4d-61d2503bc554" status: 200 len: 1725 microversion: 2.20 time: 0.223628 May 26 12:42:56.251639 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: [pid: 129321|app: 0|req: 259/543] 10.222.0.75 () {60 vars in 1276 bytes} [Thu May 26 12:42:56 2022] GET /compute/v2.1/servers/bf2f6303-22b9-4cfa-8d4d-61d2503bc554 => generated 1725 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 12:42:56.785541 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi [None req-e67a26b1-0978-4ec6-b34f-f3c8b0e75f2f tempest-TestShelveInstance-546397589 tempest-TestShelveInstance-546397589-project] Calling method '>' {{(pid=129321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:42:56.786187 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi [None req-e047afcf-7bcf-4b26-a0a2-1a9a48ea581f tempest-VolumesActionsTest-731506124 tempest-VolumesActionsTest-731506124-project] Calling method '>' {{(pid=129322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:42:56.786544 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.compute.api [None req-e047afcf-7bcf-4b26-a0a2-1a9a48ea581f tempest-VolumesActionsTest-731506124 tempest-VolumesActionsTest-731506124-project] [instance: 3fd057be-56c1-462d-8ea2-9ca668166ccf] Fetching instance by UUID {{(pid=129322) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:42:56.787340 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.compute.api [None req-e67a26b1-0978-4ec6-b34f-f3c8b0e75f2f tempest-TestShelveInstance-546397589 tempest-TestShelveInstance-546397589-project] [instance: 05cf529d-df00-4ff9-b0d2-0e27563d2861] Fetching instance by UUID {{(pid=129321) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:42:56.796287 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-e047afcf-7bcf-4b26-a0a2-1a9a48ea581f tempest-VolumesActionsTest-731506124 tempest-VolumesActionsTest-731506124-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:42:56.796794 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-e047afcf-7bcf-4b26-a0a2-1a9a48ea581f tempest-VolumesActionsTest-731506124 tempest-VolumesActionsTest-731506124-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:42:56.797666 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-e047afcf-7bcf-4b26-a0a2-1a9a48ea581f tempest-VolumesActionsTest-731506124 tempest-VolumesActionsTest-731506124-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:42:56.798112 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-e047afcf-7bcf-4b26-a0a2-1a9a48ea581f tempest-VolumesActionsTest-731506124 tempest-VolumesActionsTest-731506124-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:42:56.806303 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-e67a26b1-0978-4ec6-b34f-f3c8b0e75f2f tempest-TestShelveInstance-546397589 tempest-TestShelveInstance-546397589-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:42:56.806752 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-e67a26b1-0978-4ec6-b34f-f3c8b0e75f2f tempest-TestShelveInstance-546397589 tempest-TestShelveInstance-546397589-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:42:56.809416 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-e67a26b1-0978-4ec6-b34f-f3c8b0e75f2f tempest-TestShelveInstance-546397589 tempest-TestShelveInstance-546397589-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:42:56.810040 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-e67a26b1-0978-4ec6-b34f-f3c8b0e75f2f tempest-TestShelveInstance-546397589 tempest-TestShelveInstance-546397589-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:42:56.869885 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.policy [None req-e047afcf-7bcf-4b26-a0a2-1a9a48ea581f tempest-VolumesActionsTest-731506124 tempest-VolumesActionsTest-731506124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f39e076a9e6b401db6de9a2846519591', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa93879e60e470185e8dd71efaaf1a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129322) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:42:56.882339 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: INFO nova.api.openstack.requestlog [None req-e047afcf-7bcf-4b26-a0a2-1a9a48ea581f tempest-VolumesActionsTest-731506124 tempest-VolumesActionsTest-731506124-project] 10.222.0.75 "GET /compute/v2.1/servers/3fd057be-56c1-462d-8ea2-9ca668166ccf" status: 200 len: 1274 microversion: 2.1 time: 0.102162 May 26 12:42:56.888143 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: [pid: 129322|app: 0|req: 285/544] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 26 12:42:56 2022] GET /compute/v2.1/servers/3fd057be-56c1-462d-8ea2-9ca668166ccf => generated 1274 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:42:57.017361 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi [None req-0f8d028f-b934-4cdc-aa9a-580759c907e8 tempest-TestMinimumBasicScenario-102576986 tempest-TestMinimumBasicScenario-102576986-project] Calling method '>' {{(pid=129322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:42:57.017986 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.compute.api [None req-0f8d028f-b934-4cdc-aa9a-580759c907e8 tempest-TestMinimumBasicScenario-102576986 tempest-TestMinimumBasicScenario-102576986-project] [instance: 76661008-e6d3-4646-a9ba-d5d0e83a4b65] Fetching instance by UUID {{(pid=129322) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:42:57.025132 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-0f8d028f-b934-4cdc-aa9a-580759c907e8 tempest-TestMinimumBasicScenario-102576986 tempest-TestMinimumBasicScenario-102576986-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:42:57.025701 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-0f8d028f-b934-4cdc-aa9a-580759c907e8 tempest-TestMinimumBasicScenario-102576986 tempest-TestMinimumBasicScenario-102576986-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:42:57.026649 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-0f8d028f-b934-4cdc-aa9a-580759c907e8 tempest-TestMinimumBasicScenario-102576986 tempest-TestMinimumBasicScenario-102576986-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:42:57.027175 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-0f8d028f-b934-4cdc-aa9a-580759c907e8 tempest-TestMinimumBasicScenario-102576986 tempest-TestMinimumBasicScenario-102576986-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:42:57.102021 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.policy [None req-e67a26b1-0978-4ec6-b34f-f3c8b0e75f2f tempest-TestShelveInstance-546397589 tempest-TestShelveInstance-546397589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d9bf2dcfce24386a1aaf9709d88da45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1f2f503ef674a4b97f848b69f8b63c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129321) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:42:57.110495 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: INFO nova.api.openstack.requestlog [None req-e67a26b1-0978-4ec6-b34f-f3c8b0e75f2f tempest-TestShelveInstance-546397589 tempest-TestShelveInstance-546397589-project] 10.222.0.75 "GET /compute/v2.1/servers/05cf529d-df00-4ff9-b0d2-0e27563d2861" status: 200 len: 1259 microversion: 2.1 time: 0.329371 May 26 12:42:57.111090 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: [pid: 129321|app: 0|req: 260/545] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 26 12:42:56 2022] GET /compute/v2.1/servers/05cf529d-df00-4ff9-b0d2-0e27563d2861 => generated 1259 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:42:57.166663 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.policy [None req-0f8d028f-b934-4cdc-aa9a-580759c907e8 tempest-TestMinimumBasicScenario-102576986 tempest-TestMinimumBasicScenario-102576986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0352a80bdc174b9a9df4eca60b81eba4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fa2c4d6423444e487d259062656129b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129322) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:42:57.174662 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: INFO nova.api.openstack.requestlog [None req-0f8d028f-b934-4cdc-aa9a-580759c907e8 tempest-TestMinimumBasicScenario-102576986 tempest-TestMinimumBasicScenario-102576986-project] 10.222.0.75 "GET /compute/v2.1/servers/76661008-e6d3-4646-a9ba-d5d0e83a4b65" status: 200 len: 1357 microversion: 2.1 time: 0.162141 May 26 12:42:57.175199 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: [pid: 129322|app: 0|req: 286/546] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 26 12:42:57 2022] GET /compute/v2.1/servers/76661008-e6d3-4646-a9ba-d5d0e83a4b65 => generated 1357 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 12:42:57.272753 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi [None req-1c65f320-20a2-45dc-afba-f5bdd0e5b5fb tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Calling method '>' {{(pid=129321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:42:57.273352 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.compute.api [None req-1c65f320-20a2-45dc-afba-f5bdd0e5b5fb tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] [instance: bf2f6303-22b9-4cfa-8d4d-61d2503bc554] Fetching instance by UUID {{(pid=129321) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:42:57.280432 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-1c65f320-20a2-45dc-afba-f5bdd0e5b5fb tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:42:57.280871 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-1c65f320-20a2-45dc-afba-f5bdd0e5b5fb tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:42:57.281617 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-1c65f320-20a2-45dc-afba-f5bdd0e5b5fb tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:42:57.282078 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-1c65f320-20a2-45dc-afba-f5bdd0e5b5fb tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:42:57.449730 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.policy [None req-1c65f320-20a2-45dc-afba-f5bdd0e5b5fb tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e811736979c44b02b14fecb74c6bd7ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675272fb40d4847819f83ec04afecef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129321) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:42:57.461961 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.policy [None req-1c65f320-20a2-45dc-afba-f5bdd0e5b5fb tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e811736979c44b02b14fecb74c6bd7ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675272fb40d4847819f83ec04afecef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129321) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:42:57.464236 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.policy [None req-1c65f320-20a2-45dc-afba-f5bdd0e5b5fb tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e811736979c44b02b14fecb74c6bd7ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675272fb40d4847819f83ec04afecef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129321) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:42:57.465807 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: INFO nova.api.openstack.requestlog [None req-1c65f320-20a2-45dc-afba-f5bdd0e5b5fb tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] 10.222.0.75 "GET /compute/v2.1/servers/bf2f6303-22b9-4cfa-8d4d-61d2503bc554" status: 200 len: 1725 microversion: 2.20 time: 0.196828 May 26 12:42:57.466562 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: [pid: 129321|app: 0|req: 261/547] 10.222.0.75 () {60 vars in 1276 bytes} [Thu May 26 12:42:57 2022] GET /compute/v2.1/servers/bf2f6303-22b9-4cfa-8d4d-61d2503bc554 => generated 1725 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 12:42:57.901243 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi [None req-3e71b93a-91c3-4a4a-b34d-966408748267 tempest-VolumesActionsTest-731506124 tempest-VolumesActionsTest-731506124-project] Calling method '>' {{(pid=129322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:42:57.902477 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.compute.api [None req-3e71b93a-91c3-4a4a-b34d-966408748267 tempest-VolumesActionsTest-731506124 tempest-VolumesActionsTest-731506124-project] [instance: 3fd057be-56c1-462d-8ea2-9ca668166ccf] Fetching instance by UUID {{(pid=129322) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:42:57.913455 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-3e71b93a-91c3-4a4a-b34d-966408748267 tempest-VolumesActionsTest-731506124 tempest-VolumesActionsTest-731506124-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:42:57.915681 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-3e71b93a-91c3-4a4a-b34d-966408748267 tempest-VolumesActionsTest-731506124 tempest-VolumesActionsTest-731506124-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:42:57.916466 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-3e71b93a-91c3-4a4a-b34d-966408748267 tempest-VolumesActionsTest-731506124 tempest-VolumesActionsTest-731506124-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:42:57.917409 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-3e71b93a-91c3-4a4a-b34d-966408748267 tempest-VolumesActionsTest-731506124 tempest-VolumesActionsTest-731506124-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:42:57.989259 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.policy [None req-3e71b93a-91c3-4a4a-b34d-966408748267 tempest-VolumesActionsTest-731506124 tempest-VolumesActionsTest-731506124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f39e076a9e6b401db6de9a2846519591', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa93879e60e470185e8dd71efaaf1a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129322) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:42:57.997240 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: INFO nova.api.openstack.requestlog [None req-3e71b93a-91c3-4a4a-b34d-966408748267 tempest-VolumesActionsTest-731506124 tempest-VolumesActionsTest-731506124-project] 10.222.0.75 "GET /compute/v2.1/servers/3fd057be-56c1-462d-8ea2-9ca668166ccf" status: 200 len: 1272 microversion: 2.1 time: 0.100870 May 26 12:42:57.997834 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: [pid: 129322|app: 0|req: 287/548] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 26 12:42:57 2022] GET /compute/v2.1/servers/3fd057be-56c1-462d-8ea2-9ca668166ccf => generated 1272 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:42:58.031006 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi [req-77fe920b-eab3-4316-a1b9-fd95a65dde97 req-17d74708-84b0-4ecd-a804-2eca2a7856a8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "76661008-e6d3-4646-a9ba-d5d0e83a4b65", "name": "network-vif-plugged", "status": "completed", "tag": "4aebdf54-88c1-42d5-a224-778a4410cff0"}]} {{(pid=129321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 12:42:58.041016 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [req-77fe920b-eab3-4316-a1b9-fd95a65dde97 req-17d74708-84b0-4ecd-a804-2eca2a7856a8 service nova] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:42:58.042081 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [req-77fe920b-eab3-4316-a1b9-fd95a65dde97 req-17d74708-84b0-4ecd-a804-2eca2a7856a8 service nova] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:42:58.057314 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: INFO nova.api.openstack.compute.server_external_events [req-77fe920b-eab3-4316-a1b9-fd95a65dde97 req-17d74708-84b0-4ecd-a804-2eca2a7856a8 service nova] Creating event network-vif-plugged:4aebdf54-88c1-42d5-a224-778a4410cff0 for instance 76661008-e6d3-4646-a9ba-d5d0e83a4b65 on hv-cinder-81966 May 26 12:42:58.063816 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: INFO nova.api.openstack.requestlog [req-77fe920b-eab3-4316-a1b9-fd95a65dde97 req-17d74708-84b0-4ecd-a804-2eca2a7856a8 service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037067 May 26 12:42:58.064829 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: [pid: 129321|app: 0|req: 262/549] 10.222.0.75 () {64 vars in 1317 bytes} [Thu May 26 12:42:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 12:42:58.126783 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi [None req-091305f4-a825-4805-badf-09037acb292e tempest-TestShelveInstance-546397589 tempest-TestShelveInstance-546397589-project] Calling method '>' {{(pid=129322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:42:58.127399 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.compute.api [None req-091305f4-a825-4805-badf-09037acb292e tempest-TestShelveInstance-546397589 tempest-TestShelveInstance-546397589-project] [instance: 05cf529d-df00-4ff9-b0d2-0e27563d2861] Fetching instance by UUID {{(pid=129322) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:42:58.134007 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-091305f4-a825-4805-badf-09037acb292e tempest-TestShelveInstance-546397589 tempest-TestShelveInstance-546397589-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:42:58.134446 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-091305f4-a825-4805-badf-09037acb292e tempest-TestShelveInstance-546397589 tempest-TestShelveInstance-546397589-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:42:58.135203 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-091305f4-a825-4805-badf-09037acb292e tempest-TestShelveInstance-546397589 tempest-TestShelveInstance-546397589-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:42:58.135660 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-091305f4-a825-4805-badf-09037acb292e tempest-TestShelveInstance-546397589 tempest-TestShelveInstance-546397589-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:42:58.193096 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi [None req-2b5c34cb-c3dc-4764-b247-ea480122b609 tempest-TestMinimumBasicScenario-102576986 tempest-TestMinimumBasicScenario-102576986-project] Calling method '>' {{(pid=129321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:42:58.193794 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.compute.api [None req-2b5c34cb-c3dc-4764-b247-ea480122b609 tempest-TestMinimumBasicScenario-102576986 tempest-TestMinimumBasicScenario-102576986-project] [instance: 76661008-e6d3-4646-a9ba-d5d0e83a4b65] Fetching instance by UUID {{(pid=129321) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:42:58.200625 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-2b5c34cb-c3dc-4764-b247-ea480122b609 tempest-TestMinimumBasicScenario-102576986 tempest-TestMinimumBasicScenario-102576986-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:42:58.201394 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-2b5c34cb-c3dc-4764-b247-ea480122b609 tempest-TestMinimumBasicScenario-102576986 tempest-TestMinimumBasicScenario-102576986-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:42:58.202225 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-2b5c34cb-c3dc-4764-b247-ea480122b609 tempest-TestMinimumBasicScenario-102576986 tempest-TestMinimumBasicScenario-102576986-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:42:58.203321 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-2b5c34cb-c3dc-4764-b247-ea480122b609 tempest-TestMinimumBasicScenario-102576986 tempest-TestMinimumBasicScenario-102576986-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:42:58.284887 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.policy [None req-091305f4-a825-4805-badf-09037acb292e tempest-TestShelveInstance-546397589 tempest-TestShelveInstance-546397589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d9bf2dcfce24386a1aaf9709d88da45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1f2f503ef674a4b97f848b69f8b63c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129322) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:42:58.292743 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: INFO nova.api.openstack.requestlog [None req-091305f4-a825-4805-badf-09037acb292e tempest-TestShelveInstance-546397589 tempest-TestShelveInstance-546397589-project] 10.222.0.75 "GET /compute/v2.1/servers/05cf529d-df00-4ff9-b0d2-0e27563d2861" status: 200 len: 1259 microversion: 2.1 time: 0.170186 May 26 12:42:58.293318 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: [pid: 129322|app: 0|req: 288/550] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 26 12:42:58 2022] GET /compute/v2.1/servers/05cf529d-df00-4ff9-b0d2-0e27563d2861 => generated 1259 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:42:58.485721 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi [None req-a7dcef8c-3b2f-4299-87f7-d2d6707c1ea7 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Calling method '>' {{(pid=129322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:42:58.486253 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.compute.api [None req-a7dcef8c-3b2f-4299-87f7-d2d6707c1ea7 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] [instance: bf2f6303-22b9-4cfa-8d4d-61d2503bc554] Fetching instance by UUID {{(pid=129322) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:42:58.492962 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-a7dcef8c-3b2f-4299-87f7-d2d6707c1ea7 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:42:58.493411 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-a7dcef8c-3b2f-4299-87f7-d2d6707c1ea7 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:42:58.494204 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-a7dcef8c-3b2f-4299-87f7-d2d6707c1ea7 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:42:58.494917 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-a7dcef8c-3b2f-4299-87f7-d2d6707c1ea7 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:42:58.601628 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.policy [None req-2b5c34cb-c3dc-4764-b247-ea480122b609 tempest-TestMinimumBasicScenario-102576986 tempest-TestMinimumBasicScenario-102576986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0352a80bdc174b9a9df4eca60b81eba4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fa2c4d6423444e487d259062656129b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129321) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:42:58.609633 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: INFO nova.api.openstack.requestlog [None req-2b5c34cb-c3dc-4764-b247-ea480122b609 tempest-TestMinimumBasicScenario-102576986 tempest-TestMinimumBasicScenario-102576986-project] 10.222.0.75 "GET /compute/v2.1/servers/76661008-e6d3-4646-a9ba-d5d0e83a4b65" status: 200 len: 1357 microversion: 2.1 time: 0.421363 May 26 12:42:58.610659 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: [pid: 129321|app: 0|req: 263/551] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 26 12:42:58 2022] GET /compute/v2.1/servers/76661008-e6d3-4646-a9ba-d5d0e83a4b65 => generated 1357 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:42:58.630662 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.policy [None req-a7dcef8c-3b2f-4299-87f7-d2d6707c1ea7 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e811736979c44b02b14fecb74c6bd7ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675272fb40d4847819f83ec04afecef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129322) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:42:58.638750 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.policy [None req-a7dcef8c-3b2f-4299-87f7-d2d6707c1ea7 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e811736979c44b02b14fecb74c6bd7ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675272fb40d4847819f83ec04afecef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129322) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:42:58.640321 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.policy [None req-a7dcef8c-3b2f-4299-87f7-d2d6707c1ea7 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e811736979c44b02b14fecb74c6bd7ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675272fb40d4847819f83ec04afecef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129322) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:42:58.641781 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: INFO nova.api.openstack.requestlog [None req-a7dcef8c-3b2f-4299-87f7-d2d6707c1ea7 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] 10.222.0.75 "GET /compute/v2.1/servers/bf2f6303-22b9-4cfa-8d4d-61d2503bc554" status: 200 len: 1746 microversion: 2.20 time: 0.160354 May 26 12:42:58.642556 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: [pid: 129322|app: 0|req: 289/552] 10.222.0.75 () {60 vars in 1276 bytes} [Thu May 26 12:42:58 2022] GET /compute/v2.1/servers/bf2f6303-22b9-4cfa-8d4d-61d2503bc554 => generated 1746 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 12:42:59.017450 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi [None req-8599d310-8da9-4f26-acae-922a5682dc10 tempest-VolumesActionsTest-731506124 tempest-VolumesActionsTest-731506124-project] Calling method '>' {{(pid=129321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:42:59.018249 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.compute.api [None req-8599d310-8da9-4f26-acae-922a5682dc10 tempest-VolumesActionsTest-731506124 tempest-VolumesActionsTest-731506124-project] [instance: 3fd057be-56c1-462d-8ea2-9ca668166ccf] Fetching instance by UUID {{(pid=129321) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:42:59.027525 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-8599d310-8da9-4f26-acae-922a5682dc10 tempest-VolumesActionsTest-731506124 tempest-VolumesActionsTest-731506124-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:42:59.028123 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-8599d310-8da9-4f26-acae-922a5682dc10 tempest-VolumesActionsTest-731506124 tempest-VolumesActionsTest-731506124-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:42:59.029335 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-8599d310-8da9-4f26-acae-922a5682dc10 tempest-VolumesActionsTest-731506124 tempest-VolumesActionsTest-731506124-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:42:59.029804 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-8599d310-8da9-4f26-acae-922a5682dc10 tempest-VolumesActionsTest-731506124 tempest-VolumesActionsTest-731506124-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:42:59.045998 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG dbcounter [-] [129321] Writing DB stats nova_cell1:SELECT=100 {{(pid=129321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:42:59.179128 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.policy [None req-8599d310-8da9-4f26-acae-922a5682dc10 tempest-VolumesActionsTest-731506124 tempest-VolumesActionsTest-731506124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f39e076a9e6b401db6de9a2846519591', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa93879e60e470185e8dd71efaaf1a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129321) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:42:59.190119 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: INFO nova.api.openstack.requestlog [None req-8599d310-8da9-4f26-acae-922a5682dc10 tempest-VolumesActionsTest-731506124 tempest-VolumesActionsTest-731506124-project] 10.222.0.75 "GET /compute/v2.1/servers/3fd057be-56c1-462d-8ea2-9ca668166ccf" status: 200 len: 1314 microversion: 2.1 time: 0.179101 May 26 12:42:59.190717 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: [pid: 129321|app: 0|req: 264/553] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 26 12:42:59 2022] GET /compute/v2.1/servers/3fd057be-56c1-462d-8ea2-9ca668166ccf => generated 1314 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:42:59.309741 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi [None req-e516a463-3368-4962-888e-e2d1dde1953e tempest-TestShelveInstance-546397589 tempest-TestShelveInstance-546397589-project] Calling method '>' {{(pid=129322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:42:59.310390 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.compute.api [None req-e516a463-3368-4962-888e-e2d1dde1953e tempest-TestShelveInstance-546397589 tempest-TestShelveInstance-546397589-project] [instance: 05cf529d-df00-4ff9-b0d2-0e27563d2861] Fetching instance by UUID {{(pid=129322) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:42:59.316902 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-e516a463-3368-4962-888e-e2d1dde1953e tempest-TestShelveInstance-546397589 tempest-TestShelveInstance-546397589-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:42:59.317348 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-e516a463-3368-4962-888e-e2d1dde1953e tempest-TestShelveInstance-546397589 tempest-TestShelveInstance-546397589-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:42:59.318105 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-e516a463-3368-4962-888e-e2d1dde1953e tempest-TestShelveInstance-546397589 tempest-TestShelveInstance-546397589-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:42:59.318539 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-e516a463-3368-4962-888e-e2d1dde1953e tempest-TestShelveInstance-546397589 tempest-TestShelveInstance-546397589-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:42:59.479306 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.policy [None req-e516a463-3368-4962-888e-e2d1dde1953e tempest-TestShelveInstance-546397589 tempest-TestShelveInstance-546397589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d9bf2dcfce24386a1aaf9709d88da45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1f2f503ef674a4b97f848b69f8b63c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129322) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:42:59.489048 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: INFO nova.api.openstack.requestlog [None req-e516a463-3368-4962-888e-e2d1dde1953e tempest-TestShelveInstance-546397589 tempest-TestShelveInstance-546397589-project] 10.222.0.75 "GET /compute/v2.1/servers/05cf529d-df00-4ff9-b0d2-0e27563d2861" status: 200 len: 1259 microversion: 2.1 time: 0.183317 May 26 12:42:59.489603 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: [pid: 129322|app: 0|req: 290/554] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 26 12:42:59 2022] GET /compute/v2.1/servers/05cf529d-df00-4ff9-b0d2-0e27563d2861 => generated 1259 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:42:59.628538 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi [None req-8136e820-0d94-4664-9608-83446fde7c73 tempest-TestMinimumBasicScenario-102576986 tempest-TestMinimumBasicScenario-102576986-project] Calling method '>' {{(pid=129321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:42:59.629152 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.compute.api [None req-8136e820-0d94-4664-9608-83446fde7c73 tempest-TestMinimumBasicScenario-102576986 tempest-TestMinimumBasicScenario-102576986-project] [instance: 76661008-e6d3-4646-a9ba-d5d0e83a4b65] Fetching instance by UUID {{(pid=129321) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:42:59.635565 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-8136e820-0d94-4664-9608-83446fde7c73 tempest-TestMinimumBasicScenario-102576986 tempest-TestMinimumBasicScenario-102576986-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:42:59.636069 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-8136e820-0d94-4664-9608-83446fde7c73 tempest-TestMinimumBasicScenario-102576986 tempest-TestMinimumBasicScenario-102576986-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:42:59.636831 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-8136e820-0d94-4664-9608-83446fde7c73 tempest-TestMinimumBasicScenario-102576986 tempest-TestMinimumBasicScenario-102576986-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:42:59.637272 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-8136e820-0d94-4664-9608-83446fde7c73 tempest-TestMinimumBasicScenario-102576986 tempest-TestMinimumBasicScenario-102576986-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:42:59.661752 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi [None req-8a6e2066-15a0-4568-b49c-13b0529479f9 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Calling method '>' {{(pid=129322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:42:59.662453 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.compute.api [None req-8a6e2066-15a0-4568-b49c-13b0529479f9 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] [instance: bf2f6303-22b9-4cfa-8d4d-61d2503bc554] Fetching instance by UUID {{(pid=129322) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:42:59.669670 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-8a6e2066-15a0-4568-b49c-13b0529479f9 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:42:59.670097 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-8a6e2066-15a0-4568-b49c-13b0529479f9 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:42:59.670862 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-8a6e2066-15a0-4568-b49c-13b0529479f9 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:42:59.671281 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-8a6e2066-15a0-4568-b49c-13b0529479f9 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:42:59.778643 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.policy [None req-8136e820-0d94-4664-9608-83446fde7c73 tempest-TestMinimumBasicScenario-102576986 tempest-TestMinimumBasicScenario-102576986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0352a80bdc174b9a9df4eca60b81eba4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fa2c4d6423444e487d259062656129b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129321) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:42:59.791668 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: INFO nova.api.openstack.requestlog [None req-8136e820-0d94-4664-9608-83446fde7c73 tempest-TestMinimumBasicScenario-102576986 tempest-TestMinimumBasicScenario-102576986-project] 10.222.0.75 "GET /compute/v2.1/servers/76661008-e6d3-4646-a9ba-d5d0e83a4b65" status: 200 len: 1357 microversion: 2.1 time: 0.168558 May 26 12:42:59.792557 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: [pid: 129321|app: 0|req: 265/555] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 26 12:42:59 2022] GET /compute/v2.1/servers/76661008-e6d3-4646-a9ba-d5d0e83a4b65 => generated 1357 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:42:59.809027 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.policy [None req-8a6e2066-15a0-4568-b49c-13b0529479f9 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e811736979c44b02b14fecb74c6bd7ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675272fb40d4847819f83ec04afecef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129322) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:42:59.817832 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.policy [None req-8a6e2066-15a0-4568-b49c-13b0529479f9 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e811736979c44b02b14fecb74c6bd7ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675272fb40d4847819f83ec04afecef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129322) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:42:59.819346 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.policy [None req-8a6e2066-15a0-4568-b49c-13b0529479f9 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e811736979c44b02b14fecb74c6bd7ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675272fb40d4847819f83ec04afecef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129322) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:42:59.820549 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: INFO nova.api.openstack.requestlog [None req-8a6e2066-15a0-4568-b49c-13b0529479f9 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] 10.222.0.75 "GET /compute/v2.1/servers/bf2f6303-22b9-4cfa-8d4d-61d2503bc554" status: 200 len: 1746 microversion: 2.20 time: 0.163197 May 26 12:42:59.821111 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: [pid: 129322|app: 0|req: 291/556] 10.222.0.75 () {60 vars in 1276 bytes} [Thu May 26 12:42:59 2022] GET /compute/v2.1/servers/bf2f6303-22b9-4cfa-8d4d-61d2503bc554 => generated 1746 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 26 12:43:00.206698 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi [None req-0fb857a3-8ae1-4692-b858-88540c8bac96 tempest-VolumesActionsTest-731506124 tempest-VolumesActionsTest-731506124-project] Calling method '>' {{(pid=129321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:43:00.207323 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.compute.api [None req-0fb857a3-8ae1-4692-b858-88540c8bac96 tempest-VolumesActionsTest-731506124 tempest-VolumesActionsTest-731506124-project] [instance: 3fd057be-56c1-462d-8ea2-9ca668166ccf] Fetching instance by UUID {{(pid=129321) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:43:00.214018 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-0fb857a3-8ae1-4692-b858-88540c8bac96 tempest-VolumesActionsTest-731506124 tempest-VolumesActionsTest-731506124-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:43:00.214482 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-0fb857a3-8ae1-4692-b858-88540c8bac96 tempest-VolumesActionsTest-731506124 tempest-VolumesActionsTest-731506124-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:43:00.215232 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-0fb857a3-8ae1-4692-b858-88540c8bac96 tempest-VolumesActionsTest-731506124 tempest-VolumesActionsTest-731506124-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:43:00.215686 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-0fb857a3-8ae1-4692-b858-88540c8bac96 tempest-VolumesActionsTest-731506124 tempest-VolumesActionsTest-731506124-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:43:00.362362 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.policy [None req-0fb857a3-8ae1-4692-b858-88540c8bac96 tempest-VolumesActionsTest-731506124 tempest-VolumesActionsTest-731506124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f39e076a9e6b401db6de9a2846519591', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa93879e60e470185e8dd71efaaf1a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129321) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:43:00.373585 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: INFO nova.api.openstack.requestlog [None req-0fb857a3-8ae1-4692-b858-88540c8bac96 tempest-VolumesActionsTest-731506124 tempest-VolumesActionsTest-731506124-project] 10.222.0.75 "GET /compute/v2.1/servers/3fd057be-56c1-462d-8ea2-9ca668166ccf" status: 200 len: 1314 microversion: 2.1 time: 0.170578 May 26 12:43:00.374607 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: [pid: 129321|app: 0|req: 266/557] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 26 12:43:00 2022] GET /compute/v2.1/servers/3fd057be-56c1-462d-8ea2-9ca668166ccf => generated 1314 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:43:00.506540 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi [None req-6fcacccd-67c8-4855-a5eb-30b7cf85986f tempest-TestShelveInstance-546397589 tempest-TestShelveInstance-546397589-project] Calling method '>' {{(pid=129322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:43:00.507172 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.compute.api [None req-6fcacccd-67c8-4855-a5eb-30b7cf85986f tempest-TestShelveInstance-546397589 tempest-TestShelveInstance-546397589-project] [instance: 05cf529d-df00-4ff9-b0d2-0e27563d2861] Fetching instance by UUID {{(pid=129322) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:43:00.513558 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-6fcacccd-67c8-4855-a5eb-30b7cf85986f tempest-TestShelveInstance-546397589 tempest-TestShelveInstance-546397589-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:43:00.513998 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-6fcacccd-67c8-4855-a5eb-30b7cf85986f tempest-TestShelveInstance-546397589 tempest-TestShelveInstance-546397589-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:43:00.514749 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-6fcacccd-67c8-4855-a5eb-30b7cf85986f tempest-TestShelveInstance-546397589 tempest-TestShelveInstance-546397589-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:43:00.515177 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-6fcacccd-67c8-4855-a5eb-30b7cf85986f tempest-TestShelveInstance-546397589 tempest-TestShelveInstance-546397589-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:43:00.670611 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.policy [None req-6fcacccd-67c8-4855-a5eb-30b7cf85986f tempest-TestShelveInstance-546397589 tempest-TestShelveInstance-546397589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d9bf2dcfce24386a1aaf9709d88da45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1f2f503ef674a4b97f848b69f8b63c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129322) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:43:00.683671 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: INFO nova.api.openstack.requestlog [None req-6fcacccd-67c8-4855-a5eb-30b7cf85986f tempest-TestShelveInstance-546397589 tempest-TestShelveInstance-546397589-project] 10.222.0.75 "GET /compute/v2.1/servers/05cf529d-df00-4ff9-b0d2-0e27563d2861" status: 200 len: 1259 microversion: 2.1 time: 0.180999 May 26 12:43:00.684278 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: [pid: 129322|app: 0|req: 292/558] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 26 12:43:00 2022] GET /compute/v2.1/servers/05cf529d-df00-4ff9-b0d2-0e27563d2861 => generated 1259 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:43:00.809770 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi [None req-ba0fc383-299c-4e65-be71-5927e87d2aa4 tempest-TestMinimumBasicScenario-102576986 tempest-TestMinimumBasicScenario-102576986-project] Calling method '>' {{(pid=129321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:43:00.810403 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.compute.api [None req-ba0fc383-299c-4e65-be71-5927e87d2aa4 tempest-TestMinimumBasicScenario-102576986 tempest-TestMinimumBasicScenario-102576986-project] [instance: 76661008-e6d3-4646-a9ba-d5d0e83a4b65] Fetching instance by UUID {{(pid=129321) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:43:00.817006 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-ba0fc383-299c-4e65-be71-5927e87d2aa4 tempest-TestMinimumBasicScenario-102576986 tempest-TestMinimumBasicScenario-102576986-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:43:00.817463 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-ba0fc383-299c-4e65-be71-5927e87d2aa4 tempest-TestMinimumBasicScenario-102576986 tempest-TestMinimumBasicScenario-102576986-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:43:00.818213 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-ba0fc383-299c-4e65-be71-5927e87d2aa4 tempest-TestMinimumBasicScenario-102576986 tempest-TestMinimumBasicScenario-102576986-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:43:00.818645 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-ba0fc383-299c-4e65-be71-5927e87d2aa4 tempest-TestMinimumBasicScenario-102576986 tempest-TestMinimumBasicScenario-102576986-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:43:00.839822 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi [None req-f4efb13e-1e28-408c-bf4d-710d737882ed tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Calling method '>' {{(pid=129322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:43:00.840429 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.compute.api [None req-f4efb13e-1e28-408c-bf4d-710d737882ed tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] [instance: bf2f6303-22b9-4cfa-8d4d-61d2503bc554] Fetching instance by UUID {{(pid=129322) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:43:00.846954 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-f4efb13e-1e28-408c-bf4d-710d737882ed tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:43:00.847401 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-f4efb13e-1e28-408c-bf4d-710d737882ed tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:43:00.848201 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-f4efb13e-1e28-408c-bf4d-710d737882ed tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:43:00.848627 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-f4efb13e-1e28-408c-bf4d-710d737882ed tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:43:00.851320 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG dbcounter [-] [129322] Writing DB stats nova_cell1:SELECT=100 {{(pid=129322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:43:00.963396 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.policy [None req-ba0fc383-299c-4e65-be71-5927e87d2aa4 tempest-TestMinimumBasicScenario-102576986 tempest-TestMinimumBasicScenario-102576986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0352a80bdc174b9a9df4eca60b81eba4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fa2c4d6423444e487d259062656129b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129321) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:43:00.972767 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: INFO nova.api.openstack.requestlog [None req-ba0fc383-299c-4e65-be71-5927e87d2aa4 tempest-TestMinimumBasicScenario-102576986 tempest-TestMinimumBasicScenario-102576986-project] 10.222.0.75 "GET /compute/v2.1/servers/76661008-e6d3-4646-a9ba-d5d0e83a4b65" status: 200 len: 1357 microversion: 2.1 time: 0.167144 May 26 12:43:00.973737 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: [pid: 129321|app: 0|req: 267/559] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 26 12:43:00 2022] GET /compute/v2.1/servers/76661008-e6d3-4646-a9ba-d5d0e83a4b65 => generated 1357 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:43:01.001530 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.policy [None req-f4efb13e-1e28-408c-bf4d-710d737882ed tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e811736979c44b02b14fecb74c6bd7ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675272fb40d4847819f83ec04afecef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129322) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:43:01.009975 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.policy [None req-f4efb13e-1e28-408c-bf4d-710d737882ed tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e811736979c44b02b14fecb74c6bd7ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675272fb40d4847819f83ec04afecef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129322) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:43:01.011650 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.policy [None req-f4efb13e-1e28-408c-bf4d-710d737882ed tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e811736979c44b02b14fecb74c6bd7ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675272fb40d4847819f83ec04afecef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129322) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:43:01.012818 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: INFO nova.api.openstack.requestlog [None req-f4efb13e-1e28-408c-bf4d-710d737882ed tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] 10.222.0.75 "GET /compute/v2.1/servers/bf2f6303-22b9-4cfa-8d4d-61d2503bc554" status: 200 len: 1746 microversion: 2.20 time: 0.177091 May 26 12:43:01.013389 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: [pid: 129322|app: 0|req: 293/560] 10.222.0.75 () {60 vars in 1276 bytes} [Thu May 26 12:43:00 2022] GET /compute/v2.1/servers/bf2f6303-22b9-4cfa-8d4d-61d2503bc554 => generated 1746 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 12:43:01.392038 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi [None req-746832dc-c7e3-42ce-bd27-68e8a211a3b9 tempest-VolumesActionsTest-731506124 tempest-VolumesActionsTest-731506124-project] Calling method '>' {{(pid=129321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:43:01.393458 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.compute.api [None req-746832dc-c7e3-42ce-bd27-68e8a211a3b9 tempest-VolumesActionsTest-731506124 tempest-VolumesActionsTest-731506124-project] [instance: 3fd057be-56c1-462d-8ea2-9ca668166ccf] Fetching instance by UUID {{(pid=129321) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:43:01.395862 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG dbcounter [-] [129321] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=129321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:43:01.401999 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-746832dc-c7e3-42ce-bd27-68e8a211a3b9 tempest-VolumesActionsTest-731506124 tempest-VolumesActionsTest-731506124-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:43:01.402453 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-746832dc-c7e3-42ce-bd27-68e8a211a3b9 tempest-VolumesActionsTest-731506124 tempest-VolumesActionsTest-731506124-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:43:01.403270 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-746832dc-c7e3-42ce-bd27-68e8a211a3b9 tempest-VolumesActionsTest-731506124 tempest-VolumesActionsTest-731506124-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:43:01.403710 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-746832dc-c7e3-42ce-bd27-68e8a211a3b9 tempest-VolumesActionsTest-731506124 tempest-VolumesActionsTest-731506124-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:43:01.550614 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.policy [None req-746832dc-c7e3-42ce-bd27-68e8a211a3b9 tempest-VolumesActionsTest-731506124 tempest-VolumesActionsTest-731506124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f39e076a9e6b401db6de9a2846519591', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa93879e60e470185e8dd71efaaf1a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129321) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:43:01.558815 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: INFO nova.api.openstack.requestlog [None req-746832dc-c7e3-42ce-bd27-68e8a211a3b9 tempest-VolumesActionsTest-731506124 tempest-VolumesActionsTest-731506124-project] 10.222.0.75 "GET /compute/v2.1/servers/3fd057be-56c1-462d-8ea2-9ca668166ccf" status: 200 len: 1314 microversion: 2.1 time: 0.170878 May 26 12:43:01.559396 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: [pid: 129321|app: 0|req: 268/561] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 26 12:43:01 2022] GET /compute/v2.1/servers/3fd057be-56c1-462d-8ea2-9ca668166ccf => generated 1314 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:43:01.703959 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi [None req-38bcfc5d-c42d-4c7a-b1a9-829e60ce34bc tempest-TestShelveInstance-546397589 tempest-TestShelveInstance-546397589-project] Calling method '>' {{(pid=129322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:43:01.704803 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.compute.api [None req-38bcfc5d-c42d-4c7a-b1a9-829e60ce34bc tempest-TestShelveInstance-546397589 tempest-TestShelveInstance-546397589-project] [instance: 05cf529d-df00-4ff9-b0d2-0e27563d2861] Fetching instance by UUID {{(pid=129322) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:43:01.711914 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-38bcfc5d-c42d-4c7a-b1a9-829e60ce34bc tempest-TestShelveInstance-546397589 tempest-TestShelveInstance-546397589-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:43:01.712625 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-38bcfc5d-c42d-4c7a-b1a9-829e60ce34bc tempest-TestShelveInstance-546397589 tempest-TestShelveInstance-546397589-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:43:01.713792 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-38bcfc5d-c42d-4c7a-b1a9-829e60ce34bc tempest-TestShelveInstance-546397589 tempest-TestShelveInstance-546397589-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:43:01.714535 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-38bcfc5d-c42d-4c7a-b1a9-829e60ce34bc tempest-TestShelveInstance-546397589 tempest-TestShelveInstance-546397589-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:43:01.866957 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.policy [None req-38bcfc5d-c42d-4c7a-b1a9-829e60ce34bc tempest-TestShelveInstance-546397589 tempest-TestShelveInstance-546397589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d9bf2dcfce24386a1aaf9709d88da45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1f2f503ef674a4b97f848b69f8b63c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129322) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:43:01.878748 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: INFO nova.api.openstack.requestlog [None req-38bcfc5d-c42d-4c7a-b1a9-829e60ce34bc tempest-TestShelveInstance-546397589 tempest-TestShelveInstance-546397589-project] 10.222.0.75 "GET /compute/v2.1/servers/05cf529d-df00-4ff9-b0d2-0e27563d2861" status: 200 len: 1259 microversion: 2.1 time: 0.179087 May 26 12:43:01.879340 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: [pid: 129322|app: 0|req: 294/562] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 26 12:43:01 2022] GET /compute/v2.1/servers/05cf529d-df00-4ff9-b0d2-0e27563d2861 => generated 1259 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:43:01.990154 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi [None req-64ef5348-be01-471c-ae4f-ba072afb5c6b tempest-TestMinimumBasicScenario-102576986 tempest-TestMinimumBasicScenario-102576986-project] Calling method '>' {{(pid=129321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:43:01.990711 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.compute.api [None req-64ef5348-be01-471c-ae4f-ba072afb5c6b tempest-TestMinimumBasicScenario-102576986 tempest-TestMinimumBasicScenario-102576986-project] [instance: 76661008-e6d3-4646-a9ba-d5d0e83a4b65] Fetching instance by UUID {{(pid=129321) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:43:01.997242 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-64ef5348-be01-471c-ae4f-ba072afb5c6b tempest-TestMinimumBasicScenario-102576986 tempest-TestMinimumBasicScenario-102576986-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:43:01.997697 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-64ef5348-be01-471c-ae4f-ba072afb5c6b tempest-TestMinimumBasicScenario-102576986 tempest-TestMinimumBasicScenario-102576986-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:43:01.998454 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-64ef5348-be01-471c-ae4f-ba072afb5c6b tempest-TestMinimumBasicScenario-102576986 tempest-TestMinimumBasicScenario-102576986-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:43:01.998888 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-64ef5348-be01-471c-ae4f-ba072afb5c6b tempest-TestMinimumBasicScenario-102576986 tempest-TestMinimumBasicScenario-102576986-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:43:02.032659 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi [None req-e17561db-3417-458e-98fb-4c74bc497255 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Calling method '>' {{(pid=129322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:43:02.033407 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.compute.api [None req-e17561db-3417-458e-98fb-4c74bc497255 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] [instance: bf2f6303-22b9-4cfa-8d4d-61d2503bc554] Fetching instance by UUID {{(pid=129322) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:43:02.040771 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-e17561db-3417-458e-98fb-4c74bc497255 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:43:02.041213 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-e17561db-3417-458e-98fb-4c74bc497255 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:43:02.041967 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-e17561db-3417-458e-98fb-4c74bc497255 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:43:02.042396 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-e17561db-3417-458e-98fb-4c74bc497255 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:43:02.139453 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.policy [None req-64ef5348-be01-471c-ae4f-ba072afb5c6b tempest-TestMinimumBasicScenario-102576986 tempest-TestMinimumBasicScenario-102576986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0352a80bdc174b9a9df4eca60b81eba4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fa2c4d6423444e487d259062656129b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129321) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:43:02.147767 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: INFO nova.api.openstack.requestlog [None req-64ef5348-be01-471c-ae4f-ba072afb5c6b tempest-TestMinimumBasicScenario-102576986 tempest-TestMinimumBasicScenario-102576986-project] 10.222.0.75 "GET /compute/v2.1/servers/76661008-e6d3-4646-a9ba-d5d0e83a4b65" status: 200 len: 1357 microversion: 2.1 time: 0.161533 May 26 12:43:02.148641 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: [pid: 129321|app: 0|req: 269/563] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 26 12:43:01 2022] GET /compute/v2.1/servers/76661008-e6d3-4646-a9ba-d5d0e83a4b65 => generated 1357 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:43:02.182611 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.policy [None req-e17561db-3417-458e-98fb-4c74bc497255 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e811736979c44b02b14fecb74c6bd7ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675272fb40d4847819f83ec04afecef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129322) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:43:02.191210 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.policy [None req-e17561db-3417-458e-98fb-4c74bc497255 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e811736979c44b02b14fecb74c6bd7ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675272fb40d4847819f83ec04afecef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129322) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:43:02.192735 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.policy [None req-e17561db-3417-458e-98fb-4c74bc497255 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e811736979c44b02b14fecb74c6bd7ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675272fb40d4847819f83ec04afecef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129322) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:43:02.193895 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: INFO nova.api.openstack.requestlog [None req-e17561db-3417-458e-98fb-4c74bc497255 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] 10.222.0.75 "GET /compute/v2.1/servers/bf2f6303-22b9-4cfa-8d4d-61d2503bc554" status: 200 len: 1746 microversion: 2.20 time: 0.165868 May 26 12:43:02.194650 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: [pid: 129322|app: 0|req: 295/564] 10.222.0.75 () {60 vars in 1276 bytes} [Thu May 26 12:43:02 2022] GET /compute/v2.1/servers/bf2f6303-22b9-4cfa-8d4d-61d2503bc554 => generated 1746 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 12:43:02.575927 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi [None req-ff8fa6ac-80cb-4b6e-bc3d-846622153605 tempest-VolumesActionsTest-731506124 tempest-VolumesActionsTest-731506124-project] Calling method '>' {{(pid=129321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:43:02.576531 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.compute.api [None req-ff8fa6ac-80cb-4b6e-bc3d-846622153605 tempest-VolumesActionsTest-731506124 tempest-VolumesActionsTest-731506124-project] [instance: 3fd057be-56c1-462d-8ea2-9ca668166ccf] Fetching instance by UUID {{(pid=129321) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:43:02.584318 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-ff8fa6ac-80cb-4b6e-bc3d-846622153605 tempest-VolumesActionsTest-731506124 tempest-VolumesActionsTest-731506124-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:43:02.584792 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-ff8fa6ac-80cb-4b6e-bc3d-846622153605 tempest-VolumesActionsTest-731506124 tempest-VolumesActionsTest-731506124-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:43:02.585617 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-ff8fa6ac-80cb-4b6e-bc3d-846622153605 tempest-VolumesActionsTest-731506124 tempest-VolumesActionsTest-731506124-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:43:02.586050 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-ff8fa6ac-80cb-4b6e-bc3d-846622153605 tempest-VolumesActionsTest-731506124 tempest-VolumesActionsTest-731506124-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:43:02.730390 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.policy [None req-ff8fa6ac-80cb-4b6e-bc3d-846622153605 tempest-VolumesActionsTest-731506124 tempest-VolumesActionsTest-731506124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f39e076a9e6b401db6de9a2846519591', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa93879e60e470185e8dd71efaaf1a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129321) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:43:02.740725 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: INFO nova.api.openstack.requestlog [None req-ff8fa6ac-80cb-4b6e-bc3d-846622153605 tempest-VolumesActionsTest-731506124 tempest-VolumesActionsTest-731506124-project] 10.222.0.75 "GET /compute/v2.1/servers/3fd057be-56c1-462d-8ea2-9ca668166ccf" status: 200 len: 1314 microversion: 2.1 time: 0.168616 May 26 12:43:02.741379 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: [pid: 129321|app: 0|req: 270/565] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 26 12:43:02 2022] GET /compute/v2.1/servers/3fd057be-56c1-462d-8ea2-9ca668166ccf => generated 1314 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:43:02.900557 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi [None req-1151a290-b7fb-4d90-984e-d7257dd4f643 tempest-TestShelveInstance-546397589 tempest-TestShelveInstance-546397589-project] Calling method '>' {{(pid=129322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:43:02.901287 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.compute.api [None req-1151a290-b7fb-4d90-984e-d7257dd4f643 tempest-TestShelveInstance-546397589 tempest-TestShelveInstance-546397589-project] [instance: 05cf529d-df00-4ff9-b0d2-0e27563d2861] Fetching instance by UUID {{(pid=129322) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:43:02.903379 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG dbcounter [-] [129322] Writing DB stats nova_cell0:SELECT=2 {{(pid=129322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:43:02.904488 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG dbcounter [-] [129322] Writing DB stats nova_cell0:SELECT=8 {{(pid=129322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:43:02.911846 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-1151a290-b7fb-4d90-984e-d7257dd4f643 tempest-TestShelveInstance-546397589 tempest-TestShelveInstance-546397589-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:43:02.912291 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-1151a290-b7fb-4d90-984e-d7257dd4f643 tempest-TestShelveInstance-546397589 tempest-TestShelveInstance-546397589-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:43:02.913068 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-1151a290-b7fb-4d90-984e-d7257dd4f643 tempest-TestShelveInstance-546397589 tempest-TestShelveInstance-546397589-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:43:02.913504 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-1151a290-b7fb-4d90-984e-d7257dd4f643 tempest-TestShelveInstance-546397589 tempest-TestShelveInstance-546397589-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:43:03.081874 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.policy [None req-1151a290-b7fb-4d90-984e-d7257dd4f643 tempest-TestShelveInstance-546397589 tempest-TestShelveInstance-546397589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d9bf2dcfce24386a1aaf9709d88da45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1f2f503ef674a4b97f848b69f8b63c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129322) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:43:03.089716 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: INFO nova.api.openstack.requestlog [None req-1151a290-b7fb-4d90-984e-d7257dd4f643 tempest-TestShelveInstance-546397589 tempest-TestShelveInstance-546397589-project] 10.222.0.75 "GET /compute/v2.1/servers/05cf529d-df00-4ff9-b0d2-0e27563d2861" status: 200 len: 1259 microversion: 2.1 time: 0.193797 May 26 12:43:03.093632 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: [pid: 129322|app: 0|req: 296/566] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 26 12:43:02 2022] GET /compute/v2.1/servers/05cf529d-df00-4ff9-b0d2-0e27563d2861 => generated 1259 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 12:43:03.168623 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi [None req-7335eb12-4fdb-49fc-816b-824c8074e4bd tempest-TestMinimumBasicScenario-102576986 tempest-TestMinimumBasicScenario-102576986-project] Calling method '>' {{(pid=129321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:43:03.169604 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.compute.api [None req-7335eb12-4fdb-49fc-816b-824c8074e4bd tempest-TestMinimumBasicScenario-102576986 tempest-TestMinimumBasicScenario-102576986-project] [instance: 76661008-e6d3-4646-a9ba-d5d0e83a4b65] Fetching instance by UUID {{(pid=129321) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:43:03.177084 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-7335eb12-4fdb-49fc-816b-824c8074e4bd tempest-TestMinimumBasicScenario-102576986 tempest-TestMinimumBasicScenario-102576986-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:43:03.177524 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-7335eb12-4fdb-49fc-816b-824c8074e4bd tempest-TestMinimumBasicScenario-102576986 tempest-TestMinimumBasicScenario-102576986-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:43:03.178288 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-7335eb12-4fdb-49fc-816b-824c8074e4bd tempest-TestMinimumBasicScenario-102576986 tempest-TestMinimumBasicScenario-102576986-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:43:03.178725 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-7335eb12-4fdb-49fc-816b-824c8074e4bd tempest-TestMinimumBasicScenario-102576986 tempest-TestMinimumBasicScenario-102576986-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:43:03.214748 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi [None req-140ceadf-a640-4fd9-9c06-d1085043cbf7 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Calling method '>' {{(pid=129322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:43:03.215430 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.compute.api [None req-140ceadf-a640-4fd9-9c06-d1085043cbf7 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] [instance: bf2f6303-22b9-4cfa-8d4d-61d2503bc554] Fetching instance by UUID {{(pid=129322) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:43:03.223383 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-140ceadf-a640-4fd9-9c06-d1085043cbf7 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:43:03.223900 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-140ceadf-a640-4fd9-9c06-d1085043cbf7 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:43:03.224809 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-140ceadf-a640-4fd9-9c06-d1085043cbf7 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:43:03.225411 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-140ceadf-a640-4fd9-9c06-d1085043cbf7 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:43:03.413753 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.policy [None req-140ceadf-a640-4fd9-9c06-d1085043cbf7 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e811736979c44b02b14fecb74c6bd7ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675272fb40d4847819f83ec04afecef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129322) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:43:03.422222 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.policy [None req-140ceadf-a640-4fd9-9c06-d1085043cbf7 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e811736979c44b02b14fecb74c6bd7ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675272fb40d4847819f83ec04afecef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129322) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:43:03.424533 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.policy [None req-140ceadf-a640-4fd9-9c06-d1085043cbf7 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e811736979c44b02b14fecb74c6bd7ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675272fb40d4847819f83ec04afecef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129322) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:43:03.425754 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: INFO nova.api.openstack.requestlog [None req-140ceadf-a640-4fd9-9c06-d1085043cbf7 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] 10.222.0.75 "GET /compute/v2.1/servers/bf2f6303-22b9-4cfa-8d4d-61d2503bc554" status: 200 len: 1746 microversion: 2.20 time: 0.216934 May 26 12:43:03.426470 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: [pid: 129322|app: 0|req: 297/567] 10.222.0.75 () {60 vars in 1276 bytes} [Thu May 26 12:43:03 2022] GET /compute/v2.1/servers/bf2f6303-22b9-4cfa-8d4d-61d2503bc554 => generated 1746 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 12:43:03.431311 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi [None req-790fa24f-4003-4bbd-9bf5-eca80421ae7d tempest-VolumesSnapshotTestJSON-1904508205 tempest-VolumesSnapshotTestJSON-1904508205-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1973985276", "imageRef": "1e3c323d-d797-4e6d-bd9a-482d90084b0c", "flavorRef": "452", "networks": [{"uuid": "302c6bf6-ca25-4af8-8c23-ffa0e49d26a6"}]}} {{(pid=129322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 12:43:03.449341 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.policy [None req-7335eb12-4fdb-49fc-816b-824c8074e4bd tempest-TestMinimumBasicScenario-102576986 tempest-TestMinimumBasicScenario-102576986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0352a80bdc174b9a9df4eca60b81eba4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fa2c4d6423444e487d259062656129b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129321) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:43:03.458135 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: INFO nova.api.openstack.requestlog [None req-7335eb12-4fdb-49fc-816b-824c8074e4bd tempest-TestMinimumBasicScenario-102576986 tempest-TestMinimumBasicScenario-102576986-project] 10.222.0.75 "GET /compute/v2.1/servers/76661008-e6d3-4646-a9ba-d5d0e83a4b65" status: 200 len: 1357 microversion: 2.1 time: 0.296553 May 26 12:43:03.459200 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: [pid: 129321|app: 0|req: 271/568] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 26 12:43:03 2022] GET /compute/v2.1/servers/76661008-e6d3-4646-a9ba-d5d0e83a4b65 => generated 1357 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:43:03.487940 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.network.neutron [None req-790fa24f-4003-4bbd-9bf5-eca80421ae7d tempest-VolumesSnapshotTestJSON-1904508205 tempest-VolumesSnapshotTestJSON-1904508205-project] validate_networks() for [('302c6bf6-ca25-4af8-8c23-ffa0e49d26a6', None, None, None, None, None)] {{(pid=129322) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 26 12:43:03.756773 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi [req-73a859ca-f48c-4fff-93d7-72f89f2ae585 req-7e3b538c-abb7-4b79-a3c7-950e891b4426 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3fd057be-56c1-462d-8ea2-9ca668166ccf", "tag": "fb8f79ae-b609-4e5d-bbcf-2886fb227ed9"}]} {{(pid=129321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 12:43:03.765618 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [req-73a859ca-f48c-4fff-93d7-72f89f2ae585 req-7e3b538c-abb7-4b79-a3c7-950e891b4426 service nova] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:43:03.766554 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [req-73a859ca-f48c-4fff-93d7-72f89f2ae585 req-7e3b538c-abb7-4b79-a3c7-950e891b4426 service nova] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:43:03.785365 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: INFO nova.api.openstack.compute.server_external_events [req-73a859ca-f48c-4fff-93d7-72f89f2ae585 req-7e3b538c-abb7-4b79-a3c7-950e891b4426 service nova] Creating event network-changed:fb8f79ae-b609-4e5d-bbcf-2886fb227ed9 for instance 3fd057be-56c1-462d-8ea2-9ca668166ccf on hv-cinder-81966 May 26 12:43:03.790876 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: INFO nova.api.openstack.requestlog [req-73a859ca-f48c-4fff-93d7-72f89f2ae585 req-7e3b538c-abb7-4b79-a3c7-950e891b4426 service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038311 May 26 12:43:03.791509 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: [pid: 129321|app: 0|req: 272/569] 10.222.0.75 () {64 vars in 1317 bytes} [Thu May 26 12:43:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 12:43:03.798000 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi [None req-94d0b1fc-afc4-4689-8840-42847ddee138 tempest-VolumesActionsTest-731506124 tempest-VolumesActionsTest-731506124-project] Calling method '>' {{(pid=129321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:43:03.799079 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.compute.api [None req-94d0b1fc-afc4-4689-8840-42847ddee138 tempest-VolumesActionsTest-731506124 tempest-VolumesActionsTest-731506124-project] [instance: 3fd057be-56c1-462d-8ea2-9ca668166ccf] Fetching instance by UUID {{(pid=129321) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:43:03.806042 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-94d0b1fc-afc4-4689-8840-42847ddee138 tempest-VolumesActionsTest-731506124 tempest-VolumesActionsTest-731506124-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:43:03.806494 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-94d0b1fc-afc4-4689-8840-42847ddee138 tempest-VolumesActionsTest-731506124 tempest-VolumesActionsTest-731506124-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:43:03.807261 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-94d0b1fc-afc4-4689-8840-42847ddee138 tempest-VolumesActionsTest-731506124 tempest-VolumesActionsTest-731506124-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:43:03.807723 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-94d0b1fc-afc4-4689-8840-42847ddee138 tempest-VolumesActionsTest-731506124 tempest-VolumesActionsTest-731506124-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:43:03.858843 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.virt.hardware [None req-790fa24f-4003-4bbd-9bf5-eca80421ae7d tempest-VolumesSnapshotTestJSON-1904508205 tempest-VolumesSnapshotTestJSON-1904508205-project] Flavor limits 0:0:0 {{(pid=129322) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 26 12:43:03.859285 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.virt.hardware [None req-790fa24f-4003-4bbd-9bf5-eca80421ae7d tempest-VolumesSnapshotTestJSON-1904508205 tempest-VolumesSnapshotTestJSON-1904508205-project] Image limits 0:0:0 {{(pid=129322) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 26 12:43:03.859803 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.virt.hardware [None req-790fa24f-4003-4bbd-9bf5-eca80421ae7d tempest-VolumesSnapshotTestJSON-1904508205 tempest-VolumesSnapshotTestJSON-1904508205-project] Flavor pref 0:0:0 {{(pid=129322) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 26 12:43:03.860213 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.virt.hardware [None req-790fa24f-4003-4bbd-9bf5-eca80421ae7d tempest-VolumesSnapshotTestJSON-1904508205 tempest-VolumesSnapshotTestJSON-1904508205-project] Image pref 0:0:0 {{(pid=129322) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 26 12:43:03.860602 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.virt.hardware [None req-790fa24f-4003-4bbd-9bf5-eca80421ae7d tempest-VolumesSnapshotTestJSON-1904508205 tempest-VolumesSnapshotTestJSON-1904508205-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129322) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 26 12:43:03.869971 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-790fa24f-4003-4bbd-9bf5-eca80421ae7d tempest-VolumesSnapshotTestJSON-1904508205 tempest-VolumesSnapshotTestJSON-1904508205-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:43:03.870419 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-790fa24f-4003-4bbd-9bf5-eca80421ae7d tempest-VolumesSnapshotTestJSON-1904508205 tempest-VolumesSnapshotTestJSON-1904508205-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:43:03.871210 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-790fa24f-4003-4bbd-9bf5-eca80421ae7d tempest-VolumesSnapshotTestJSON-1904508205 tempest-VolumesSnapshotTestJSON-1904508205-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:43:03.871745 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-790fa24f-4003-4bbd-9bf5-eca80421ae7d tempest-VolumesSnapshotTestJSON-1904508205 tempest-VolumesSnapshotTestJSON-1904508205-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:43:03.890575 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.quota [None req-790fa24f-4003-4bbd-9bf5-eca80421ae7d tempest-VolumesSnapshotTestJSON-1904508205 tempest-VolumesSnapshotTestJSON-1904508205-project] Getting quotas for project 72bda4cbb07a43688506e01d06ba89c2. Resources: {'instances', 'cores', 'ram'} {{(pid=129322) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 26 12:43:03.894550 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.quota [None req-790fa24f-4003-4bbd-9bf5-eca80421ae7d tempest-VolumesSnapshotTestJSON-1904508205 tempest-VolumesSnapshotTestJSON-1904508205-project] Getting quotas for user 805854e5ce2e412fb9420afd63f73ee6 and project 72bda4cbb07a43688506e01d06ba89c2. Resources: {'instances', 'cores', 'ram'} {{(pid=129322) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 26 12:43:03.909254 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.compute.api [None req-790fa24f-4003-4bbd-9bf5-eca80421ae7d tempest-VolumesSnapshotTestJSON-1904508205 tempest-VolumesSnapshotTestJSON-1904508205-project] Going to run 1 instances... {{(pid=129322) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 26 12:43:03.911400 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.compute.api [None req-790fa24f-4003-4bbd-9bf5-eca80421ae7d tempest-VolumesSnapshotTestJSON-1904508205 tempest-VolumesSnapshotTestJSON-1904508205-project] [instance: 6a87df93-cf49-465a-80dd-102efb0f8b11] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1e3c323d-d797-4e6d-bd9a-482d90084b0c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129322) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 26 12:43:03.965499 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: INFO nova.api.openstack.requestlog [None req-790fa24f-4003-4bbd-9bf5-eca80421ae7d tempest-VolumesSnapshotTestJSON-1904508205 tempest-VolumesSnapshotTestJSON-1904508205-project] 10.222.0.75 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.537796 May 26 12:43:03.966164 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: [pid: 129322|app: 0|req: 298/570] 10.222.0.75 () {60 vars in 1146 bytes} [Thu May 26 12:43:03 2022] POST /compute/v2.1/servers => generated 380 bytes in 539 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 26 12:43:03.968084 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.policy [None req-94d0b1fc-afc4-4689-8840-42847ddee138 tempest-VolumesActionsTest-731506124 tempest-VolumesActionsTest-731506124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f39e076a9e6b401db6de9a2846519591', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa93879e60e470185e8dd71efaaf1a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129321) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:43:03.976433 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi [None req-52ec777d-68e6-4db5-a2be-de6e04ea5312 tempest-VolumesSnapshotTestJSON-1904508205 tempest-VolumesSnapshotTestJSON-1904508205-project] Calling method '>' {{(pid=129322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:43:03.977129 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.compute.api [None req-52ec777d-68e6-4db5-a2be-de6e04ea5312 tempest-VolumesSnapshotTestJSON-1904508205 tempest-VolumesSnapshotTestJSON-1904508205-project] [instance: 6a87df93-cf49-465a-80dd-102efb0f8b11] Fetching instance by UUID {{(pid=129322) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:43:03.979195 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: INFO nova.api.openstack.requestlog [None req-94d0b1fc-afc4-4689-8840-42847ddee138 tempest-VolumesActionsTest-731506124 tempest-VolumesActionsTest-731506124-project] 10.222.0.75 "GET /compute/v2.1/servers/3fd057be-56c1-462d-8ea2-9ca668166ccf" status: 200 len: 1314 microversion: 2.1 time: 0.185973 May 26 12:43:03.980977 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: [pid: 129321|app: 0|req: 273/571] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 26 12:43:03 2022] GET /compute/v2.1/servers/3fd057be-56c1-462d-8ea2-9ca668166ccf => generated 1314 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:43:04.036096 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.policy [None req-52ec777d-68e6-4db5-a2be-de6e04ea5312 tempest-VolumesSnapshotTestJSON-1904508205 tempest-VolumesSnapshotTestJSON-1904508205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '805854e5ce2e412fb9420afd63f73ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72bda4cbb07a43688506e01d06ba89c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129322) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:43:04.043854 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: INFO nova.api.openstack.requestlog [None req-52ec777d-68e6-4db5-a2be-de6e04ea5312 tempest-VolumesSnapshotTestJSON-1904508205 tempest-VolumesSnapshotTestJSON-1904508205-project] 10.222.0.75 "GET /compute/v2.1/servers/6a87df93-cf49-465a-80dd-102efb0f8b11" status: 200 len: 1219 microversion: 2.1 time: 0.070967 May 26 12:43:04.044730 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: [pid: 129322|app: 0|req: 299/572] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 26 12:43:03 2022] GET /compute/v2.1/servers/6a87df93-cf49-465a-80dd-102efb0f8b11 => generated 1219 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:43:04.106463 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi [None req-978ec840-8839-4424-9b4b-e61bf38a89fd tempest-TestShelveInstance-546397589 tempest-TestShelveInstance-546397589-project] Calling method '>' {{(pid=129321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:43:04.107180 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.compute.api [None req-978ec840-8839-4424-9b4b-e61bf38a89fd tempest-TestShelveInstance-546397589 tempest-TestShelveInstance-546397589-project] [instance: 05cf529d-df00-4ff9-b0d2-0e27563d2861] Fetching instance by UUID {{(pid=129321) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:43:04.114004 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-978ec840-8839-4424-9b4b-e61bf38a89fd tempest-TestShelveInstance-546397589 tempest-TestShelveInstance-546397589-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:43:04.114451 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-978ec840-8839-4424-9b4b-e61bf38a89fd tempest-TestShelveInstance-546397589 tempest-TestShelveInstance-546397589-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:43:04.115214 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-978ec840-8839-4424-9b4b-e61bf38a89fd tempest-TestShelveInstance-546397589 tempest-TestShelveInstance-546397589-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:43:04.115678 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-978ec840-8839-4424-9b4b-e61bf38a89fd tempest-TestShelveInstance-546397589 tempest-TestShelveInstance-546397589-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:43:04.271051 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.policy [None req-978ec840-8839-4424-9b4b-e61bf38a89fd tempest-TestShelveInstance-546397589 tempest-TestShelveInstance-546397589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d9bf2dcfce24386a1aaf9709d88da45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1f2f503ef674a4b97f848b69f8b63c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129321) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:43:04.280325 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: INFO nova.api.openstack.requestlog [None req-978ec840-8839-4424-9b4b-e61bf38a89fd tempest-TestShelveInstance-546397589 tempest-TestShelveInstance-546397589-project] 10.222.0.75 "GET /compute/v2.1/servers/05cf529d-df00-4ff9-b0d2-0e27563d2861" status: 200 len: 1259 microversion: 2.1 time: 0.177559 May 26 12:43:04.280927 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: [pid: 129321|app: 0|req: 274/573] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 26 12:43:04 2022] GET /compute/v2.1/servers/05cf529d-df00-4ff9-b0d2-0e27563d2861 => generated 1259 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:43:04.448433 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi [None req-cff62512-b846-4781-b89e-69013e3ba969 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Calling method '>' {{(pid=129322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:43:04.449197 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.compute.api [None req-cff62512-b846-4781-b89e-69013e3ba969 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] [instance: bf2f6303-22b9-4cfa-8d4d-61d2503bc554] Fetching instance by UUID {{(pid=129322) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:43:04.456498 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-cff62512-b846-4781-b89e-69013e3ba969 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:43:04.456935 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-cff62512-b846-4781-b89e-69013e3ba969 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:43:04.457803 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-cff62512-b846-4781-b89e-69013e3ba969 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:43:04.458255 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-cff62512-b846-4781-b89e-69013e3ba969 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:43:04.476456 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi [None req-c028118b-e84b-4ef4-8c1a-c7dd40805300 tempest-TestMinimumBasicScenario-102576986 tempest-TestMinimumBasicScenario-102576986-project] Calling method '>' {{(pid=129321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:43:04.477051 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.compute.api [None req-c028118b-e84b-4ef4-8c1a-c7dd40805300 tempest-TestMinimumBasicScenario-102576986 tempest-TestMinimumBasicScenario-102576986-project] [instance: 76661008-e6d3-4646-a9ba-d5d0e83a4b65] Fetching instance by UUID {{(pid=129321) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:43:04.483284 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-c028118b-e84b-4ef4-8c1a-c7dd40805300 tempest-TestMinimumBasicScenario-102576986 tempest-TestMinimumBasicScenario-102576986-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:43:04.484426 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-c028118b-e84b-4ef4-8c1a-c7dd40805300 tempest-TestMinimumBasicScenario-102576986 tempest-TestMinimumBasicScenario-102576986-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:43:04.485210 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-c028118b-e84b-4ef4-8c1a-c7dd40805300 tempest-TestMinimumBasicScenario-102576986 tempest-TestMinimumBasicScenario-102576986-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:43:04.485649 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-c028118b-e84b-4ef4-8c1a-c7dd40805300 tempest-TestMinimumBasicScenario-102576986 tempest-TestMinimumBasicScenario-102576986-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:43:04.747264 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.policy [None req-cff62512-b846-4781-b89e-69013e3ba969 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e811736979c44b02b14fecb74c6bd7ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675272fb40d4847819f83ec04afecef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129322) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:43:04.757848 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.policy [None req-cff62512-b846-4781-b89e-69013e3ba969 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e811736979c44b02b14fecb74c6bd7ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675272fb40d4847819f83ec04afecef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129322) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:43:04.759259 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.policy [None req-cff62512-b846-4781-b89e-69013e3ba969 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e811736979c44b02b14fecb74c6bd7ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675272fb40d4847819f83ec04afecef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129322) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:43:04.760735 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: INFO nova.api.openstack.requestlog [None req-cff62512-b846-4781-b89e-69013e3ba969 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] 10.222.0.75 "GET /compute/v2.1/servers/bf2f6303-22b9-4cfa-8d4d-61d2503bc554" status: 200 len: 1746 microversion: 2.20 time: 0.319382 May 26 12:43:04.761308 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: [pid: 129322|app: 0|req: 300/574] 10.222.0.75 () {60 vars in 1276 bytes} [Thu May 26 12:43:04 2022] GET /compute/v2.1/servers/bf2f6303-22b9-4cfa-8d4d-61d2503bc554 => generated 1746 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 12:43:04.764403 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.policy [None req-c028118b-e84b-4ef4-8c1a-c7dd40805300 tempest-TestMinimumBasicScenario-102576986 tempest-TestMinimumBasicScenario-102576986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0352a80bdc174b9a9df4eca60b81eba4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fa2c4d6423444e487d259062656129b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129321) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:43:04.766103 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi [req-b00a6620-4d52-4f2e-9ede-e4bef15c73c5 req-d66f83c3-3ccf-4dd5-992f-35d2133b622b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bf2f6303-22b9-4cfa-8d4d-61d2503bc554", "name": "network-vif-plugged", "status": "completed", "tag": "fe40ed8f-f450-48f7-876a-abe2fea7abe5"}]} {{(pid=129322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 12:43:04.775174 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: INFO nova.api.openstack.requestlog [None req-c028118b-e84b-4ef4-8c1a-c7dd40805300 tempest-TestMinimumBasicScenario-102576986 tempest-TestMinimumBasicScenario-102576986-project] 10.222.0.75 "GET /compute/v2.1/servers/76661008-e6d3-4646-a9ba-d5d0e83a4b65" status: 200 len: 1357 microversion: 2.1 time: 0.302638 May 26 12:43:04.775508 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [req-b00a6620-4d52-4f2e-9ede-e4bef15c73c5 req-d66f83c3-3ccf-4dd5-992f-35d2133b622b service nova] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:43:04.775788 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: [pid: 129321|app: 0|req: 275/575] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 26 12:43:04 2022] GET /compute/v2.1/servers/76661008-e6d3-4646-a9ba-d5d0e83a4b65 => generated 1357 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 12:43:04.783879 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [req-b00a6620-4d52-4f2e-9ede-e4bef15c73c5 req-d66f83c3-3ccf-4dd5-992f-35d2133b622b service nova] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:43:04.801979 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: INFO nova.api.openstack.compute.server_external_events [req-b00a6620-4d52-4f2e-9ede-e4bef15c73c5 req-d66f83c3-3ccf-4dd5-992f-35d2133b622b service nova] Creating event network-vif-plugged:fe40ed8f-f450-48f7-876a-abe2fea7abe5 for instance bf2f6303-22b9-4cfa-8d4d-61d2503bc554 on hv-cinder-81966 May 26 12:43:04.809367 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: INFO nova.api.openstack.requestlog [req-b00a6620-4d52-4f2e-9ede-e4bef15c73c5 req-d66f83c3-3ccf-4dd5-992f-35d2133b622b service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046167 May 26 12:43:04.810245 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: [pid: 129322|app: 0|req: 301/576] 10.222.0.75 () {64 vars in 1317 bytes} [Thu May 26 12:43:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 12:43:04.997193 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi [None req-a8446845-f945-4f69-ad2e-5592f5d0c872 tempest-VolumesActionsTest-731506124 tempest-VolumesActionsTest-731506124-project] Calling method '>' {{(pid=129321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:43:04.998390 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.compute.api [None req-a8446845-f945-4f69-ad2e-5592f5d0c872 tempest-VolumesActionsTest-731506124 tempest-VolumesActionsTest-731506124-project] [instance: 3fd057be-56c1-462d-8ea2-9ca668166ccf] Fetching instance by UUID {{(pid=129321) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:43:05.010985 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-a8446845-f945-4f69-ad2e-5592f5d0c872 tempest-VolumesActionsTest-731506124 tempest-VolumesActionsTest-731506124-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:43:05.012093 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-a8446845-f945-4f69-ad2e-5592f5d0c872 tempest-VolumesActionsTest-731506124 tempest-VolumesActionsTest-731506124-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:43:05.013117 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-a8446845-f945-4f69-ad2e-5592f5d0c872 tempest-VolumesActionsTest-731506124 tempest-VolumesActionsTest-731506124-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:43:05.013711 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-a8446845-f945-4f69-ad2e-5592f5d0c872 tempest-VolumesActionsTest-731506124 tempest-VolumesActionsTest-731506124-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:43:05.070783 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi [None req-9fe89133-0ead-4bdc-a351-4751ac072232 tempest-VolumesSnapshotTestJSON-1904508205 tempest-VolumesSnapshotTestJSON-1904508205-project] Calling method '>' {{(pid=129322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:43:05.071573 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.compute.api [None req-9fe89133-0ead-4bdc-a351-4751ac072232 tempest-VolumesSnapshotTestJSON-1904508205 tempest-VolumesSnapshotTestJSON-1904508205-project] [instance: 6a87df93-cf49-465a-80dd-102efb0f8b11] Fetching instance by UUID {{(pid=129322) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:43:05.083965 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-9fe89133-0ead-4bdc-a351-4751ac072232 tempest-VolumesSnapshotTestJSON-1904508205 tempest-VolumesSnapshotTestJSON-1904508205-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:43:05.085189 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-9fe89133-0ead-4bdc-a351-4751ac072232 tempest-VolumesSnapshotTestJSON-1904508205 tempest-VolumesSnapshotTestJSON-1904508205-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:43:05.086429 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-9fe89133-0ead-4bdc-a351-4751ac072232 tempest-VolumesSnapshotTestJSON-1904508205 tempest-VolumesSnapshotTestJSON-1904508205-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:43:05.087322 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-9fe89133-0ead-4bdc-a351-4751ac072232 tempest-VolumesSnapshotTestJSON-1904508205 tempest-VolumesSnapshotTestJSON-1904508205-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:43:05.171839 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.policy [None req-9fe89133-0ead-4bdc-a351-4751ac072232 tempest-VolumesSnapshotTestJSON-1904508205 tempest-VolumesSnapshotTestJSON-1904508205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '805854e5ce2e412fb9420afd63f73ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72bda4cbb07a43688506e01d06ba89c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129322) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:43:05.182085 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: INFO nova.api.openstack.requestlog [None req-9fe89133-0ead-4bdc-a351-4751ac072232 tempest-VolumesSnapshotTestJSON-1904508205 tempest-VolumesSnapshotTestJSON-1904508205-project] 10.222.0.75 "GET /compute/v2.1/servers/6a87df93-cf49-465a-80dd-102efb0f8b11" status: 200 len: 1215 microversion: 2.1 time: 0.121016 May 26 12:43:05.182656 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: [pid: 129322|app: 0|req: 302/577] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 26 12:43:05 2022] GET /compute/v2.1/servers/6a87df93-cf49-465a-80dd-102efb0f8b11 => generated 1215 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:43:05.261589 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.policy [None req-a8446845-f945-4f69-ad2e-5592f5d0c872 tempest-VolumesActionsTest-731506124 tempest-VolumesActionsTest-731506124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f39e076a9e6b401db6de9a2846519591', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa93879e60e470185e8dd71efaaf1a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129321) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:43:05.269727 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: INFO nova.api.openstack.requestlog [None req-a8446845-f945-4f69-ad2e-5592f5d0c872 tempest-VolumesActionsTest-731506124 tempest-VolumesActionsTest-731506124-project] 10.222.0.75 "GET /compute/v2.1/servers/3fd057be-56c1-462d-8ea2-9ca668166ccf" status: 200 len: 1314 microversion: 2.1 time: 0.276566 May 26 12:43:05.279448 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: [pid: 129321|app: 0|req: 276/578] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 26 12:43:04 2022] GET /compute/v2.1/servers/3fd057be-56c1-462d-8ea2-9ca668166ccf => generated 1314 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:43:05.298452 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi [None req-32296173-e405-4a2b-9fe4-d3778f3f299e tempest-TestShelveInstance-546397589 tempest-TestShelveInstance-546397589-project] Calling method '>' {{(pid=129322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:43:05.299063 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.compute.api [None req-32296173-e405-4a2b-9fe4-d3778f3f299e tempest-TestShelveInstance-546397589 tempest-TestShelveInstance-546397589-project] [instance: 05cf529d-df00-4ff9-b0d2-0e27563d2861] Fetching instance by UUID {{(pid=129322) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:43:05.305125 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-32296173-e405-4a2b-9fe4-d3778f3f299e tempest-TestShelveInstance-546397589 tempest-TestShelveInstance-546397589-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:43:05.305563 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-32296173-e405-4a2b-9fe4-d3778f3f299e tempest-TestShelveInstance-546397589 tempest-TestShelveInstance-546397589-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:43:05.306280 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-32296173-e405-4a2b-9fe4-d3778f3f299e tempest-TestShelveInstance-546397589 tempest-TestShelveInstance-546397589-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:43:05.306705 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-32296173-e405-4a2b-9fe4-d3778f3f299e tempest-TestShelveInstance-546397589 tempest-TestShelveInstance-546397589-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:43:05.462955 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.policy [None req-32296173-e405-4a2b-9fe4-d3778f3f299e tempest-TestShelveInstance-546397589 tempest-TestShelveInstance-546397589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d9bf2dcfce24386a1aaf9709d88da45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1f2f503ef674a4b97f848b69f8b63c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129322) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:43:05.471118 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: INFO nova.api.openstack.requestlog [None req-32296173-e405-4a2b-9fe4-d3778f3f299e tempest-TestShelveInstance-546397589 tempest-TestShelveInstance-546397589-project] 10.222.0.75 "GET /compute/v2.1/servers/05cf529d-df00-4ff9-b0d2-0e27563d2861" status: 200 len: 1259 microversion: 2.1 time: 0.176634 May 26 12:43:05.471722 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: [pid: 129322|app: 0|req: 303/579] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 26 12:43:05 2022] GET /compute/v2.1/servers/05cf529d-df00-4ff9-b0d2-0e27563d2861 => generated 1259 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:43:05.789816 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi [None req-409af555-573e-4008-ad82-d13a15f0e752 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Calling method '>' {{(pid=129321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:43:05.790748 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.compute.api [None req-409af555-573e-4008-ad82-d13a15f0e752 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] [instance: bf2f6303-22b9-4cfa-8d4d-61d2503bc554] Fetching instance by UUID {{(pid=129321) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:43:05.793405 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi [None req-0dee416a-8b95-40a0-bd29-9fa7313c955e tempest-TestMinimumBasicScenario-102576986 tempest-TestMinimumBasicScenario-102576986-project] Calling method '>' {{(pid=129322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:43:05.794073 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.compute.api [None req-0dee416a-8b95-40a0-bd29-9fa7313c955e tempest-TestMinimumBasicScenario-102576986 tempest-TestMinimumBasicScenario-102576986-project] [instance: 76661008-e6d3-4646-a9ba-d5d0e83a4b65] Fetching instance by UUID {{(pid=129322) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:43:05.800157 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-409af555-573e-4008-ad82-d13a15f0e752 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:43:05.800959 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-409af555-573e-4008-ad82-d13a15f0e752 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:43:05.801993 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-409af555-573e-4008-ad82-d13a15f0e752 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:43:05.802323 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-0dee416a-8b95-40a0-bd29-9fa7313c955e tempest-TestMinimumBasicScenario-102576986 tempest-TestMinimumBasicScenario-102576986-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:43:05.802760 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-0dee416a-8b95-40a0-bd29-9fa7313c955e tempest-TestMinimumBasicScenario-102576986 tempest-TestMinimumBasicScenario-102576986-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:43:05.803581 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-0dee416a-8b95-40a0-bd29-9fa7313c955e tempest-TestMinimumBasicScenario-102576986 tempest-TestMinimumBasicScenario-102576986-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:43:05.803833 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-409af555-573e-4008-ad82-d13a15f0e752 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:43:05.804015 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-0dee416a-8b95-40a0-bd29-9fa7313c955e tempest-TestMinimumBasicScenario-102576986 tempest-TestMinimumBasicScenario-102576986-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:43:05.951828 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.policy [None req-0dee416a-8b95-40a0-bd29-9fa7313c955e tempest-TestMinimumBasicScenario-102576986 tempest-TestMinimumBasicScenario-102576986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0352a80bdc174b9a9df4eca60b81eba4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fa2c4d6423444e487d259062656129b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129322) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:43:05.954972 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.policy [None req-409af555-573e-4008-ad82-d13a15f0e752 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e811736979c44b02b14fecb74c6bd7ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675272fb40d4847819f83ec04afecef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129321) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:43:05.960493 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: INFO nova.api.openstack.requestlog [None req-0dee416a-8b95-40a0-bd29-9fa7313c955e tempest-TestMinimumBasicScenario-102576986 tempest-TestMinimumBasicScenario-102576986-project] 10.222.0.75 "GET /compute/v2.1/servers/76661008-e6d3-4646-a9ba-d5d0e83a4b65" status: 200 len: 1357 microversion: 2.1 time: 0.172010 May 26 12:43:05.961082 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: [pid: 129322|app: 0|req: 304/580] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 26 12:43:05 2022] GET /compute/v2.1/servers/76661008-e6d3-4646-a9ba-d5d0e83a4b65 => generated 1357 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 12:43:05.963359 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.policy [None req-409af555-573e-4008-ad82-d13a15f0e752 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e811736979c44b02b14fecb74c6bd7ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675272fb40d4847819f83ec04afecef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129321) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:43:05.964892 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.policy [None req-409af555-573e-4008-ad82-d13a15f0e752 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e811736979c44b02b14fecb74c6bd7ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675272fb40d4847819f83ec04afecef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129321) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:43:05.966043 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: INFO nova.api.openstack.requestlog [None req-409af555-573e-4008-ad82-d13a15f0e752 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] 10.222.0.75 "GET /compute/v2.1/servers/bf2f6303-22b9-4cfa-8d4d-61d2503bc554" status: 200 len: 1746 microversion: 2.20 time: 0.180470 May 26 12:43:05.966595 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: [pid: 129321|app: 0|req: 277/581] 10.222.0.75 () {60 vars in 1276 bytes} [Thu May 26 12:43:05 2022] GET /compute/v2.1/servers/bf2f6303-22b9-4cfa-8d4d-61d2503bc554 => generated 1746 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 12:43:06.199900 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi [None req-d39eeef9-2bac-4bba-9522-d163a8b2615b tempest-VolumesSnapshotTestJSON-1904508205 tempest-VolumesSnapshotTestJSON-1904508205-project] Calling method '>' {{(pid=129322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:43:06.200776 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.compute.api [None req-d39eeef9-2bac-4bba-9522-d163a8b2615b tempest-VolumesSnapshotTestJSON-1904508205 tempest-VolumesSnapshotTestJSON-1904508205-project] [instance: 6a87df93-cf49-465a-80dd-102efb0f8b11] Fetching instance by UUID {{(pid=129322) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:43:06.208691 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-d39eeef9-2bac-4bba-9522-d163a8b2615b tempest-VolumesSnapshotTestJSON-1904508205 tempest-VolumesSnapshotTestJSON-1904508205-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:43:06.209136 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-d39eeef9-2bac-4bba-9522-d163a8b2615b tempest-VolumesSnapshotTestJSON-1904508205 tempest-VolumesSnapshotTestJSON-1904508205-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:43:06.209910 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-d39eeef9-2bac-4bba-9522-d163a8b2615b tempest-VolumesSnapshotTestJSON-1904508205 tempest-VolumesSnapshotTestJSON-1904508205-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:43:06.210342 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-d39eeef9-2bac-4bba-9522-d163a8b2615b tempest-VolumesSnapshotTestJSON-1904508205 tempest-VolumesSnapshotTestJSON-1904508205-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:43:06.282181 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.policy [None req-d39eeef9-2bac-4bba-9522-d163a8b2615b tempest-VolumesSnapshotTestJSON-1904508205 tempest-VolumesSnapshotTestJSON-1904508205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '805854e5ce2e412fb9420afd63f73ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72bda4cbb07a43688506e01d06ba89c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129322) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:43:06.286559 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi [None req-2b341021-4506-497d-8cde-82d361df14d0 tempest-VolumesActionsTest-731506124 tempest-VolumesActionsTest-731506124-project] Calling method '>' {{(pid=129321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:43:06.287444 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.compute.api [None req-2b341021-4506-497d-8cde-82d361df14d0 tempest-VolumesActionsTest-731506124 tempest-VolumesActionsTest-731506124-project] [instance: 3fd057be-56c1-462d-8ea2-9ca668166ccf] Fetching instance by UUID {{(pid=129321) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:43:06.293211 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: INFO nova.api.openstack.requestlog [None req-d39eeef9-2bac-4bba-9522-d163a8b2615b tempest-VolumesSnapshotTestJSON-1904508205 tempest-VolumesSnapshotTestJSON-1904508205-project] 10.222.0.75 "GET /compute/v2.1/servers/6a87df93-cf49-465a-80dd-102efb0f8b11" status: 200 len: 1271 microversion: 2.1 time: 0.097178 May 26 12:43:06.294184 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-2b341021-4506-497d-8cde-82d361df14d0 tempest-VolumesActionsTest-731506124 tempest-VolumesActionsTest-731506124-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:43:06.294892 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-2b341021-4506-497d-8cde-82d361df14d0 tempest-VolumesActionsTest-731506124 tempest-VolumesActionsTest-731506124-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:43:06.295760 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-2b341021-4506-497d-8cde-82d361df14d0 tempest-VolumesActionsTest-731506124 tempest-VolumesActionsTest-731506124-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:43:06.296350 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-2b341021-4506-497d-8cde-82d361df14d0 tempest-VolumesActionsTest-731506124 tempest-VolumesActionsTest-731506124-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:43:06.297482 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: [pid: 129322|app: 0|req: 305/582] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 26 12:43:06 2022] GET /compute/v2.1/servers/6a87df93-cf49-465a-80dd-102efb0f8b11 => generated 1271 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:43:06.489940 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi [None req-b360f93f-a76e-40b5-b8e9-49f3ddae2ac9 tempest-TestShelveInstance-546397589 tempest-TestShelveInstance-546397589-project] Calling method '>' {{(pid=129322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:43:06.490452 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.compute.api [None req-b360f93f-a76e-40b5-b8e9-49f3ddae2ac9 tempest-TestShelveInstance-546397589 tempest-TestShelveInstance-546397589-project] [instance: 05cf529d-df00-4ff9-b0d2-0e27563d2861] Fetching instance by UUID {{(pid=129322) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:43:06.498245 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-b360f93f-a76e-40b5-b8e9-49f3ddae2ac9 tempest-TestShelveInstance-546397589 tempest-TestShelveInstance-546397589-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:43:06.498806 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-b360f93f-a76e-40b5-b8e9-49f3ddae2ac9 tempest-TestShelveInstance-546397589 tempest-TestShelveInstance-546397589-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:43:06.500357 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-b360f93f-a76e-40b5-b8e9-49f3ddae2ac9 tempest-TestShelveInstance-546397589 tempest-TestShelveInstance-546397589-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:43:06.500792 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-b360f93f-a76e-40b5-b8e9-49f3ddae2ac9 tempest-TestShelveInstance-546397589 tempest-TestShelveInstance-546397589-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:43:06.605883 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.policy [None req-2b341021-4506-497d-8cde-82d361df14d0 tempest-VolumesActionsTest-731506124 tempest-VolumesActionsTest-731506124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f39e076a9e6b401db6de9a2846519591', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa93879e60e470185e8dd71efaaf1a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129321) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:43:06.613977 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: INFO nova.api.openstack.requestlog [None req-2b341021-4506-497d-8cde-82d361df14d0 tempest-VolumesActionsTest-731506124 tempest-VolumesActionsTest-731506124-project] 10.222.0.75 "GET /compute/v2.1/servers/3fd057be-56c1-462d-8ea2-9ca668166ccf" status: 200 len: 1314 microversion: 2.1 time: 0.331645 May 26 12:43:06.614631 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: [pid: 129321|app: 0|req: 278/583] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 26 12:43:06 2022] GET /compute/v2.1/servers/3fd057be-56c1-462d-8ea2-9ca668166ccf => generated 1314 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 12:43:06.640877 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.policy [None req-b360f93f-a76e-40b5-b8e9-49f3ddae2ac9 tempest-TestShelveInstance-546397589 tempest-TestShelveInstance-546397589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d9bf2dcfce24386a1aaf9709d88da45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1f2f503ef674a4b97f848b69f8b63c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129322) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:43:06.649545 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: INFO nova.api.openstack.requestlog [None req-b360f93f-a76e-40b5-b8e9-49f3ddae2ac9 tempest-TestShelveInstance-546397589 tempest-TestShelveInstance-546397589-project] 10.222.0.75 "GET /compute/v2.1/servers/05cf529d-df00-4ff9-b0d2-0e27563d2861" status: 200 len: 1259 microversion: 2.1 time: 0.163571 May 26 12:43:06.650878 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: [pid: 129322|app: 0|req: 306/584] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 26 12:43:06 2022] GET /compute/v2.1/servers/05cf529d-df00-4ff9-b0d2-0e27563d2861 => generated 1259 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 12:43:06.978112 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi [None req-aea6ac9f-9a34-444e-a795-33769eff6424 tempest-TestMinimumBasicScenario-102576986 tempest-TestMinimumBasicScenario-102576986-project] Calling method '>' {{(pid=129321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:43:06.978699 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.compute.api [None req-aea6ac9f-9a34-444e-a795-33769eff6424 tempest-TestMinimumBasicScenario-102576986 tempest-TestMinimumBasicScenario-102576986-project] [instance: 76661008-e6d3-4646-a9ba-d5d0e83a4b65] Fetching instance by UUID {{(pid=129321) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:43:06.984732 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi [None req-e639d1c8-e939-4f9c-a425-720fb747128f tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Calling method '>' {{(pid=129322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:43:06.985293 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-aea6ac9f-9a34-444e-a795-33769eff6424 tempest-TestMinimumBasicScenario-102576986 tempest-TestMinimumBasicScenario-102576986-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:43:06.985473 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.compute.api [None req-e639d1c8-e939-4f9c-a425-720fb747128f tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] [instance: bf2f6303-22b9-4cfa-8d4d-61d2503bc554] Fetching instance by UUID {{(pid=129322) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:43:06.985703 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-aea6ac9f-9a34-444e-a795-33769eff6424 tempest-TestMinimumBasicScenario-102576986 tempest-TestMinimumBasicScenario-102576986-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:43:06.986852 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-aea6ac9f-9a34-444e-a795-33769eff6424 tempest-TestMinimumBasicScenario-102576986 tempest-TestMinimumBasicScenario-102576986-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:43:06.987931 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG dbcounter [-] [129322] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=129322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:43:06.988339 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-aea6ac9f-9a34-444e-a795-33769eff6424 tempest-TestMinimumBasicScenario-102576986 tempest-TestMinimumBasicScenario-102576986-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:43:06.993632 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-e639d1c8-e939-4f9c-a425-720fb747128f tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:43:06.994081 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-e639d1c8-e939-4f9c-a425-720fb747128f tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:43:06.995565 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-e639d1c8-e939-4f9c-a425-720fb747128f tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:43:06.995997 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-e639d1c8-e939-4f9c-a425-720fb747128f tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:43:07.130934 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.policy [None req-e639d1c8-e939-4f9c-a425-720fb747128f tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e811736979c44b02b14fecb74c6bd7ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675272fb40d4847819f83ec04afecef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129322) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:43:07.139832 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.policy [None req-e639d1c8-e939-4f9c-a425-720fb747128f tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e811736979c44b02b14fecb74c6bd7ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675272fb40d4847819f83ec04afecef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129322) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:43:07.141517 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.policy [None req-e639d1c8-e939-4f9c-a425-720fb747128f tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e811736979c44b02b14fecb74c6bd7ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675272fb40d4847819f83ec04afecef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129322) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:43:07.142839 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: INFO nova.api.openstack.requestlog [None req-e639d1c8-e939-4f9c-a425-720fb747128f tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] 10.222.0.75 "GET /compute/v2.1/servers/bf2f6303-22b9-4cfa-8d4d-61d2503bc554" status: 200 len: 1746 microversion: 2.20 time: 0.162133 May 26 12:43:07.143424 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: [pid: 129322|app: 0|req: 307/585] 10.222.0.75 () {60 vars in 1276 bytes} [Thu May 26 12:43:06 2022] GET /compute/v2.1/servers/bf2f6303-22b9-4cfa-8d4d-61d2503bc554 => generated 1746 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 26 12:43:07.184728 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.policy [None req-aea6ac9f-9a34-444e-a795-33769eff6424 tempest-TestMinimumBasicScenario-102576986 tempest-TestMinimumBasicScenario-102576986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0352a80bdc174b9a9df4eca60b81eba4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fa2c4d6423444e487d259062656129b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129321) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:43:07.193785 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: INFO nova.api.openstack.requestlog [None req-aea6ac9f-9a34-444e-a795-33769eff6424 tempest-TestMinimumBasicScenario-102576986 tempest-TestMinimumBasicScenario-102576986-project] 10.222.0.75 "GET /compute/v2.1/servers/76661008-e6d3-4646-a9ba-d5d0e83a4b65" status: 200 len: 1547 microversion: 2.1 time: 0.219686 May 26 12:43:07.194737 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: [pid: 129321|app: 0|req: 279/586] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 26 12:43:06 2022] GET /compute/v2.1/servers/76661008-e6d3-4646-a9ba-d5d0e83a4b65 => generated 1547 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:43:07.211189 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi [None req-6b6d8e03-b5ad-4720-9208-719b31c5e9f8 tempest-TestMinimumBasicScenario-102576986 tempest-TestMinimumBasicScenario-102576986-project] Calling method '>' {{(pid=129322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:43:07.211840 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.compute.api [None req-6b6d8e03-b5ad-4720-9208-719b31c5e9f8 tempest-TestMinimumBasicScenario-102576986 tempest-TestMinimumBasicScenario-102576986-project] [instance: 76661008-e6d3-4646-a9ba-d5d0e83a4b65] Fetching instance by UUID {{(pid=129322) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:43:07.219154 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-6b6d8e03-b5ad-4720-9208-719b31c5e9f8 tempest-TestMinimumBasicScenario-102576986 tempest-TestMinimumBasicScenario-102576986-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:43:07.219627 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-6b6d8e03-b5ad-4720-9208-719b31c5e9f8 tempest-TestMinimumBasicScenario-102576986 tempest-TestMinimumBasicScenario-102576986-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:43:07.220442 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-6b6d8e03-b5ad-4720-9208-719b31c5e9f8 tempest-TestMinimumBasicScenario-102576986 tempest-TestMinimumBasicScenario-102576986-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:43:07.220871 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-6b6d8e03-b5ad-4720-9208-719b31c5e9f8 tempest-TestMinimumBasicScenario-102576986 tempest-TestMinimumBasicScenario-102576986-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:43:07.310483 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi [None req-bd35d957-e90b-4a7f-81c8-7fddaf7b18dc tempest-VolumesSnapshotTestJSON-1904508205 tempest-VolumesSnapshotTestJSON-1904508205-project] Calling method '>' {{(pid=129321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:43:07.311531 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.compute.api [None req-bd35d957-e90b-4a7f-81c8-7fddaf7b18dc tempest-VolumesSnapshotTestJSON-1904508205 tempest-VolumesSnapshotTestJSON-1904508205-project] [instance: 6a87df93-cf49-465a-80dd-102efb0f8b11] Fetching instance by UUID {{(pid=129321) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:43:07.318361 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-bd35d957-e90b-4a7f-81c8-7fddaf7b18dc tempest-VolumesSnapshotTestJSON-1904508205 tempest-VolumesSnapshotTestJSON-1904508205-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:43:07.319099 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-bd35d957-e90b-4a7f-81c8-7fddaf7b18dc tempest-VolumesSnapshotTestJSON-1904508205 tempest-VolumesSnapshotTestJSON-1904508205-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:43:07.320035 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-bd35d957-e90b-4a7f-81c8-7fddaf7b18dc tempest-VolumesSnapshotTestJSON-1904508205 tempest-VolumesSnapshotTestJSON-1904508205-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:43:07.320526 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-bd35d957-e90b-4a7f-81c8-7fddaf7b18dc tempest-VolumesSnapshotTestJSON-1904508205 tempest-VolumesSnapshotTestJSON-1904508205-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:43:07.370471 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.policy [None req-6b6d8e03-b5ad-4720-9208-719b31c5e9f8 tempest-TestMinimumBasicScenario-102576986 tempest-TestMinimumBasicScenario-102576986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0352a80bdc174b9a9df4eca60b81eba4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fa2c4d6423444e487d259062656129b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129322) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:43:07.378190 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: INFO nova.api.openstack.requestlog [None req-6b6d8e03-b5ad-4720-9208-719b31c5e9f8 tempest-TestMinimumBasicScenario-102576986 tempest-TestMinimumBasicScenario-102576986-project] 10.222.0.75 "GET /compute/v2.1/servers/76661008-e6d3-4646-a9ba-d5d0e83a4b65" status: 200 len: 1547 microversion: 2.1 time: 0.171050 May 26 12:43:07.378769 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: [pid: 129322|app: 0|req: 308/587] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 26 12:43:07 2022] GET /compute/v2.1/servers/76661008-e6d3-4646-a9ba-d5d0e83a4b65 => generated 1547 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:43:07.396271 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi [None req-8cd8a151-8806-45ca-9253-4ea669c27e89 tempest-TestMinimumBasicScenario-102576986 tempest-TestMinimumBasicScenario-102576986-project] Calling method '>' {{(pid=129322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:43:07.399786 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.policy [None req-8cd8a151-8806-45ca-9253-4ea669c27e89 tempest-TestMinimumBasicScenario-102576986 tempest-TestMinimumBasicScenario-102576986-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '0352a80bdc174b9a9df4eca60b81eba4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fa2c4d6423444e487d259062656129b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129322) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:43:07.401120 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.compute.api [None req-8cd8a151-8806-45ca-9253-4ea669c27e89 tempest-TestMinimumBasicScenario-102576986 tempest-TestMinimumBasicScenario-102576986-project] Searching by: {'deleted': False, 'project_id': '2fa2c4d6423444e487d259062656129b'} {{(pid=129322) get_all /opt/stack/nova/nova/compute/api.py:2962}} May 26 12:43:07.408196 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-8cd8a151-8806-45ca-9253-4ea669c27e89 tempest-TestMinimumBasicScenario-102576986 tempest-TestMinimumBasicScenario-102576986-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:43:07.408632 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-8cd8a151-8806-45ca-9253-4ea669c27e89 tempest-TestMinimumBasicScenario-102576986 tempest-TestMinimumBasicScenario-102576986-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:43:07.409415 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-8cd8a151-8806-45ca-9253-4ea669c27e89 tempest-TestMinimumBasicScenario-102576986 tempest-TestMinimumBasicScenario-102576986-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:43:07.409843 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-8cd8a151-8806-45ca-9253-4ea669c27e89 tempest-TestMinimumBasicScenario-102576986 tempest-TestMinimumBasicScenario-102576986-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:43:07.505329 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.compute.multi_cell_list [None req-8cd8a151-8806-45ca-9253-4ea669c27e89 tempest-TestMinimumBasicScenario-102576986 tempest-TestMinimumBasicScenario-102576986-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=129322) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} May 26 12:43:07.507697 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.policy [None req-bd35d957-e90b-4a7f-81c8-7fddaf7b18dc tempest-VolumesSnapshotTestJSON-1904508205 tempest-VolumesSnapshotTestJSON-1904508205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '805854e5ce2e412fb9420afd63f73ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72bda4cbb07a43688506e01d06ba89c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129321) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:43:07.515577 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: INFO nova.api.openstack.requestlog [None req-bd35d957-e90b-4a7f-81c8-7fddaf7b18dc tempest-VolumesSnapshotTestJSON-1904508205 tempest-VolumesSnapshotTestJSON-1904508205-project] 10.222.0.75 "GET /compute/v2.1/servers/6a87df93-cf49-465a-80dd-102efb0f8b11" status: 200 len: 1319 microversion: 2.1 time: 0.209156 May 26 12:43:07.516156 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: [pid: 129321|app: 0|req: 280/588] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 26 12:43:07 2022] GET /compute/v2.1/servers/6a87df93-cf49-465a-80dd-102efb0f8b11 => generated 1319 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:43:07.606754 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: INFO nova.api.openstack.requestlog [None req-8cd8a151-8806-45ca-9253-4ea669c27e89 tempest-TestMinimumBasicScenario-102576986 tempest-TestMinimumBasicScenario-102576986-project] 10.222.0.75 "GET /compute/v2.1/servers" status: 200 len: 342 microversion: 2.1 time: 0.214101 May 26 12:43:07.607291 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: [pid: 129322|app: 0|req: 309/589] 10.222.0.75 () {58 vars in 1124 bytes} [Thu May 26 12:43:07 2022] GET /compute/v2.1/servers => generated 342 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 12:43:07.618049 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi [None req-e2bc057b-df0a-4100-9cd3-7ef6c1c928c9 tempest-TestMinimumBasicScenario-102576986 tempest-TestMinimumBasicScenario-102576986-project] Calling method '>' {{(pid=129321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:43:07.618651 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.compute.api [None req-e2bc057b-df0a-4100-9cd3-7ef6c1c928c9 tempest-TestMinimumBasicScenario-102576986 tempest-TestMinimumBasicScenario-102576986-project] [instance: 76661008-e6d3-4646-a9ba-d5d0e83a4b65] Fetching instance by UUID {{(pid=129321) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:43:07.625362 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-e2bc057b-df0a-4100-9cd3-7ef6c1c928c9 tempest-TestMinimumBasicScenario-102576986 tempest-TestMinimumBasicScenario-102576986-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:43:07.625805 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-e2bc057b-df0a-4100-9cd3-7ef6c1c928c9 tempest-TestMinimumBasicScenario-102576986 tempest-TestMinimumBasicScenario-102576986-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:43:07.626584 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-e2bc057b-df0a-4100-9cd3-7ef6c1c928c9 tempest-TestMinimumBasicScenario-102576986 tempest-TestMinimumBasicScenario-102576986-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:43:07.627191 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-e2bc057b-df0a-4100-9cd3-7ef6c1c928c9 tempest-TestMinimumBasicScenario-102576986 tempest-TestMinimumBasicScenario-102576986-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:43:07.630715 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi [None req-913669e8-d2cf-4237-926b-011615f90ed0 tempest-VolumesActionsTest-731506124 tempest-VolumesActionsTest-731506124-project] Calling method '>' {{(pid=129322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:43:07.631356 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.compute.api [None req-913669e8-d2cf-4237-926b-011615f90ed0 tempest-VolumesActionsTest-731506124 tempest-VolumesActionsTest-731506124-project] [instance: 3fd057be-56c1-462d-8ea2-9ca668166ccf] Fetching instance by UUID {{(pid=129322) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:43:07.637510 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-913669e8-d2cf-4237-926b-011615f90ed0 tempest-VolumesActionsTest-731506124 tempest-VolumesActionsTest-731506124-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:43:07.637955 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-913669e8-d2cf-4237-926b-011615f90ed0 tempest-VolumesActionsTest-731506124 tempest-VolumesActionsTest-731506124-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:43:07.638695 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-913669e8-d2cf-4237-926b-011615f90ed0 tempest-VolumesActionsTest-731506124 tempest-VolumesActionsTest-731506124-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:43:07.639127 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-913669e8-d2cf-4237-926b-011615f90ed0 tempest-VolumesActionsTest-731506124 tempest-VolumesActionsTest-731506124-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:43:07.757170 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.policy [None req-e2bc057b-df0a-4100-9cd3-7ef6c1c928c9 tempest-TestMinimumBasicScenario-102576986 tempest-TestMinimumBasicScenario-102576986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0352a80bdc174b9a9df4eca60b81eba4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fa2c4d6423444e487d259062656129b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129321) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:43:07.759521 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG dbcounter [-] [129321] Writing DB stats nova_cell1:SELECT=100 {{(pid=129321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:43:07.766799 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: INFO nova.api.openstack.requestlog [None req-e2bc057b-df0a-4100-9cd3-7ef6c1c928c9 tempest-TestMinimumBasicScenario-102576986 tempest-TestMinimumBasicScenario-102576986-project] 10.222.0.75 "GET /compute/v2.1/servers/76661008-e6d3-4646-a9ba-d5d0e83a4b65" status: 200 len: 1547 microversion: 2.1 time: 0.152611 May 26 12:43:07.767507 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: [pid: 129321|app: 0|req: 281/590] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 26 12:43:07 2022] GET /compute/v2.1/servers/76661008-e6d3-4646-a9ba-d5d0e83a4b65 => generated 1547 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:43:07.772239 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi [None req-8f333b61-c39b-4a40-973a-89f22687a2d0 tempest-TestShelveInstance-546397589 tempest-TestShelveInstance-546397589-project] Calling method '>' {{(pid=129321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:43:07.772843 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.compute.api [None req-8f333b61-c39b-4a40-973a-89f22687a2d0 tempest-TestShelveInstance-546397589 tempest-TestShelveInstance-546397589-project] [instance: 05cf529d-df00-4ff9-b0d2-0e27563d2861] Fetching instance by UUID {{(pid=129321) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:43:07.779444 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-8f333b61-c39b-4a40-973a-89f22687a2d0 tempest-TestShelveInstance-546397589 tempest-TestShelveInstance-546397589-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:43:07.780441 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-8f333b61-c39b-4a40-973a-89f22687a2d0 tempest-TestShelveInstance-546397589 tempest-TestShelveInstance-546397589-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:43:07.780996 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-8f333b61-c39b-4a40-973a-89f22687a2d0 tempest-TestShelveInstance-546397589 tempest-TestShelveInstance-546397589-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:43:07.781484 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-8f333b61-c39b-4a40-973a-89f22687a2d0 tempest-TestShelveInstance-546397589 tempest-TestShelveInstance-546397589-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:43:07.782004 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.policy [None req-913669e8-d2cf-4237-926b-011615f90ed0 tempest-VolumesActionsTest-731506124 tempest-VolumesActionsTest-731506124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f39e076a9e6b401db6de9a2846519591', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa93879e60e470185e8dd71efaaf1a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129322) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:43:07.792046 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: INFO nova.api.openstack.requestlog [None req-913669e8-d2cf-4237-926b-011615f90ed0 tempest-VolumesActionsTest-731506124 tempest-VolumesActionsTest-731506124-project] 10.222.0.75 "GET /compute/v2.1/servers/3fd057be-56c1-462d-8ea2-9ca668166ccf" status: 200 len: 1314 microversion: 2.1 time: 0.164617 May 26 12:43:07.792846 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: [pid: 129322|app: 0|req: 310/591] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 26 12:43:07 2022] GET /compute/v2.1/servers/3fd057be-56c1-462d-8ea2-9ca668166ccf => generated 1314 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:43:07.920722 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.policy [None req-8f333b61-c39b-4a40-973a-89f22687a2d0 tempest-TestShelveInstance-546397589 tempest-TestShelveInstance-546397589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d9bf2dcfce24386a1aaf9709d88da45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1f2f503ef674a4b97f848b69f8b63c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129321) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:43:07.929487 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: INFO nova.api.openstack.requestlog [None req-8f333b61-c39b-4a40-973a-89f22687a2d0 tempest-TestShelveInstance-546397589 tempest-TestShelveInstance-546397589-project] 10.222.0.75 "GET /compute/v2.1/servers/05cf529d-df00-4ff9-b0d2-0e27563d2861" status: 200 len: 1259 microversion: 2.1 time: 0.160790 May 26 12:43:07.930393 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: [pid: 129321|app: 0|req: 282/592] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 26 12:43:07 2022] GET /compute/v2.1/servers/05cf529d-df00-4ff9-b0d2-0e27563d2861 => generated 1259 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:43:08.162488 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi [None req-4742a67c-eb94-4faf-aaaf-98c74008088d tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Calling method '>' {{(pid=129322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:43:08.163273 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.compute.api [None req-4742a67c-eb94-4faf-aaaf-98c74008088d tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] [instance: bf2f6303-22b9-4cfa-8d4d-61d2503bc554] Fetching instance by UUID {{(pid=129322) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:43:08.169569 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-4742a67c-eb94-4faf-aaaf-98c74008088d tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:43:08.170026 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-4742a67c-eb94-4faf-aaaf-98c74008088d tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:43:08.170788 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-4742a67c-eb94-4faf-aaaf-98c74008088d tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:43:08.171229 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-4742a67c-eb94-4faf-aaaf-98c74008088d tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:43:08.309434 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.policy [None req-4742a67c-eb94-4faf-aaaf-98c74008088d tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e811736979c44b02b14fecb74c6bd7ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675272fb40d4847819f83ec04afecef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129322) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:43:08.311726 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG dbcounter [-] [129322] Writing DB stats nova_cell1:SELECT=100 {{(pid=129322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:43:08.319523 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.policy [None req-4742a67c-eb94-4faf-aaaf-98c74008088d tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e811736979c44b02b14fecb74c6bd7ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675272fb40d4847819f83ec04afecef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129322) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:43:08.321351 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.policy [None req-4742a67c-eb94-4faf-aaaf-98c74008088d tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e811736979c44b02b14fecb74c6bd7ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675272fb40d4847819f83ec04afecef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129322) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:43:08.322667 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: INFO nova.api.openstack.requestlog [None req-4742a67c-eb94-4faf-aaaf-98c74008088d tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] 10.222.0.75 "GET /compute/v2.1/servers/bf2f6303-22b9-4cfa-8d4d-61d2503bc554" status: 200 len: 1746 microversion: 2.20 time: 0.164794 May 26 12:43:08.323601 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: [pid: 129322|app: 0|req: 311/593] 10.222.0.75 () {60 vars in 1276 bytes} [Thu May 26 12:43:08 2022] GET /compute/v2.1/servers/bf2f6303-22b9-4cfa-8d4d-61d2503bc554 => generated 1746 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 12:43:08.533818 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi [None req-1c1b8cee-92df-4f88-9469-6daa7287fa28 tempest-VolumesSnapshotTestJSON-1904508205 tempest-VolumesSnapshotTestJSON-1904508205-project] Calling method '>' {{(pid=129321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:43:08.534434 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.compute.api [None req-1c1b8cee-92df-4f88-9469-6daa7287fa28 tempest-VolumesSnapshotTestJSON-1904508205 tempest-VolumesSnapshotTestJSON-1904508205-project] [instance: 6a87df93-cf49-465a-80dd-102efb0f8b11] Fetching instance by UUID {{(pid=129321) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:43:08.541855 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-1c1b8cee-92df-4f88-9469-6daa7287fa28 tempest-VolumesSnapshotTestJSON-1904508205 tempest-VolumesSnapshotTestJSON-1904508205-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:43:08.542366 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-1c1b8cee-92df-4f88-9469-6daa7287fa28 tempest-VolumesSnapshotTestJSON-1904508205 tempest-VolumesSnapshotTestJSON-1904508205-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:43:08.543230 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-1c1b8cee-92df-4f88-9469-6daa7287fa28 tempest-VolumesSnapshotTestJSON-1904508205 tempest-VolumesSnapshotTestJSON-1904508205-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:43:08.543728 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-1c1b8cee-92df-4f88-9469-6daa7287fa28 tempest-VolumesSnapshotTestJSON-1904508205 tempest-VolumesSnapshotTestJSON-1904508205-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:43:08.700798 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.policy [None req-1c1b8cee-92df-4f88-9469-6daa7287fa28 tempest-VolumesSnapshotTestJSON-1904508205 tempest-VolumesSnapshotTestJSON-1904508205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '805854e5ce2e412fb9420afd63f73ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72bda4cbb07a43688506e01d06ba89c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129321) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:43:08.712626 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: INFO nova.api.openstack.requestlog [None req-1c1b8cee-92df-4f88-9469-6daa7287fa28 tempest-VolumesSnapshotTestJSON-1904508205 tempest-VolumesSnapshotTestJSON-1904508205-project] 10.222.0.75 "GET /compute/v2.1/servers/6a87df93-cf49-465a-80dd-102efb0f8b11" status: 200 len: 1319 microversion: 2.1 time: 0.182541 May 26 12:43:08.713566 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: [pid: 129321|app: 0|req: 283/594] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 26 12:43:08 2022] GET /compute/v2.1/servers/6a87df93-cf49-465a-80dd-102efb0f8b11 => generated 1319 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:43:08.809316 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi [None req-6444946e-66b2-4500-88da-aad5f09a133e tempest-VolumesActionsTest-731506124 tempest-VolumesActionsTest-731506124-project] Calling method '>' {{(pid=129322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:43:08.809973 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.compute.api [None req-6444946e-66b2-4500-88da-aad5f09a133e tempest-VolumesActionsTest-731506124 tempest-VolumesActionsTest-731506124-project] [instance: 3fd057be-56c1-462d-8ea2-9ca668166ccf] Fetching instance by UUID {{(pid=129322) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:43:08.816598 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-6444946e-66b2-4500-88da-aad5f09a133e tempest-VolumesActionsTest-731506124 tempest-VolumesActionsTest-731506124-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:43:08.816880 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-6444946e-66b2-4500-88da-aad5f09a133e tempest-VolumesActionsTest-731506124 tempest-VolumesActionsTest-731506124-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:43:08.817665 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-6444946e-66b2-4500-88da-aad5f09a133e tempest-VolumesActionsTest-731506124 tempest-VolumesActionsTest-731506124-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:43:08.818095 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-6444946e-66b2-4500-88da-aad5f09a133e tempest-VolumesActionsTest-731506124 tempest-VolumesActionsTest-731506124-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:43:08.946640 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi [None req-6c4c4f32-9da1-45e9-af0c-bb843fd016a0 tempest-TestShelveInstance-546397589 tempest-TestShelveInstance-546397589-project] Calling method '>' {{(pid=129321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:43:08.947324 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.compute.api [None req-6c4c4f32-9da1-45e9-af0c-bb843fd016a0 tempest-TestShelveInstance-546397589 tempest-TestShelveInstance-546397589-project] [instance: 05cf529d-df00-4ff9-b0d2-0e27563d2861] Fetching instance by UUID {{(pid=129321) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:43:08.953987 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-6c4c4f32-9da1-45e9-af0c-bb843fd016a0 tempest-TestShelveInstance-546397589 tempest-TestShelveInstance-546397589-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:43:08.954404 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-6c4c4f32-9da1-45e9-af0c-bb843fd016a0 tempest-TestShelveInstance-546397589 tempest-TestShelveInstance-546397589-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:43:08.955167 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-6c4c4f32-9da1-45e9-af0c-bb843fd016a0 tempest-TestShelveInstance-546397589 tempest-TestShelveInstance-546397589-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:43:08.955626 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-6c4c4f32-9da1-45e9-af0c-bb843fd016a0 tempest-TestShelveInstance-546397589 tempest-TestShelveInstance-546397589-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:43:08.977939 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.policy [None req-6444946e-66b2-4500-88da-aad5f09a133e tempest-VolumesActionsTest-731506124 tempest-VolumesActionsTest-731506124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f39e076a9e6b401db6de9a2846519591', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa93879e60e470185e8dd71efaaf1a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129322) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:43:08.989801 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: INFO nova.api.openstack.requestlog [None req-6444946e-66b2-4500-88da-aad5f09a133e tempest-VolumesActionsTest-731506124 tempest-VolumesActionsTest-731506124-project] 10.222.0.75 "GET /compute/v2.1/servers/3fd057be-56c1-462d-8ea2-9ca668166ccf" status: 200 len: 1314 microversion: 2.1 time: 0.184141 May 26 12:43:08.990653 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: [pid: 129322|app: 0|req: 312/595] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 26 12:43:08 2022] GET /compute/v2.1/servers/3fd057be-56c1-462d-8ea2-9ca668166ccf => generated 1314 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:43:09.109266 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.policy [None req-6c4c4f32-9da1-45e9-af0c-bb843fd016a0 tempest-TestShelveInstance-546397589 tempest-TestShelveInstance-546397589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d9bf2dcfce24386a1aaf9709d88da45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1f2f503ef674a4b97f848b69f8b63c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129321) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:43:09.117223 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: INFO nova.api.openstack.requestlog [None req-6c4c4f32-9da1-45e9-af0c-bb843fd016a0 tempest-TestShelveInstance-546397589 tempest-TestShelveInstance-546397589-project] 10.222.0.75 "GET /compute/v2.1/servers/05cf529d-df00-4ff9-b0d2-0e27563d2861" status: 200 len: 1259 microversion: 2.1 time: 0.174551 May 26 12:43:09.117925 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: [pid: 129321|app: 0|req: 284/596] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 26 12:43:08 2022] GET /compute/v2.1/servers/05cf529d-df00-4ff9-b0d2-0e27563d2861 => generated 1259 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:43:09.345454 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi [None req-b8d00c49-d24f-47d7-97fe-b43246f8df0d tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Calling method '>' {{(pid=129322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:43:09.346469 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.compute.api [None req-b8d00c49-d24f-47d7-97fe-b43246f8df0d tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] [instance: bf2f6303-22b9-4cfa-8d4d-61d2503bc554] Fetching instance by UUID {{(pid=129322) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:43:09.353444 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-b8d00c49-d24f-47d7-97fe-b43246f8df0d tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:43:09.353887 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-b8d00c49-d24f-47d7-97fe-b43246f8df0d tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:43:09.354651 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-b8d00c49-d24f-47d7-97fe-b43246f8df0d tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:43:09.355074 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-b8d00c49-d24f-47d7-97fe-b43246f8df0d tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:43:09.506071 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.policy [None req-b8d00c49-d24f-47d7-97fe-b43246f8df0d tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e811736979c44b02b14fecb74c6bd7ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675272fb40d4847819f83ec04afecef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129322) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:43:09.518798 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.policy [None req-b8d00c49-d24f-47d7-97fe-b43246f8df0d tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e811736979c44b02b14fecb74c6bd7ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675272fb40d4847819f83ec04afecef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129322) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:43:09.521205 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.policy [None req-b8d00c49-d24f-47d7-97fe-b43246f8df0d tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e811736979c44b02b14fecb74c6bd7ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675272fb40d4847819f83ec04afecef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129322) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:43:09.522977 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: INFO nova.api.openstack.requestlog [None req-b8d00c49-d24f-47d7-97fe-b43246f8df0d tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] 10.222.0.75 "GET /compute/v2.1/servers/bf2f6303-22b9-4cfa-8d4d-61d2503bc554" status: 200 len: 1746 microversion: 2.20 time: 0.183517 May 26 12:43:09.523815 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: [pid: 129322|app: 0|req: 313/597] 10.222.0.75 () {60 vars in 1276 bytes} [Thu May 26 12:43:09 2022] GET /compute/v2.1/servers/bf2f6303-22b9-4cfa-8d4d-61d2503bc554 => generated 1746 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 12:43:09.735457 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi [None req-d28716d3-b274-4faf-9428-d7958d1463b4 tempest-VolumesSnapshotTestJSON-1904508205 tempest-VolumesSnapshotTestJSON-1904508205-project] Calling method '>' {{(pid=129321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:43:09.736082 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.compute.api [None req-d28716d3-b274-4faf-9428-d7958d1463b4 tempest-VolumesSnapshotTestJSON-1904508205 tempest-VolumesSnapshotTestJSON-1904508205-project] [instance: 6a87df93-cf49-465a-80dd-102efb0f8b11] Fetching instance by UUID {{(pid=129321) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:43:09.744268 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-d28716d3-b274-4faf-9428-d7958d1463b4 tempest-VolumesSnapshotTestJSON-1904508205 tempest-VolumesSnapshotTestJSON-1904508205-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:43:09.744716 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-d28716d3-b274-4faf-9428-d7958d1463b4 tempest-VolumesSnapshotTestJSON-1904508205 tempest-VolumesSnapshotTestJSON-1904508205-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:43:09.745463 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-d28716d3-b274-4faf-9428-d7958d1463b4 tempest-VolumesSnapshotTestJSON-1904508205 tempest-VolumesSnapshotTestJSON-1904508205-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:43:09.745890 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-d28716d3-b274-4faf-9428-d7958d1463b4 tempest-VolumesSnapshotTestJSON-1904508205 tempest-VolumesSnapshotTestJSON-1904508205-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:43:09.903404 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.policy [None req-d28716d3-b274-4faf-9428-d7958d1463b4 tempest-VolumesSnapshotTestJSON-1904508205 tempest-VolumesSnapshotTestJSON-1904508205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '805854e5ce2e412fb9420afd63f73ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72bda4cbb07a43688506e01d06ba89c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129321) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:43:09.912252 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: INFO nova.api.openstack.requestlog [None req-d28716d3-b274-4faf-9428-d7958d1463b4 tempest-VolumesSnapshotTestJSON-1904508205 tempest-VolumesSnapshotTestJSON-1904508205-project] 10.222.0.75 "GET /compute/v2.1/servers/6a87df93-cf49-465a-80dd-102efb0f8b11" status: 200 len: 1319 microversion: 2.1 time: 0.182773 May 26 12:43:09.912843 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: [pid: 129321|app: 0|req: 285/598] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 26 12:43:09 2022] GET /compute/v2.1/servers/6a87df93-cf49-465a-80dd-102efb0f8b11 => generated 1319 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:43:10.009809 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi [None req-c2f8078b-7895-43d4-8f1d-838dd37aae1e tempest-VolumesActionsTest-731506124 tempest-VolumesActionsTest-731506124-project] Calling method '>' {{(pid=129322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:43:10.010684 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.compute.api [None req-c2f8078b-7895-43d4-8f1d-838dd37aae1e tempest-VolumesActionsTest-731506124 tempest-VolumesActionsTest-731506124-project] [instance: 3fd057be-56c1-462d-8ea2-9ca668166ccf] Fetching instance by UUID {{(pid=129322) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:43:10.020328 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-c2f8078b-7895-43d4-8f1d-838dd37aae1e tempest-VolumesActionsTest-731506124 tempest-VolumesActionsTest-731506124-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:43:10.020780 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-c2f8078b-7895-43d4-8f1d-838dd37aae1e tempest-VolumesActionsTest-731506124 tempest-VolumesActionsTest-731506124-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:43:10.021553 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-c2f8078b-7895-43d4-8f1d-838dd37aae1e tempest-VolumesActionsTest-731506124 tempest-VolumesActionsTest-731506124-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:43:10.021993 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-c2f8078b-7895-43d4-8f1d-838dd37aae1e tempest-VolumesActionsTest-731506124 tempest-VolumesActionsTest-731506124-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:43:10.136612 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi [None req-87a0a5fb-ed05-459d-b86a-a69aaa4650d4 tempest-TestShelveInstance-546397589 tempest-TestShelveInstance-546397589-project] Calling method '>' {{(pid=129321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:43:10.137319 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.compute.api [None req-87a0a5fb-ed05-459d-b86a-a69aaa4650d4 tempest-TestShelveInstance-546397589 tempest-TestShelveInstance-546397589-project] [instance: 05cf529d-df00-4ff9-b0d2-0e27563d2861] Fetching instance by UUID {{(pid=129321) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:43:10.144377 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-87a0a5fb-ed05-459d-b86a-a69aaa4650d4 tempest-TestShelveInstance-546397589 tempest-TestShelveInstance-546397589-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:43:10.145075 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-87a0a5fb-ed05-459d-b86a-a69aaa4650d4 tempest-TestShelveInstance-546397589 tempest-TestShelveInstance-546397589-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:43:10.146739 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-87a0a5fb-ed05-459d-b86a-a69aaa4650d4 tempest-TestShelveInstance-546397589 tempest-TestShelveInstance-546397589-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:43:10.147172 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-87a0a5fb-ed05-459d-b86a-a69aaa4650d4 tempest-TestShelveInstance-546397589 tempest-TestShelveInstance-546397589-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:43:10.186428 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.policy [None req-c2f8078b-7895-43d4-8f1d-838dd37aae1e tempest-VolumesActionsTest-731506124 tempest-VolumesActionsTest-731506124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f39e076a9e6b401db6de9a2846519591', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa93879e60e470185e8dd71efaaf1a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129322) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:43:10.194651 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: INFO nova.api.openstack.requestlog [None req-c2f8078b-7895-43d4-8f1d-838dd37aae1e tempest-VolumesActionsTest-731506124 tempest-VolumesActionsTest-731506124-project] 10.222.0.75 "GET /compute/v2.1/servers/3fd057be-56c1-462d-8ea2-9ca668166ccf" status: 200 len: 1314 microversion: 2.1 time: 0.190432 May 26 12:43:10.195243 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: [pid: 129322|app: 0|req: 314/599] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 26 12:43:10 2022] GET /compute/v2.1/servers/3fd057be-56c1-462d-8ea2-9ca668166ccf => generated 1314 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:43:10.289426 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.policy [None req-87a0a5fb-ed05-459d-b86a-a69aaa4650d4 tempest-TestShelveInstance-546397589 tempest-TestShelveInstance-546397589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d9bf2dcfce24386a1aaf9709d88da45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1f2f503ef674a4b97f848b69f8b63c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129321) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:43:10.298495 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: INFO nova.api.openstack.requestlog [None req-87a0a5fb-ed05-459d-b86a-a69aaa4650d4 tempest-TestShelveInstance-546397589 tempest-TestShelveInstance-546397589-project] 10.222.0.75 "GET /compute/v2.1/servers/05cf529d-df00-4ff9-b0d2-0e27563d2861" status: 200 len: 1259 microversion: 2.1 time: 0.166730 May 26 12:43:10.299212 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: [pid: 129321|app: 0|req: 286/600] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 26 12:43:10 2022] GET /compute/v2.1/servers/05cf529d-df00-4ff9-b0d2-0e27563d2861 => generated 1259 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:43:10.391528 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi [None req-28fb2e59-bb0e-462b-8ab2-17864cd280e5 tempest-TestMinimumBasicScenario-102576986 tempest-TestMinimumBasicScenario-102576986-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "abf921a4-40ef-4fd1-97e5-c25de2c53323"}} {{(pid=129322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 12:43:10.393091 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.compute.api [None req-28fb2e59-bb0e-462b-8ab2-17864cd280e5 tempest-TestMinimumBasicScenario-102576986 tempest-TestMinimumBasicScenario-102576986-project] [instance: 76661008-e6d3-4646-a9ba-d5d0e83a4b65] Fetching instance by UUID {{(pid=129322) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:43:10.400723 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-28fb2e59-bb0e-462b-8ab2-17864cd280e5 tempest-TestMinimumBasicScenario-102576986 tempest-TestMinimumBasicScenario-102576986-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:43:10.401163 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-28fb2e59-bb0e-462b-8ab2-17864cd280e5 tempest-TestMinimumBasicScenario-102576986 tempest-TestMinimumBasicScenario-102576986-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:43:10.401916 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-28fb2e59-bb0e-462b-8ab2-17864cd280e5 tempest-TestMinimumBasicScenario-102576986 tempest-TestMinimumBasicScenario-102576986-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:43:10.402341 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-28fb2e59-bb0e-462b-8ab2-17864cd280e5 tempest-TestMinimumBasicScenario-102576986 tempest-TestMinimumBasicScenario-102576986-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:43:10.542780 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi [None req-3a6b9be0-72c7-4829-a58e-1590b52d2a2d tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Calling method '>' {{(pid=129321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:43:10.543282 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.compute.api [None req-3a6b9be0-72c7-4829-a58e-1590b52d2a2d tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] [instance: bf2f6303-22b9-4cfa-8d4d-61d2503bc554] Fetching instance by UUID {{(pid=129321) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:43:10.549861 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-3a6b9be0-72c7-4829-a58e-1590b52d2a2d tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:43:10.550279 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-3a6b9be0-72c7-4829-a58e-1590b52d2a2d tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:43:10.551036 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-3a6b9be0-72c7-4829-a58e-1590b52d2a2d tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:43:10.551729 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-3a6b9be0-72c7-4829-a58e-1590b52d2a2d tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:43:10.699066 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.policy [None req-3a6b9be0-72c7-4829-a58e-1590b52d2a2d tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e811736979c44b02b14fecb74c6bd7ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675272fb40d4847819f83ec04afecef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129321) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:43:10.710480 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.policy [None req-3a6b9be0-72c7-4829-a58e-1590b52d2a2d tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e811736979c44b02b14fecb74c6bd7ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675272fb40d4847819f83ec04afecef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129321) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:43:10.712148 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.policy [None req-3a6b9be0-72c7-4829-a58e-1590b52d2a2d tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e811736979c44b02b14fecb74c6bd7ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675272fb40d4847819f83ec04afecef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129321) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:43:10.713328 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: INFO nova.api.openstack.requestlog [None req-3a6b9be0-72c7-4829-a58e-1590b52d2a2d tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] 10.222.0.75 "GET /compute/v2.1/servers/bf2f6303-22b9-4cfa-8d4d-61d2503bc554" status: 200 len: 1746 microversion: 2.20 time: 0.174592 May 26 12:43:10.713930 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: [pid: 129321|app: 0|req: 287/601] 10.222.0.75 () {60 vars in 1276 bytes} [Thu May 26 12:43:10 2022] GET /compute/v2.1/servers/bf2f6303-22b9-4cfa-8d4d-61d2503bc554 => generated 1746 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 12:43:10.930048 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi [None req-612f7260-55e5-4b40-8a55-e5984fc61069 tempest-VolumesSnapshotTestJSON-1904508205 tempest-VolumesSnapshotTestJSON-1904508205-project] Calling method '>' {{(pid=129321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:43:10.930716 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.compute.api [None req-612f7260-55e5-4b40-8a55-e5984fc61069 tempest-VolumesSnapshotTestJSON-1904508205 tempest-VolumesSnapshotTestJSON-1904508205-project] [instance: 6a87df93-cf49-465a-80dd-102efb0f8b11] Fetching instance by UUID {{(pid=129321) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:43:10.937734 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-612f7260-55e5-4b40-8a55-e5984fc61069 tempest-VolumesSnapshotTestJSON-1904508205 tempest-VolumesSnapshotTestJSON-1904508205-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:43:10.938180 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-612f7260-55e5-4b40-8a55-e5984fc61069 tempest-VolumesSnapshotTestJSON-1904508205 tempest-VolumesSnapshotTestJSON-1904508205-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:43:10.938942 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-612f7260-55e5-4b40-8a55-e5984fc61069 tempest-VolumesSnapshotTestJSON-1904508205 tempest-VolumesSnapshotTestJSON-1904508205-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:43:10.939373 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-612f7260-55e5-4b40-8a55-e5984fc61069 tempest-VolumesSnapshotTestJSON-1904508205 tempest-VolumesSnapshotTestJSON-1904508205-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:43:11.084511 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.policy [None req-612f7260-55e5-4b40-8a55-e5984fc61069 tempest-VolumesSnapshotTestJSON-1904508205 tempest-VolumesSnapshotTestJSON-1904508205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '805854e5ce2e412fb9420afd63f73ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72bda4cbb07a43688506e01d06ba89c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129321) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:43:11.096541 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: INFO nova.api.openstack.requestlog [None req-612f7260-55e5-4b40-8a55-e5984fc61069 tempest-VolumesSnapshotTestJSON-1904508205 tempest-VolumesSnapshotTestJSON-1904508205-project] 10.222.0.75 "GET /compute/v2.1/servers/6a87df93-cf49-465a-80dd-102efb0f8b11" status: 200 len: 1319 microversion: 2.1 time: 0.170573 May 26 12:43:11.097456 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: [pid: 129321|app: 0|req: 288/602] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 26 12:43:10 2022] GET /compute/v2.1/servers/6a87df93-cf49-465a-80dd-102efb0f8b11 => generated 1319 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:43:11.211919 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi [None req-57f4093f-20d9-46b4-8abc-590d9d32f8dd tempest-VolumesActionsTest-731506124 tempest-VolumesActionsTest-731506124-project] Calling method '>' {{(pid=129321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:43:11.212552 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.compute.api [None req-57f4093f-20d9-46b4-8abc-590d9d32f8dd tempest-VolumesActionsTest-731506124 tempest-VolumesActionsTest-731506124-project] [instance: 3fd057be-56c1-462d-8ea2-9ca668166ccf] Fetching instance by UUID {{(pid=129321) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:43:11.218992 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-57f4093f-20d9-46b4-8abc-590d9d32f8dd tempest-VolumesActionsTest-731506124 tempest-VolumesActionsTest-731506124-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:43:11.219437 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-57f4093f-20d9-46b4-8abc-590d9d32f8dd tempest-VolumesActionsTest-731506124 tempest-VolumesActionsTest-731506124-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:43:11.220222 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-57f4093f-20d9-46b4-8abc-590d9d32f8dd tempest-VolumesActionsTest-731506124 tempest-VolumesActionsTest-731506124-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:43:11.220650 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-57f4093f-20d9-46b4-8abc-590d9d32f8dd tempest-VolumesActionsTest-731506124 tempest-VolumesActionsTest-731506124-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:43:11.375179 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.policy [None req-57f4093f-20d9-46b4-8abc-590d9d32f8dd tempest-VolumesActionsTest-731506124 tempest-VolumesActionsTest-731506124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f39e076a9e6b401db6de9a2846519591', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa93879e60e470185e8dd71efaaf1a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129321) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:43:11.383017 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: INFO nova.api.openstack.requestlog [None req-57f4093f-20d9-46b4-8abc-590d9d32f8dd tempest-VolumesActionsTest-731506124 tempest-VolumesActionsTest-731506124-project] 10.222.0.75 "GET /compute/v2.1/servers/3fd057be-56c1-462d-8ea2-9ca668166ccf" status: 200 len: 1314 microversion: 2.1 time: 0.175045 May 26 12:43:11.392361 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: [pid: 129321|app: 0|req: 289/603] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 26 12:43:11 2022] GET /compute/v2.1/servers/3fd057be-56c1-462d-8ea2-9ca668166ccf => generated 1314 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:43:11.397311 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi [None req-74d38540-30dd-430f-a3d5-6ef1cd5802d3 tempest-TestShelveInstance-546397589 tempest-TestShelveInstance-546397589-project] Calling method '>' {{(pid=129321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:43:11.397928 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.compute.api [None req-74d38540-30dd-430f-a3d5-6ef1cd5802d3 tempest-TestShelveInstance-546397589 tempest-TestShelveInstance-546397589-project] [instance: 05cf529d-df00-4ff9-b0d2-0e27563d2861] Fetching instance by UUID {{(pid=129321) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:43:11.404433 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-74d38540-30dd-430f-a3d5-6ef1cd5802d3 tempest-TestShelveInstance-546397589 tempest-TestShelveInstance-546397589-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:43:11.404873 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-74d38540-30dd-430f-a3d5-6ef1cd5802d3 tempest-TestShelveInstance-546397589 tempest-TestShelveInstance-546397589-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:43:11.405671 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-74d38540-30dd-430f-a3d5-6ef1cd5802d3 tempest-TestShelveInstance-546397589 tempest-TestShelveInstance-546397589-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:43:11.406061 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-74d38540-30dd-430f-a3d5-6ef1cd5802d3 tempest-TestShelveInstance-546397589 tempest-TestShelveInstance-546397589-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:43:11.637238 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.policy [None req-74d38540-30dd-430f-a3d5-6ef1cd5802d3 tempest-TestShelveInstance-546397589 tempest-TestShelveInstance-546397589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d9bf2dcfce24386a1aaf9709d88da45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1f2f503ef674a4b97f848b69f8b63c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129321) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:43:11.645287 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: INFO nova.api.openstack.requestlog [None req-74d38540-30dd-430f-a3d5-6ef1cd5802d3 tempest-TestShelveInstance-546397589 tempest-TestShelveInstance-546397589-project] 10.222.0.75 "GET /compute/v2.1/servers/05cf529d-df00-4ff9-b0d2-0e27563d2861" status: 200 len: 1259 microversion: 2.1 time: 0.251845 May 26 12:43:11.645976 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: [pid: 129321|app: 0|req: 290/604] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 26 12:43:11 2022] GET /compute/v2.1/servers/05cf529d-df00-4ff9-b0d2-0e27563d2861 => generated 1259 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:43:11.838343 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi [None req-93fb5b5e-e87d-49f8-90c3-9e2c3cbe8326 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Calling method '>' {{(pid=129321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:43:11.838961 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.compute.api [None req-93fb5b5e-e87d-49f8-90c3-9e2c3cbe8326 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] [instance: bf2f6303-22b9-4cfa-8d4d-61d2503bc554] Fetching instance by UUID {{(pid=129321) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:43:11.845788 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-93fb5b5e-e87d-49f8-90c3-9e2c3cbe8326 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:43:11.846255 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-93fb5b5e-e87d-49f8-90c3-9e2c3cbe8326 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:43:11.847009 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-93fb5b5e-e87d-49f8-90c3-9e2c3cbe8326 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:43:11.847446 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-93fb5b5e-e87d-49f8-90c3-9e2c3cbe8326 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:43:12.053395 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.policy [None req-93fb5b5e-e87d-49f8-90c3-9e2c3cbe8326 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e811736979c44b02b14fecb74c6bd7ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675272fb40d4847819f83ec04afecef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129321) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:43:12.061835 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.policy [None req-93fb5b5e-e87d-49f8-90c3-9e2c3cbe8326 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e811736979c44b02b14fecb74c6bd7ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675272fb40d4847819f83ec04afecef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129321) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:43:12.063392 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.policy [None req-93fb5b5e-e87d-49f8-90c3-9e2c3cbe8326 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e811736979c44b02b14fecb74c6bd7ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675272fb40d4847819f83ec04afecef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129321) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:43:12.064649 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: INFO nova.api.openstack.requestlog [None req-93fb5b5e-e87d-49f8-90c3-9e2c3cbe8326 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] 10.222.0.75 "GET /compute/v2.1/servers/bf2f6303-22b9-4cfa-8d4d-61d2503bc554" status: 200 len: 1746 microversion: 2.20 time: 0.335549 May 26 12:43:12.065516 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: [pid: 129321|app: 0|req: 291/605] 10.222.0.75 () {60 vars in 1276 bytes} [Thu May 26 12:43:11 2022] GET /compute/v2.1/servers/bf2f6303-22b9-4cfa-8d4d-61d2503bc554 => generated 1746 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 12:43:12.114251 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi [None req-a4fc8211-c510-4b3a-b10a-5c43105df672 tempest-VolumesSnapshotTestJSON-1904508205 tempest-VolumesSnapshotTestJSON-1904508205-project] Calling method '>' {{(pid=129321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:43:12.115201 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.compute.api [None req-a4fc8211-c510-4b3a-b10a-5c43105df672 tempest-VolumesSnapshotTestJSON-1904508205 tempest-VolumesSnapshotTestJSON-1904508205-project] [instance: 6a87df93-cf49-465a-80dd-102efb0f8b11] Fetching instance by UUID {{(pid=129321) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:43:12.121569 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-a4fc8211-c510-4b3a-b10a-5c43105df672 tempest-VolumesSnapshotTestJSON-1904508205 tempest-VolumesSnapshotTestJSON-1904508205-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:43:12.122043 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-a4fc8211-c510-4b3a-b10a-5c43105df672 tempest-VolumesSnapshotTestJSON-1904508205 tempest-VolumesSnapshotTestJSON-1904508205-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:43:12.122933 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-a4fc8211-c510-4b3a-b10a-5c43105df672 tempest-VolumesSnapshotTestJSON-1904508205 tempest-VolumesSnapshotTestJSON-1904508205-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:43:12.123359 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-a4fc8211-c510-4b3a-b10a-5c43105df672 tempest-VolumesSnapshotTestJSON-1904508205 tempest-VolumesSnapshotTestJSON-1904508205-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:43:12.303206 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.policy [None req-a4fc8211-c510-4b3a-b10a-5c43105df672 tempest-VolumesSnapshotTestJSON-1904508205 tempest-VolumesSnapshotTestJSON-1904508205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '805854e5ce2e412fb9420afd63f73ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72bda4cbb07a43688506e01d06ba89c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129321) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:43:12.314963 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: INFO nova.api.openstack.requestlog [None req-a4fc8211-c510-4b3a-b10a-5c43105df672 tempest-VolumesSnapshotTestJSON-1904508205 tempest-VolumesSnapshotTestJSON-1904508205-project] 10.222.0.75 "GET /compute/v2.1/servers/6a87df93-cf49-465a-80dd-102efb0f8b11" status: 200 len: 1319 microversion: 2.1 time: 0.204308 May 26 12:43:12.315797 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: [pid: 129321|app: 0|req: 292/606] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 26 12:43:12 2022] GET /compute/v2.1/servers/6a87df93-cf49-465a-80dd-102efb0f8b11 => generated 1319 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:43:12.320263 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi [req-d6a1cb06-cc21-45bb-8cb5-6db8c7393c17 req-66332d98-5859-4c12-a988-0704dc151ccf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6a87df93-cf49-465a-80dd-102efb0f8b11", "tag": "dbacc009-79e8-4f19-b33f-318a83e21b17"}]} {{(pid=129321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 12:43:12.329194 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [req-d6a1cb06-cc21-45bb-8cb5-6db8c7393c17 req-66332d98-5859-4c12-a988-0704dc151ccf service nova] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:43:12.329746 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [req-d6a1cb06-cc21-45bb-8cb5-6db8c7393c17 req-66332d98-5859-4c12-a988-0704dc151ccf service nova] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:43:12.341715 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: INFO nova.api.openstack.compute.server_external_events [req-d6a1cb06-cc21-45bb-8cb5-6db8c7393c17 req-66332d98-5859-4c12-a988-0704dc151ccf service nova] Creating event network-changed:dbacc009-79e8-4f19-b33f-318a83e21b17 for instance 6a87df93-cf49-465a-80dd-102efb0f8b11 on hv-cinder-81966 May 26 12:43:12.346842 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: INFO nova.api.openstack.requestlog [req-d6a1cb06-cc21-45bb-8cb5-6db8c7393c17 req-66332d98-5859-4c12-a988-0704dc151ccf service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029942 May 26 12:43:12.347441 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: [pid: 129321|app: 0|req: 293/607] 10.222.0.75 () {64 vars in 1317 bytes} [Thu May 26 12:43:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 12:43:12.400374 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi [None req-2114700b-3d88-4f77-879e-3d70f2e55efb tempest-VolumesActionsTest-731506124 tempest-VolumesActionsTest-731506124-project] Calling method '>' {{(pid=129321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:43:12.401087 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.compute.api [None req-2114700b-3d88-4f77-879e-3d70f2e55efb tempest-VolumesActionsTest-731506124 tempest-VolumesActionsTest-731506124-project] [instance: 3fd057be-56c1-462d-8ea2-9ca668166ccf] Fetching instance by UUID {{(pid=129321) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:43:12.409213 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-2114700b-3d88-4f77-879e-3d70f2e55efb tempest-VolumesActionsTest-731506124 tempest-VolumesActionsTest-731506124-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:43:12.409667 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-2114700b-3d88-4f77-879e-3d70f2e55efb tempest-VolumesActionsTest-731506124 tempest-VolumesActionsTest-731506124-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:43:12.410444 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-2114700b-3d88-4f77-879e-3d70f2e55efb tempest-VolumesActionsTest-731506124 tempest-VolumesActionsTest-731506124-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:43:12.410877 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-2114700b-3d88-4f77-879e-3d70f2e55efb tempest-VolumesActionsTest-731506124 tempest-VolumesActionsTest-731506124-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:43:12.552909 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.policy [None req-2114700b-3d88-4f77-879e-3d70f2e55efb tempest-VolumesActionsTest-731506124 tempest-VolumesActionsTest-731506124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f39e076a9e6b401db6de9a2846519591', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa93879e60e470185e8dd71efaaf1a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129321) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:43:12.561219 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: INFO nova.api.openstack.requestlog [None req-2114700b-3d88-4f77-879e-3d70f2e55efb tempest-VolumesActionsTest-731506124 tempest-VolumesActionsTest-731506124-project] 10.222.0.75 "GET /compute/v2.1/servers/3fd057be-56c1-462d-8ea2-9ca668166ccf" status: 200 len: 1314 microversion: 2.1 time: 0.165811 May 26 12:43:12.561800 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: [pid: 129321|app: 0|req: 294/608] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 26 12:43:12 2022] GET /compute/v2.1/servers/3fd057be-56c1-462d-8ea2-9ca668166ccf => generated 1314 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:43:12.665209 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi [None req-766a45e0-f650-4e29-ad8a-e6cc22525b51 tempest-TestShelveInstance-546397589 tempest-TestShelveInstance-546397589-project] Calling method '>' {{(pid=129321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:43:12.666051 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.compute.api [None req-766a45e0-f650-4e29-ad8a-e6cc22525b51 tempest-TestShelveInstance-546397589 tempest-TestShelveInstance-546397589-project] [instance: 05cf529d-df00-4ff9-b0d2-0e27563d2861] Fetching instance by UUID {{(pid=129321) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:43:12.675003 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-766a45e0-f650-4e29-ad8a-e6cc22525b51 tempest-TestShelveInstance-546397589 tempest-TestShelveInstance-546397589-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:43:12.675715 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-766a45e0-f650-4e29-ad8a-e6cc22525b51 tempest-TestShelveInstance-546397589 tempest-TestShelveInstance-546397589-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:43:12.676702 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-766a45e0-f650-4e29-ad8a-e6cc22525b51 tempest-TestShelveInstance-546397589 tempest-TestShelveInstance-546397589-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:43:12.677436 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-766a45e0-f650-4e29-ad8a-e6cc22525b51 tempest-TestShelveInstance-546397589 tempest-TestShelveInstance-546397589-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:43:12.812370 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.policy [None req-766a45e0-f650-4e29-ad8a-e6cc22525b51 tempest-TestShelveInstance-546397589 tempest-TestShelveInstance-546397589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d9bf2dcfce24386a1aaf9709d88da45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1f2f503ef674a4b97f848b69f8b63c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129321) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:43:12.820180 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: INFO nova.api.openstack.requestlog [None req-766a45e0-f650-4e29-ad8a-e6cc22525b51 tempest-TestShelveInstance-546397589 tempest-TestShelveInstance-546397589-project] 10.222.0.75 "GET /compute/v2.1/servers/05cf529d-df00-4ff9-b0d2-0e27563d2861" status: 200 len: 1259 microversion: 2.1 time: 0.160830 May 26 12:43:12.820731 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: [pid: 129321|app: 0|req: 295/609] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 26 12:43:12 2022] GET /compute/v2.1/servers/05cf529d-df00-4ff9-b0d2-0e27563d2861 => generated 1259 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:43:13.083843 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi [None req-9594e65a-5ffa-4072-9c0e-3bce49863d74 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Calling method '>' {{(pid=129321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:43:13.084514 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.compute.api [None req-9594e65a-5ffa-4072-9c0e-3bce49863d74 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] [instance: bf2f6303-22b9-4cfa-8d4d-61d2503bc554] Fetching instance by UUID {{(pid=129321) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:43:13.091521 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-9594e65a-5ffa-4072-9c0e-3bce49863d74 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:43:13.091986 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-9594e65a-5ffa-4072-9c0e-3bce49863d74 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:43:13.092752 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-9594e65a-5ffa-4072-9c0e-3bce49863d74 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:43:13.093176 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-9594e65a-5ffa-4072-9c0e-3bce49863d74 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:43:13.246031 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.policy [None req-9594e65a-5ffa-4072-9c0e-3bce49863d74 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e811736979c44b02b14fecb74c6bd7ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675272fb40d4847819f83ec04afecef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129321) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:43:13.257818 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.policy [None req-9594e65a-5ffa-4072-9c0e-3bce49863d74 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e811736979c44b02b14fecb74c6bd7ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675272fb40d4847819f83ec04afecef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129321) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:43:13.259453 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.policy [None req-9594e65a-5ffa-4072-9c0e-3bce49863d74 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e811736979c44b02b14fecb74c6bd7ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675272fb40d4847819f83ec04afecef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129321) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:43:13.260881 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: INFO nova.api.openstack.requestlog [None req-9594e65a-5ffa-4072-9c0e-3bce49863d74 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] 10.222.0.75 "GET /compute/v2.1/servers/bf2f6303-22b9-4cfa-8d4d-61d2503bc554" status: 200 len: 1746 microversion: 2.20 time: 0.181304 May 26 12:43:13.261509 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: [pid: 129321|app: 0|req: 296/610] 10.222.0.75 () {60 vars in 1276 bytes} [Thu May 26 12:43:13 2022] GET /compute/v2.1/servers/bf2f6303-22b9-4cfa-8d4d-61d2503bc554 => generated 1746 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 12:43:13.332641 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi [None req-5565a0ae-eb60-4bbd-bad2-431315c1ab63 tempest-VolumesSnapshotTestJSON-1904508205 tempest-VolumesSnapshotTestJSON-1904508205-project] Calling method '>' {{(pid=129321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:43:13.333251 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.compute.api [None req-5565a0ae-eb60-4bbd-bad2-431315c1ab63 tempest-VolumesSnapshotTestJSON-1904508205 tempest-VolumesSnapshotTestJSON-1904508205-project] [instance: 6a87df93-cf49-465a-80dd-102efb0f8b11] Fetching instance by UUID {{(pid=129321) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:43:13.339780 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-5565a0ae-eb60-4bbd-bad2-431315c1ab63 tempest-VolumesSnapshotTestJSON-1904508205 tempest-VolumesSnapshotTestJSON-1904508205-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:43:13.340173 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-5565a0ae-eb60-4bbd-bad2-431315c1ab63 tempest-VolumesSnapshotTestJSON-1904508205 tempest-VolumesSnapshotTestJSON-1904508205-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:43:13.340937 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-5565a0ae-eb60-4bbd-bad2-431315c1ab63 tempest-VolumesSnapshotTestJSON-1904508205 tempest-VolumesSnapshotTestJSON-1904508205-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:43:13.341724 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-5565a0ae-eb60-4bbd-bad2-431315c1ab63 tempest-VolumesSnapshotTestJSON-1904508205 tempest-VolumesSnapshotTestJSON-1904508205-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:43:13.429768 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: INFO nova.api.openstack.requestlog [None req-28fb2e59-bb0e-462b-8ab2-17864cd280e5 tempest-TestMinimumBasicScenario-102576986 tempest-TestMinimumBasicScenario-102576986-project] 10.222.0.75 "POST /compute/v2.1/servers/76661008-e6d3-4646-a9ba-d5d0e83a4b65/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 3.044910 May 26 12:43:13.435579 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: [pid: 129322|app: 0|req: 315/611] 10.222.0.75 () {60 vars in 1322 bytes} [Thu May 26 12:43:10 2022] POST /compute/v2.1/servers/76661008-e6d3-4646-a9ba-d5d0e83a4b65/os-volume_attachments => generated 194 bytes in 3048 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 12:43:13.580417 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi [None req-fe8eb56c-ad2c-44ce-96cc-1cea63374f58 tempest-VolumesActionsTest-731506124 tempest-VolumesActionsTest-731506124-project] Calling method '>' {{(pid=129322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:43:13.581372 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.compute.api [None req-fe8eb56c-ad2c-44ce-96cc-1cea63374f58 tempest-VolumesActionsTest-731506124 tempest-VolumesActionsTest-731506124-project] [instance: 3fd057be-56c1-462d-8ea2-9ca668166ccf] Fetching instance by UUID {{(pid=129322) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:43:13.589085 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-fe8eb56c-ad2c-44ce-96cc-1cea63374f58 tempest-VolumesActionsTest-731506124 tempest-VolumesActionsTest-731506124-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:43:13.589841 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-fe8eb56c-ad2c-44ce-96cc-1cea63374f58 tempest-VolumesActionsTest-731506124 tempest-VolumesActionsTest-731506124-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:43:13.590634 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-fe8eb56c-ad2c-44ce-96cc-1cea63374f58 tempest-VolumesActionsTest-731506124 tempest-VolumesActionsTest-731506124-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:43:13.591072 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-fe8eb56c-ad2c-44ce-96cc-1cea63374f58 tempest-VolumesActionsTest-731506124 tempest-VolumesActionsTest-731506124-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:43:13.758367 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.policy [None req-fe8eb56c-ad2c-44ce-96cc-1cea63374f58 tempest-VolumesActionsTest-731506124 tempest-VolumesActionsTest-731506124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f39e076a9e6b401db6de9a2846519591', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa93879e60e470185e8dd71efaaf1a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129322) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:43:13.769591 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: INFO nova.api.openstack.requestlog [None req-fe8eb56c-ad2c-44ce-96cc-1cea63374f58 tempest-VolumesActionsTest-731506124 tempest-VolumesActionsTest-731506124-project] 10.222.0.75 "GET /compute/v2.1/servers/3fd057be-56c1-462d-8ea2-9ca668166ccf" status: 200 len: 1314 microversion: 2.1 time: 0.194343 May 26 12:43:13.778301 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: [pid: 129322|app: 0|req: 316/612] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 26 12:43:13 2022] GET /compute/v2.1/servers/3fd057be-56c1-462d-8ea2-9ca668166ccf => generated 1314 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 12:43:13.839639 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi [None req-bd99bb90-fa4f-4054-a934-2a59aaf85fc9 tempest-TestShelveInstance-546397589 tempest-TestShelveInstance-546397589-project] Calling method '>' {{(pid=129322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:43:13.840581 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.compute.api [None req-bd99bb90-fa4f-4054-a934-2a59aaf85fc9 tempest-TestShelveInstance-546397589 tempest-TestShelveInstance-546397589-project] [instance: 05cf529d-df00-4ff9-b0d2-0e27563d2861] Fetching instance by UUID {{(pid=129322) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:43:13.849444 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-bd99bb90-fa4f-4054-a934-2a59aaf85fc9 tempest-TestShelveInstance-546397589 tempest-TestShelveInstance-546397589-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:43:13.850464 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-bd99bb90-fa4f-4054-a934-2a59aaf85fc9 tempest-TestShelveInstance-546397589 tempest-TestShelveInstance-546397589-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:43:13.852138 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-bd99bb90-fa4f-4054-a934-2a59aaf85fc9 tempest-TestShelveInstance-546397589 tempest-TestShelveInstance-546397589-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:43:13.852826 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-bd99bb90-fa4f-4054-a934-2a59aaf85fc9 tempest-TestShelveInstance-546397589 tempest-TestShelveInstance-546397589-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:43:13.897322 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.policy [None req-5565a0ae-eb60-4bbd-bad2-431315c1ab63 tempest-VolumesSnapshotTestJSON-1904508205 tempest-VolumesSnapshotTestJSON-1904508205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '805854e5ce2e412fb9420afd63f73ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72bda4cbb07a43688506e01d06ba89c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129321) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:43:13.916252 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: INFO nova.api.openstack.requestlog [None req-5565a0ae-eb60-4bbd-bad2-431315c1ab63 tempest-VolumesSnapshotTestJSON-1904508205 tempest-VolumesSnapshotTestJSON-1904508205-project] 10.222.0.75 "GET /compute/v2.1/servers/6a87df93-cf49-465a-80dd-102efb0f8b11" status: 200 len: 1319 microversion: 2.1 time: 0.587743 May 26 12:43:13.916851 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: [pid: 129321|app: 0|req: 297/613] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 26 12:43:13 2022] GET /compute/v2.1/servers/6a87df93-cf49-465a-80dd-102efb0f8b11 => generated 1319 bytes in 589 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 12:43:14.039441 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.policy [None req-bd99bb90-fa4f-4054-a934-2a59aaf85fc9 tempest-TestShelveInstance-546397589 tempest-TestShelveInstance-546397589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d9bf2dcfce24386a1aaf9709d88da45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1f2f503ef674a4b97f848b69f8b63c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129322) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:43:14.042970 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG dbcounter [-] [129322] Writing DB stats nova_cell0:SELECT=8 {{(pid=129322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:43:14.060739 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: INFO nova.api.openstack.requestlog [None req-bd99bb90-fa4f-4054-a934-2a59aaf85fc9 tempest-TestShelveInstance-546397589 tempest-TestShelveInstance-546397589-project] 10.222.0.75 "GET /compute/v2.1/servers/05cf529d-df00-4ff9-b0d2-0e27563d2861" status: 200 len: 1259 microversion: 2.1 time: 0.223276 May 26 12:43:14.062259 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: [pid: 129322|app: 0|req: 317/614] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 26 12:43:13 2022] GET /compute/v2.1/servers/05cf529d-df00-4ff9-b0d2-0e27563d2861 => generated 1259 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 12:43:14.283101 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi [None req-9b09cbff-2bf0-4b9b-b263-3b86fa59d122 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Calling method '>' {{(pid=129321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:43:14.284453 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.compute.api [None req-9b09cbff-2bf0-4b9b-b263-3b86fa59d122 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] [instance: bf2f6303-22b9-4cfa-8d4d-61d2503bc554] Fetching instance by UUID {{(pid=129321) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:43:14.292358 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-9b09cbff-2bf0-4b9b-b263-3b86fa59d122 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:43:14.293184 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-9b09cbff-2bf0-4b9b-b263-3b86fa59d122 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:43:14.294348 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-9b09cbff-2bf0-4b9b-b263-3b86fa59d122 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:43:14.295100 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-9b09cbff-2bf0-4b9b-b263-3b86fa59d122 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:43:14.743480 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.policy [None req-9b09cbff-2bf0-4b9b-b263-3b86fa59d122 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e811736979c44b02b14fecb74c6bd7ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675272fb40d4847819f83ec04afecef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129321) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:43:14.782006 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.policy [None req-9b09cbff-2bf0-4b9b-b263-3b86fa59d122 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e811736979c44b02b14fecb74c6bd7ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675272fb40d4847819f83ec04afecef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129321) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:43:14.783700 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.policy [None req-9b09cbff-2bf0-4b9b-b263-3b86fa59d122 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e811736979c44b02b14fecb74c6bd7ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675272fb40d4847819f83ec04afecef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129321) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:43:14.785082 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: INFO nova.api.openstack.requestlog [None req-9b09cbff-2bf0-4b9b-b263-3b86fa59d122 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] 10.222.0.75 "GET /compute/v2.1/servers/bf2f6303-22b9-4cfa-8d4d-61d2503bc554" status: 200 len: 1741 microversion: 2.20 time: 0.508796 May 26 12:43:14.785521 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: [pid: 129321|app: 0|req: 298/615] 10.222.0.75 () {60 vars in 1276 bytes} [Thu May 26 12:43:14 2022] GET /compute/v2.1/servers/bf2f6303-22b9-4cfa-8d4d-61d2503bc554 => generated 1741 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 12:43:14.804553 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi [None req-b2eafdcc-ca4f-4da7-a0b5-a24e40f2e2f7 tempest-VolumesActionsTest-731506124 tempest-VolumesActionsTest-731506124-project] Calling method '>' {{(pid=129322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:43:14.805808 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.compute.api [None req-b2eafdcc-ca4f-4da7-a0b5-a24e40f2e2f7 tempest-VolumesActionsTest-731506124 tempest-VolumesActionsTest-731506124-project] [instance: 3fd057be-56c1-462d-8ea2-9ca668166ccf] Fetching instance by UUID {{(pid=129322) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:43:14.815836 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-b2eafdcc-ca4f-4da7-a0b5-a24e40f2e2f7 tempest-VolumesActionsTest-731506124 tempest-VolumesActionsTest-731506124-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:43:14.816280 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-b2eafdcc-ca4f-4da7-a0b5-a24e40f2e2f7 tempest-VolumesActionsTest-731506124 tempest-VolumesActionsTest-731506124-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:43:14.817050 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-b2eafdcc-ca4f-4da7-a0b5-a24e40f2e2f7 tempest-VolumesActionsTest-731506124 tempest-VolumesActionsTest-731506124-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:43:14.817479 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-b2eafdcc-ca4f-4da7-a0b5-a24e40f2e2f7 tempest-VolumesActionsTest-731506124 tempest-VolumesActionsTest-731506124-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:43:14.945334 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi [None req-bef1edf4-f97e-4d43-a873-516768de734b tempest-VolumesSnapshotTestJSON-1904508205 tempest-VolumesSnapshotTestJSON-1904508205-project] Calling method '>' {{(pid=129321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:43:14.950930 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.compute.api [None req-bef1edf4-f97e-4d43-a873-516768de734b tempest-VolumesSnapshotTestJSON-1904508205 tempest-VolumesSnapshotTestJSON-1904508205-project] [instance: 6a87df93-cf49-465a-80dd-102efb0f8b11] Fetching instance by UUID {{(pid=129321) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:43:14.976512 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-bef1edf4-f97e-4d43-a873-516768de734b tempest-VolumesSnapshotTestJSON-1904508205 tempest-VolumesSnapshotTestJSON-1904508205-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:43:14.985243 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-bef1edf4-f97e-4d43-a873-516768de734b tempest-VolumesSnapshotTestJSON-1904508205 tempest-VolumesSnapshotTestJSON-1904508205-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:43:14.987913 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-bef1edf4-f97e-4d43-a873-516768de734b tempest-VolumesSnapshotTestJSON-1904508205 tempest-VolumesSnapshotTestJSON-1904508205-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:43:14.992327 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-bef1edf4-f97e-4d43-a873-516768de734b tempest-VolumesSnapshotTestJSON-1904508205 tempest-VolumesSnapshotTestJSON-1904508205-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:43:15.001425 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG dbcounter [-] [129321] Writing DB stats nova_cell1:SELECT=100 {{(pid=129321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:43:15.067504 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.policy [None req-b2eafdcc-ca4f-4da7-a0b5-a24e40f2e2f7 tempest-VolumesActionsTest-731506124 tempest-VolumesActionsTest-731506124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f39e076a9e6b401db6de9a2846519591', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa93879e60e470185e8dd71efaaf1a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129322) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:43:15.078182 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: INFO nova.api.openstack.requestlog [None req-b2eafdcc-ca4f-4da7-a0b5-a24e40f2e2f7 tempest-VolumesActionsTest-731506124 tempest-VolumesActionsTest-731506124-project] 10.222.0.75 "GET /compute/v2.1/servers/3fd057be-56c1-462d-8ea2-9ca668166ccf" status: 200 len: 1314 microversion: 2.1 time: 0.278640 May 26 12:43:15.079654 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: [pid: 129322|app: 0|req: 318/616] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 26 12:43:14 2022] GET /compute/v2.1/servers/3fd057be-56c1-462d-8ea2-9ca668166ccf => generated 1314 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:43:15.085569 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi [None req-536c1920-b155-464c-b843-ccc69cb8e00e tempest-TestShelveInstance-546397589 tempest-TestShelveInstance-546397589-project] Calling method '>' {{(pid=129322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:43:15.086512 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.compute.api [None req-536c1920-b155-464c-b843-ccc69cb8e00e tempest-TestShelveInstance-546397589 tempest-TestShelveInstance-546397589-project] [instance: 05cf529d-df00-4ff9-b0d2-0e27563d2861] Fetching instance by UUID {{(pid=129322) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:43:15.094498 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-536c1920-b155-464c-b843-ccc69cb8e00e tempest-TestShelveInstance-546397589 tempest-TestShelveInstance-546397589-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:43:15.095135 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-536c1920-b155-464c-b843-ccc69cb8e00e tempest-TestShelveInstance-546397589 tempest-TestShelveInstance-546397589-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:43:15.096420 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-536c1920-b155-464c-b843-ccc69cb8e00e tempest-TestShelveInstance-546397589 tempest-TestShelveInstance-546397589-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:43:15.097049 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-536c1920-b155-464c-b843-ccc69cb8e00e tempest-TestShelveInstance-546397589 tempest-TestShelveInstance-546397589-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:43:15.281605 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.policy [None req-536c1920-b155-464c-b843-ccc69cb8e00e tempest-TestShelveInstance-546397589 tempest-TestShelveInstance-546397589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d9bf2dcfce24386a1aaf9709d88da45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1f2f503ef674a4b97f848b69f8b63c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129322) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:43:15.292923 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: INFO nova.api.openstack.requestlog [None req-536c1920-b155-464c-b843-ccc69cb8e00e tempest-TestShelveInstance-546397589 tempest-TestShelveInstance-546397589-project] 10.222.0.75 "GET /compute/v2.1/servers/05cf529d-df00-4ff9-b0d2-0e27563d2861" status: 200 len: 1259 microversion: 2.1 time: 0.211762 May 26 12:43:15.304122 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: [pid: 129322|app: 0|req: 319/617] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 26 12:43:15 2022] GET /compute/v2.1/servers/05cf529d-df00-4ff9-b0d2-0e27563d2861 => generated 1259 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:43:15.304122 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi [req-5de893d8-5a29-499d-b7d2-eb478bb41f2d req-a4a20729-6293-46d1-9128-56b90c9c956f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3fd057be-56c1-462d-8ea2-9ca668166ccf", "name": "network-vif-plugged", "status": "completed", "tag": "fb8f79ae-b609-4e5d-bbcf-2886fb227ed9"}]} {{(pid=129322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 12:43:15.310813 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [req-5de893d8-5a29-499d-b7d2-eb478bb41f2d req-a4a20729-6293-46d1-9128-56b90c9c956f service nova] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:43:15.311338 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [req-5de893d8-5a29-499d-b7d2-eb478bb41f2d req-a4a20729-6293-46d1-9128-56b90c9c956f service nova] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:43:15.324901 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: INFO nova.api.openstack.compute.server_external_events [req-5de893d8-5a29-499d-b7d2-eb478bb41f2d req-a4a20729-6293-46d1-9128-56b90c9c956f service nova] Creating event network-vif-plugged:fb8f79ae-b609-4e5d-bbcf-2886fb227ed9 for instance 3fd057be-56c1-462d-8ea2-9ca668166ccf on hv-cinder-81966 May 26 12:43:15.330852 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: INFO nova.api.openstack.requestlog [req-5de893d8-5a29-499d-b7d2-eb478bb41f2d req-a4a20729-6293-46d1-9128-56b90c9c956f service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035337 May 26 12:43:15.332032 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: [pid: 129322|app: 0|req: 320/618] 10.222.0.75 () {64 vars in 1317 bytes} [Thu May 26 12:43:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 12:43:15.337969 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.policy [None req-bef1edf4-f97e-4d43-a873-516768de734b tempest-VolumesSnapshotTestJSON-1904508205 tempest-VolumesSnapshotTestJSON-1904508205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '805854e5ce2e412fb9420afd63f73ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72bda4cbb07a43688506e01d06ba89c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129321) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:43:15.351130 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: INFO nova.api.openstack.requestlog [None req-bef1edf4-f97e-4d43-a873-516768de734b tempest-VolumesSnapshotTestJSON-1904508205 tempest-VolumesSnapshotTestJSON-1904508205-project] 10.222.0.75 "GET /compute/v2.1/servers/6a87df93-cf49-465a-80dd-102efb0f8b11" status: 200 len: 1319 microversion: 2.1 time: 0.421436 May 26 12:43:15.351925 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: [pid: 129321|app: 0|req: 299/619] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 26 12:43:14 2022] GET /compute/v2.1/servers/6a87df93-cf49-465a-80dd-102efb0f8b11 => generated 1319 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:43:15.808181 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi [None req-0b623218-8451-4210-9553-5193e1381385 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Calling method '>' {{(pid=129322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:43:15.809451 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.compute.api [None req-0b623218-8451-4210-9553-5193e1381385 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] [instance: bf2f6303-22b9-4cfa-8d4d-61d2503bc554] Fetching instance by UUID {{(pid=129322) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:43:15.822004 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-0b623218-8451-4210-9553-5193e1381385 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:43:15.822765 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-0b623218-8451-4210-9553-5193e1381385 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:43:15.824048 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-0b623218-8451-4210-9553-5193e1381385 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:43:15.824909 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-0b623218-8451-4210-9553-5193e1381385 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:43:16.048756 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.policy [None req-0b623218-8451-4210-9553-5193e1381385 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e811736979c44b02b14fecb74c6bd7ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675272fb40d4847819f83ec04afecef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129322) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:43:16.067809 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.policy [None req-0b623218-8451-4210-9553-5193e1381385 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e811736979c44b02b14fecb74c6bd7ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675272fb40d4847819f83ec04afecef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129322) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:43:16.071214 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.policy [None req-0b623218-8451-4210-9553-5193e1381385 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e811736979c44b02b14fecb74c6bd7ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675272fb40d4847819f83ec04afecef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129322) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:43:16.073543 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: INFO nova.api.openstack.requestlog [None req-0b623218-8451-4210-9553-5193e1381385 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] 10.222.0.75 "GET /compute/v2.1/servers/bf2f6303-22b9-4cfa-8d4d-61d2503bc554" status: 200 len: 1741 microversion: 2.20 time: 0.271165 May 26 12:43:16.075408 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: [pid: 129322|app: 0|req: 321/620] 10.222.0.75 () {60 vars in 1276 bytes} [Thu May 26 12:43:15 2022] GET /compute/v2.1/servers/bf2f6303-22b9-4cfa-8d4d-61d2503bc554 => generated 1741 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 12:43:16.100227 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi [None req-0332b864-ec85-4b5d-9f46-040d6e4da317 tempest-VolumesActionsTest-731506124 tempest-VolumesActionsTest-731506124-project] Calling method '>' {{(pid=129321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:43:16.101830 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.compute.api [None req-0332b864-ec85-4b5d-9f46-040d6e4da317 tempest-VolumesActionsTest-731506124 tempest-VolumesActionsTest-731506124-project] [instance: 3fd057be-56c1-462d-8ea2-9ca668166ccf] Fetching instance by UUID {{(pid=129321) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:43:16.114382 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-0332b864-ec85-4b5d-9f46-040d6e4da317 tempest-VolumesActionsTest-731506124 tempest-VolumesActionsTest-731506124-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:43:16.115801 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-0332b864-ec85-4b5d-9f46-040d6e4da317 tempest-VolumesActionsTest-731506124 tempest-VolumesActionsTest-731506124-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:43:16.117570 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-0332b864-ec85-4b5d-9f46-040d6e4da317 tempest-VolumesActionsTest-731506124 tempest-VolumesActionsTest-731506124-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:43:16.118949 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-0332b864-ec85-4b5d-9f46-040d6e4da317 tempest-VolumesActionsTest-731506124 tempest-VolumesActionsTest-731506124-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:43:16.313402 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi [None req-adab9dae-038c-45e3-a9a9-8a12196dc67c tempest-TestShelveInstance-546397589 tempest-TestShelveInstance-546397589-project] Calling method '>' {{(pid=129322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:43:16.314091 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.compute.api [None req-adab9dae-038c-45e3-a9a9-8a12196dc67c tempest-TestShelveInstance-546397589 tempest-TestShelveInstance-546397589-project] [instance: 05cf529d-df00-4ff9-b0d2-0e27563d2861] Fetching instance by UUID {{(pid=129322) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:43:16.326584 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-adab9dae-038c-45e3-a9a9-8a12196dc67c tempest-TestShelveInstance-546397589 tempest-TestShelveInstance-546397589-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:43:16.329833 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-adab9dae-038c-45e3-a9a9-8a12196dc67c tempest-TestShelveInstance-546397589 tempest-TestShelveInstance-546397589-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:43:16.330806 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-adab9dae-038c-45e3-a9a9-8a12196dc67c tempest-TestShelveInstance-546397589 tempest-TestShelveInstance-546397589-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:43:16.331415 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-adab9dae-038c-45e3-a9a9-8a12196dc67c tempest-TestShelveInstance-546397589 tempest-TestShelveInstance-546397589-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:43:16.427005 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.policy [None req-0332b864-ec85-4b5d-9f46-040d6e4da317 tempest-VolumesActionsTest-731506124 tempest-VolumesActionsTest-731506124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f39e076a9e6b401db6de9a2846519591', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa93879e60e470185e8dd71efaaf1a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129321) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:43:16.448298 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: INFO nova.api.openstack.requestlog [None req-0332b864-ec85-4b5d-9f46-040d6e4da317 tempest-VolumesActionsTest-731506124 tempest-VolumesActionsTest-731506124-project] 10.222.0.75 "GET /compute/v2.1/servers/3fd057be-56c1-462d-8ea2-9ca668166ccf" status: 200 len: 1314 microversion: 2.1 time: 0.353028 May 26 12:43:16.449861 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: [pid: 129321|app: 0|req: 300/621] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 26 12:43:16 2022] GET /compute/v2.1/servers/3fd057be-56c1-462d-8ea2-9ca668166ccf => generated 1314 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:43:16.461340 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi [None req-18885898-b27c-4451-8d26-dc78063a6389 tempest-VolumesSnapshotTestJSON-1904508205 tempest-VolumesSnapshotTestJSON-1904508205-project] Calling method '>' {{(pid=129321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:43:16.461956 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.compute.api [None req-18885898-b27c-4451-8d26-dc78063a6389 tempest-VolumesSnapshotTestJSON-1904508205 tempest-VolumesSnapshotTestJSON-1904508205-project] [instance: 6a87df93-cf49-465a-80dd-102efb0f8b11] Fetching instance by UUID {{(pid=129321) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:43:16.478404 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-18885898-b27c-4451-8d26-dc78063a6389 tempest-VolumesSnapshotTestJSON-1904508205 tempest-VolumesSnapshotTestJSON-1904508205-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:43:16.478996 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-18885898-b27c-4451-8d26-dc78063a6389 tempest-VolumesSnapshotTestJSON-1904508205 tempest-VolumesSnapshotTestJSON-1904508205-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:43:16.480056 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-18885898-b27c-4451-8d26-dc78063a6389 tempest-VolumesSnapshotTestJSON-1904508205 tempest-VolumesSnapshotTestJSON-1904508205-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:43:16.480727 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-18885898-b27c-4451-8d26-dc78063a6389 tempest-VolumesSnapshotTestJSON-1904508205 tempest-VolumesSnapshotTestJSON-1904508205-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:43:16.566205 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.policy [None req-adab9dae-038c-45e3-a9a9-8a12196dc67c tempest-TestShelveInstance-546397589 tempest-TestShelveInstance-546397589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d9bf2dcfce24386a1aaf9709d88da45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1f2f503ef674a4b97f848b69f8b63c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129322) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:43:16.584396 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: INFO nova.api.openstack.requestlog [None req-adab9dae-038c-45e3-a9a9-8a12196dc67c tempest-TestShelveInstance-546397589 tempest-TestShelveInstance-546397589-project] 10.222.0.75 "GET /compute/v2.1/servers/05cf529d-df00-4ff9-b0d2-0e27563d2861" status: 200 len: 1259 microversion: 2.1 time: 0.274985 May 26 12:43:16.585784 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: [pid: 129322|app: 0|req: 322/622] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 26 12:43:16 2022] GET /compute/v2.1/servers/05cf529d-df00-4ff9-b0d2-0e27563d2861 => generated 1259 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:43:16.700333 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.policy [None req-18885898-b27c-4451-8d26-dc78063a6389 tempest-VolumesSnapshotTestJSON-1904508205 tempest-VolumesSnapshotTestJSON-1904508205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '805854e5ce2e412fb9420afd63f73ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72bda4cbb07a43688506e01d06ba89c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129321) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:43:16.712997 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: INFO nova.api.openstack.requestlog [None req-18885898-b27c-4451-8d26-dc78063a6389 tempest-VolumesSnapshotTestJSON-1904508205 tempest-VolumesSnapshotTestJSON-1904508205-project] 10.222.0.75 "GET /compute/v2.1/servers/6a87df93-cf49-465a-80dd-102efb0f8b11" status: 200 len: 1319 microversion: 2.1 time: 0.259670 May 26 12:43:16.723256 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: [pid: 129321|app: 0|req: 301/623] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 26 12:43:16 2022] GET /compute/v2.1/servers/6a87df93-cf49-465a-80dd-102efb0f8b11 => generated 1319 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:43:17.102212 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi [None req-d0d7bdf6-9df9-448d-a10b-fc465f261901 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Calling method '>' {{(pid=129322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:43:17.103077 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.compute.api [None req-d0d7bdf6-9df9-448d-a10b-fc465f261901 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] [instance: bf2f6303-22b9-4cfa-8d4d-61d2503bc554] Fetching instance by UUID {{(pid=129322) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:43:17.117700 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-d0d7bdf6-9df9-448d-a10b-fc465f261901 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:43:17.120566 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-d0d7bdf6-9df9-448d-a10b-fc465f261901 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:43:17.123162 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-d0d7bdf6-9df9-448d-a10b-fc465f261901 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:43:17.123162 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-d0d7bdf6-9df9-448d-a10b-fc465f261901 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:43:17.348842 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.policy [None req-d0d7bdf6-9df9-448d-a10b-fc465f261901 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e811736979c44b02b14fecb74c6bd7ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675272fb40d4847819f83ec04afecef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129322) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:43:17.362004 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.policy [None req-d0d7bdf6-9df9-448d-a10b-fc465f261901 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e811736979c44b02b14fecb74c6bd7ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675272fb40d4847819f83ec04afecef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129322) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:43:17.364293 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.policy [None req-d0d7bdf6-9df9-448d-a10b-fc465f261901 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e811736979c44b02b14fecb74c6bd7ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675272fb40d4847819f83ec04afecef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129322) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:43:17.365719 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: INFO nova.api.openstack.requestlog [None req-d0d7bdf6-9df9-448d-a10b-fc465f261901 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] 10.222.0.75 "GET /compute/v2.1/servers/bf2f6303-22b9-4cfa-8d4d-61d2503bc554" status: 200 len: 1741 microversion: 2.20 time: 0.268376 May 26 12:43:17.366401 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: [pid: 129322|app: 0|req: 323/624] 10.222.0.75 () {60 vars in 1276 bytes} [Thu May 26 12:43:17 2022] GET /compute/v2.1/servers/bf2f6303-22b9-4cfa-8d4d-61d2503bc554 => generated 1741 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 12:43:17.469985 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi [None req-7a32bdb7-d5d3-48fe-b68b-d4e6d6f6de53 tempest-VolumesActionsTest-731506124 tempest-VolumesActionsTest-731506124-project] Calling method '>' {{(pid=129321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:43:17.470648 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.compute.api [None req-7a32bdb7-d5d3-48fe-b68b-d4e6d6f6de53 tempest-VolumesActionsTest-731506124 tempest-VolumesActionsTest-731506124-project] [instance: 3fd057be-56c1-462d-8ea2-9ca668166ccf] Fetching instance by UUID {{(pid=129321) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:43:17.480522 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-7a32bdb7-d5d3-48fe-b68b-d4e6d6f6de53 tempest-VolumesActionsTest-731506124 tempest-VolumesActionsTest-731506124-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:43:17.481285 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-7a32bdb7-d5d3-48fe-b68b-d4e6d6f6de53 tempest-VolumesActionsTest-731506124 tempest-VolumesActionsTest-731506124-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:43:17.482630 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-7a32bdb7-d5d3-48fe-b68b-d4e6d6f6de53 tempest-VolumesActionsTest-731506124 tempest-VolumesActionsTest-731506124-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:43:17.484153 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-7a32bdb7-d5d3-48fe-b68b-d4e6d6f6de53 tempest-VolumesActionsTest-731506124 tempest-VolumesActionsTest-731506124-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:43:17.603278 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi [None req-471c9919-c3bb-4add-a3e6-bec93da096c7 tempest-TestShelveInstance-546397589 tempest-TestShelveInstance-546397589-project] Calling method '>' {{(pid=129322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:43:17.603278 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.compute.api [None req-471c9919-c3bb-4add-a3e6-bec93da096c7 tempest-TestShelveInstance-546397589 tempest-TestShelveInstance-546397589-project] [instance: 05cf529d-df00-4ff9-b0d2-0e27563d2861] Fetching instance by UUID {{(pid=129322) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:43:17.608676 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG dbcounter [-] [129322] Writing DB stats nova_cell0:SELECT=4 {{(pid=129322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:43:17.611354 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-471c9919-c3bb-4add-a3e6-bec93da096c7 tempest-TestShelveInstance-546397589 tempest-TestShelveInstance-546397589-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:43:17.611951 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-471c9919-c3bb-4add-a3e6-bec93da096c7 tempest-TestShelveInstance-546397589 tempest-TestShelveInstance-546397589-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:43:17.612979 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-471c9919-c3bb-4add-a3e6-bec93da096c7 tempest-TestShelveInstance-546397589 tempest-TestShelveInstance-546397589-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:43:17.613623 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-471c9919-c3bb-4add-a3e6-bec93da096c7 tempest-TestShelveInstance-546397589 tempest-TestShelveInstance-546397589-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:43:17.651058 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.policy [None req-7a32bdb7-d5d3-48fe-b68b-d4e6d6f6de53 tempest-VolumesActionsTest-731506124 tempest-VolumesActionsTest-731506124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f39e076a9e6b401db6de9a2846519591', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa93879e60e470185e8dd71efaaf1a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129321) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:43:17.660409 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: INFO nova.api.openstack.requestlog [None req-7a32bdb7-d5d3-48fe-b68b-d4e6d6f6de53 tempest-VolumesActionsTest-731506124 tempest-VolumesActionsTest-731506124-project] 10.222.0.75 "GET /compute/v2.1/servers/3fd057be-56c1-462d-8ea2-9ca668166ccf" status: 200 len: 1314 microversion: 2.1 time: 0.195707 May 26 12:43:17.663574 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: [pid: 129321|app: 0|req: 302/625] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 26 12:43:17 2022] GET /compute/v2.1/servers/3fd057be-56c1-462d-8ea2-9ca668166ccf => generated 1314 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:43:17.733169 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi [None req-3a1a4924-aa2b-4aab-82f3-d087437953e2 tempest-VolumesSnapshotTestJSON-1904508205 tempest-VolumesSnapshotTestJSON-1904508205-project] Calling method '>' {{(pid=129321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:43:17.734574 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.compute.api [None req-3a1a4924-aa2b-4aab-82f3-d087437953e2 tempest-VolumesSnapshotTestJSON-1904508205 tempest-VolumesSnapshotTestJSON-1904508205-project] [instance: 6a87df93-cf49-465a-80dd-102efb0f8b11] Fetching instance by UUID {{(pid=129321) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:43:17.743524 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-3a1a4924-aa2b-4aab-82f3-d087437953e2 tempest-VolumesSnapshotTestJSON-1904508205 tempest-VolumesSnapshotTestJSON-1904508205-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:43:17.744285 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-3a1a4924-aa2b-4aab-82f3-d087437953e2 tempest-VolumesSnapshotTestJSON-1904508205 tempest-VolumesSnapshotTestJSON-1904508205-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:43:17.745052 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-3a1a4924-aa2b-4aab-82f3-d087437953e2 tempest-VolumesSnapshotTestJSON-1904508205 tempest-VolumesSnapshotTestJSON-1904508205-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:43:17.745623 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-3a1a4924-aa2b-4aab-82f3-d087437953e2 tempest-VolumesSnapshotTestJSON-1904508205 tempest-VolumesSnapshotTestJSON-1904508205-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:43:17.808418 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.policy [None req-471c9919-c3bb-4add-a3e6-bec93da096c7 tempest-TestShelveInstance-546397589 tempest-TestShelveInstance-546397589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d9bf2dcfce24386a1aaf9709d88da45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1f2f503ef674a4b97f848b69f8b63c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129322) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:43:17.824377 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: INFO nova.api.openstack.requestlog [None req-471c9919-c3bb-4add-a3e6-bec93da096c7 tempest-TestShelveInstance-546397589 tempest-TestShelveInstance-546397589-project] 10.222.0.75 "GET /compute/v2.1/servers/05cf529d-df00-4ff9-b0d2-0e27563d2861" status: 200 len: 1259 microversion: 2.1 time: 0.225945 May 26 12:43:17.835361 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: [pid: 129322|app: 0|req: 324/626] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 26 12:43:17 2022] GET /compute/v2.1/servers/05cf529d-df00-4ff9-b0d2-0e27563d2861 => generated 1259 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 12:43:17.969375 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.policy [None req-3a1a4924-aa2b-4aab-82f3-d087437953e2 tempest-VolumesSnapshotTestJSON-1904508205 tempest-VolumesSnapshotTestJSON-1904508205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '805854e5ce2e412fb9420afd63f73ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72bda4cbb07a43688506e01d06ba89c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129321) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:43:17.985000 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: INFO nova.api.openstack.requestlog [None req-3a1a4924-aa2b-4aab-82f3-d087437953e2 tempest-VolumesSnapshotTestJSON-1904508205 tempest-VolumesSnapshotTestJSON-1904508205-project] 10.222.0.75 "GET /compute/v2.1/servers/6a87df93-cf49-465a-80dd-102efb0f8b11" status: 200 len: 1319 microversion: 2.1 time: 0.257461 May 26 12:43:17.986006 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: [pid: 129321|app: 0|req: 303/627] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 26 12:43:17 2022] GET /compute/v2.1/servers/6a87df93-cf49-465a-80dd-102efb0f8b11 => generated 1319 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 12:43:18.393011 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi [None req-748fd4a3-a851-49a3-97fe-d63386ef4ea4 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Calling method '>' {{(pid=129322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:43:18.394051 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.compute.api [None req-748fd4a3-a851-49a3-97fe-d63386ef4ea4 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] [instance: bf2f6303-22b9-4cfa-8d4d-61d2503bc554] Fetching instance by UUID {{(pid=129322) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:43:18.405741 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-748fd4a3-a851-49a3-97fe-d63386ef4ea4 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:43:18.406721 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-748fd4a3-a851-49a3-97fe-d63386ef4ea4 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:43:18.408434 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-748fd4a3-a851-49a3-97fe-d63386ef4ea4 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:43:18.409402 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-748fd4a3-a851-49a3-97fe-d63386ef4ea4 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:43:18.592231 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.policy [None req-748fd4a3-a851-49a3-97fe-d63386ef4ea4 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e811736979c44b02b14fecb74c6bd7ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675272fb40d4847819f83ec04afecef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129322) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:43:18.603638 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.policy [None req-748fd4a3-a851-49a3-97fe-d63386ef4ea4 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e811736979c44b02b14fecb74c6bd7ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675272fb40d4847819f83ec04afecef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129322) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:43:18.605203 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.policy [None req-748fd4a3-a851-49a3-97fe-d63386ef4ea4 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e811736979c44b02b14fecb74c6bd7ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675272fb40d4847819f83ec04afecef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129322) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:43:18.606425 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: INFO nova.api.openstack.requestlog [None req-748fd4a3-a851-49a3-97fe-d63386ef4ea4 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] 10.222.0.75 "GET /compute/v2.1/servers/bf2f6303-22b9-4cfa-8d4d-61d2503bc554" status: 200 len: 1741 microversion: 2.20 time: 0.222516 May 26 12:43:18.607441 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: [pid: 129322|app: 0|req: 325/628] 10.222.0.75 () {60 vars in 1276 bytes} [Thu May 26 12:43:18 2022] GET /compute/v2.1/servers/bf2f6303-22b9-4cfa-8d4d-61d2503bc554 => generated 1741 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 12:43:18.687792 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi [None req-c312f7c9-f292-4347-804b-edcf2e83f56c tempest-VolumesActionsTest-731506124 tempest-VolumesActionsTest-731506124-project] Calling method '>' {{(pid=129321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:43:18.692583 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.compute.api [None req-c312f7c9-f292-4347-804b-edcf2e83f56c tempest-VolumesActionsTest-731506124 tempest-VolumesActionsTest-731506124-project] [instance: 3fd057be-56c1-462d-8ea2-9ca668166ccf] Fetching instance by UUID {{(pid=129321) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:43:18.707773 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-c312f7c9-f292-4347-804b-edcf2e83f56c tempest-VolumesActionsTest-731506124 tempest-VolumesActionsTest-731506124-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:43:18.708475 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-c312f7c9-f292-4347-804b-edcf2e83f56c tempest-VolumesActionsTest-731506124 tempest-VolumesActionsTest-731506124-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:43:18.710279 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-c312f7c9-f292-4347-804b-edcf2e83f56c tempest-VolumesActionsTest-731506124 tempest-VolumesActionsTest-731506124-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:43:18.713822 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-c312f7c9-f292-4347-804b-edcf2e83f56c tempest-VolumesActionsTest-731506124 tempest-VolumesActionsTest-731506124-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:43:18.845900 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi [None req-1e4cb79b-890c-4772-a054-e1a768660f7a tempest-TestShelveInstance-546397589 tempest-TestShelveInstance-546397589-project] Calling method '>' {{(pid=129322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:43:18.846718 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.compute.api [None req-1e4cb79b-890c-4772-a054-e1a768660f7a tempest-TestShelveInstance-546397589 tempest-TestShelveInstance-546397589-project] [instance: 05cf529d-df00-4ff9-b0d2-0e27563d2861] Fetching instance by UUID {{(pid=129322) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:43:18.879559 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-1e4cb79b-890c-4772-a054-e1a768660f7a tempest-TestShelveInstance-546397589 tempest-TestShelveInstance-546397589-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:43:18.880384 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-1e4cb79b-890c-4772-a054-e1a768660f7a tempest-TestShelveInstance-546397589 tempest-TestShelveInstance-546397589-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:43:18.883032 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-1e4cb79b-890c-4772-a054-e1a768660f7a tempest-TestShelveInstance-546397589 tempest-TestShelveInstance-546397589-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:43:18.883915 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-1e4cb79b-890c-4772-a054-e1a768660f7a tempest-TestShelveInstance-546397589 tempest-TestShelveInstance-546397589-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:43:19.066734 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.policy [None req-c312f7c9-f292-4347-804b-edcf2e83f56c tempest-VolumesActionsTest-731506124 tempest-VolumesActionsTest-731506124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f39e076a9e6b401db6de9a2846519591', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa93879e60e470185e8dd71efaaf1a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129321) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:43:19.087483 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: INFO nova.api.openstack.requestlog [None req-c312f7c9-f292-4347-804b-edcf2e83f56c tempest-VolumesActionsTest-731506124 tempest-VolumesActionsTest-731506124-project] 10.222.0.75 "GET /compute/v2.1/servers/3fd057be-56c1-462d-8ea2-9ca668166ccf" status: 200 len: 1314 microversion: 2.1 time: 0.411537 May 26 12:43:19.090135 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: [pid: 129321|app: 0|req: 304/629] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 26 12:43:18 2022] GET /compute/v2.1/servers/3fd057be-56c1-462d-8ea2-9ca668166ccf => generated 1314 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:43:19.100366 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi [req-f4e8e7a9-806a-4298-9259-bf60cbfeae3d req-960769b1-6a05-4735-bb64-2ac908b77dd9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "05cf529d-df00-4ff9-b0d2-0e27563d2861", "name": "network-vif-plugged", "status": "completed", "tag": "6408ddad-3849-44bf-b29b-b7e4852f543d"}]} {{(pid=129321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 12:43:19.124408 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [req-f4e8e7a9-806a-4298-9259-bf60cbfeae3d req-960769b1-6a05-4735-bb64-2ac908b77dd9 service nova] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:43:19.126375 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [req-f4e8e7a9-806a-4298-9259-bf60cbfeae3d req-960769b1-6a05-4735-bb64-2ac908b77dd9 service nova] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:43:19.159177 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: INFO nova.api.openstack.compute.server_external_events [req-f4e8e7a9-806a-4298-9259-bf60cbfeae3d req-960769b1-6a05-4735-bb64-2ac908b77dd9 service nova] Creating event network-vif-plugged:6408ddad-3849-44bf-b29b-b7e4852f543d for instance 05cf529d-df00-4ff9-b0d2-0e27563d2861 on hv-cinder-81966 May 26 12:43:19.182259 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: INFO nova.api.openstack.requestlog [req-f4e8e7a9-806a-4298-9259-bf60cbfeae3d req-960769b1-6a05-4735-bb64-2ac908b77dd9 service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.084535 May 26 12:43:19.188497 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: [pid: 129321|app: 0|req: 305/630] 10.222.0.75 () {64 vars in 1317 bytes} [Thu May 26 12:43:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 12:43:19.210363 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi [None req-b2bc0e09-a1c5-470f-afaa-c941cb313a81 tempest-VolumesSnapshotTestJSON-1904508205 tempest-VolumesSnapshotTestJSON-1904508205-project] Calling method '>' {{(pid=129321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:43:19.211469 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.compute.api [None req-b2bc0e09-a1c5-470f-afaa-c941cb313a81 tempest-VolumesSnapshotTestJSON-1904508205 tempest-VolumesSnapshotTestJSON-1904508205-project] [instance: 6a87df93-cf49-465a-80dd-102efb0f8b11] Fetching instance by UUID {{(pid=129321) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:43:19.221589 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-b2bc0e09-a1c5-470f-afaa-c941cb313a81 tempest-VolumesSnapshotTestJSON-1904508205 tempest-VolumesSnapshotTestJSON-1904508205-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:43:19.221589 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-b2bc0e09-a1c5-470f-afaa-c941cb313a81 tempest-VolumesSnapshotTestJSON-1904508205 tempest-VolumesSnapshotTestJSON-1904508205-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:43:19.223147 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-b2bc0e09-a1c5-470f-afaa-c941cb313a81 tempest-VolumesSnapshotTestJSON-1904508205 tempest-VolumesSnapshotTestJSON-1904508205-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:43:19.223147 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-b2bc0e09-a1c5-470f-afaa-c941cb313a81 tempest-VolumesSnapshotTestJSON-1904508205 tempest-VolumesSnapshotTestJSON-1904508205-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:43:19.272016 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.policy [None req-1e4cb79b-890c-4772-a054-e1a768660f7a tempest-TestShelveInstance-546397589 tempest-TestShelveInstance-546397589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d9bf2dcfce24386a1aaf9709d88da45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1f2f503ef674a4b97f848b69f8b63c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129322) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:43:19.283062 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: INFO nova.api.openstack.requestlog [None req-1e4cb79b-890c-4772-a054-e1a768660f7a tempest-TestShelveInstance-546397589 tempest-TestShelveInstance-546397589-project] 10.222.0.75 "GET /compute/v2.1/servers/05cf529d-df00-4ff9-b0d2-0e27563d2861" status: 200 len: 1259 microversion: 2.1 time: 0.443493 May 26 12:43:19.296796 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: [pid: 129322|app: 0|req: 326/631] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 26 12:43:18 2022] GET /compute/v2.1/servers/05cf529d-df00-4ff9-b0d2-0e27563d2861 => generated 1259 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:43:19.419255 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.policy [None req-b2bc0e09-a1c5-470f-afaa-c941cb313a81 tempest-VolumesSnapshotTestJSON-1904508205 tempest-VolumesSnapshotTestJSON-1904508205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '805854e5ce2e412fb9420afd63f73ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72bda4cbb07a43688506e01d06ba89c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129321) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:43:19.427363 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: INFO nova.api.openstack.requestlog [None req-b2bc0e09-a1c5-470f-afaa-c941cb313a81 tempest-VolumesSnapshotTestJSON-1904508205 tempest-VolumesSnapshotTestJSON-1904508205-project] 10.222.0.75 "GET /compute/v2.1/servers/6a87df93-cf49-465a-80dd-102efb0f8b11" status: 200 len: 1319 microversion: 2.1 time: 0.236466 May 26 12:43:19.427987 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: [pid: 129321|app: 0|req: 306/632] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 26 12:43:19 2022] GET /compute/v2.1/servers/6a87df93-cf49-465a-80dd-102efb0f8b11 => generated 1319 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:43:19.625790 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi [None req-eac6df26-1a5d-48c0-a87d-4af9795fad61 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Calling method '>' {{(pid=129322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:43:19.626415 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.compute.api [None req-eac6df26-1a5d-48c0-a87d-4af9795fad61 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] [instance: bf2f6303-22b9-4cfa-8d4d-61d2503bc554] Fetching instance by UUID {{(pid=129322) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:43:19.634784 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-eac6df26-1a5d-48c0-a87d-4af9795fad61 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:43:19.635271 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-eac6df26-1a5d-48c0-a87d-4af9795fad61 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:43:19.636162 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-eac6df26-1a5d-48c0-a87d-4af9795fad61 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:43:19.636630 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-eac6df26-1a5d-48c0-a87d-4af9795fad61 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:43:19.808445 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.policy [None req-eac6df26-1a5d-48c0-a87d-4af9795fad61 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e811736979c44b02b14fecb74c6bd7ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675272fb40d4847819f83ec04afecef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129322) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:43:19.821392 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG dbcounter [-] [129322] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=129322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:43:19.825422 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.policy [None req-eac6df26-1a5d-48c0-a87d-4af9795fad61 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e811736979c44b02b14fecb74c6bd7ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675272fb40d4847819f83ec04afecef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129322) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:43:19.827212 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.policy [None req-eac6df26-1a5d-48c0-a87d-4af9795fad61 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e811736979c44b02b14fecb74c6bd7ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675272fb40d4847819f83ec04afecef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129322) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:43:19.828451 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: INFO nova.api.openstack.requestlog [None req-eac6df26-1a5d-48c0-a87d-4af9795fad61 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] 10.222.0.75 "GET /compute/v2.1/servers/bf2f6303-22b9-4cfa-8d4d-61d2503bc554" status: 200 len: 1741 microversion: 2.20 time: 0.206974 May 26 12:43:19.829021 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: [pid: 129322|app: 0|req: 327/633] 10.222.0.75 () {60 vars in 1276 bytes} [Thu May 26 12:43:19 2022] GET /compute/v2.1/servers/bf2f6303-22b9-4cfa-8d4d-61d2503bc554 => generated 1741 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 12:43:20.109755 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi [None req-68727cc1-d172-4f5f-a9c6-8461cf12b9f6 tempest-VolumesActionsTest-731506124 tempest-VolumesActionsTest-731506124-project] Calling method '>' {{(pid=129321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:43:20.110773 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.compute.api [None req-68727cc1-d172-4f5f-a9c6-8461cf12b9f6 tempest-VolumesActionsTest-731506124 tempest-VolumesActionsTest-731506124-project] [instance: 3fd057be-56c1-462d-8ea2-9ca668166ccf] Fetching instance by UUID {{(pid=129321) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:43:20.118836 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-68727cc1-d172-4f5f-a9c6-8461cf12b9f6 tempest-VolumesActionsTest-731506124 tempest-VolumesActionsTest-731506124-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:43:20.119249 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-68727cc1-d172-4f5f-a9c6-8461cf12b9f6 tempest-VolumesActionsTest-731506124 tempest-VolumesActionsTest-731506124-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:43:20.120293 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-68727cc1-d172-4f5f-a9c6-8461cf12b9f6 tempest-VolumesActionsTest-731506124 tempest-VolumesActionsTest-731506124-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:43:20.120891 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-68727cc1-d172-4f5f-a9c6-8461cf12b9f6 tempest-VolumesActionsTest-731506124 tempest-VolumesActionsTest-731506124-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:43:20.301520 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi [None req-c562491e-6648-423e-9a35-8ba196db9a1c tempest-TestShelveInstance-546397589 tempest-TestShelveInstance-546397589-project] Calling method '>' {{(pid=129322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:43:20.302574 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.compute.api [None req-c562491e-6648-423e-9a35-8ba196db9a1c tempest-TestShelveInstance-546397589 tempest-TestShelveInstance-546397589-project] [instance: 05cf529d-df00-4ff9-b0d2-0e27563d2861] Fetching instance by UUID {{(pid=129322) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:43:20.311576 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-c562491e-6648-423e-9a35-8ba196db9a1c tempest-TestShelveInstance-546397589 tempest-TestShelveInstance-546397589-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:43:20.312036 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-c562491e-6648-423e-9a35-8ba196db9a1c tempest-TestShelveInstance-546397589 tempest-TestShelveInstance-546397589-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:43:20.312926 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-c562491e-6648-423e-9a35-8ba196db9a1c tempest-TestShelveInstance-546397589 tempest-TestShelveInstance-546397589-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:43:20.313358 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-c562491e-6648-423e-9a35-8ba196db9a1c tempest-TestShelveInstance-546397589 tempest-TestShelveInstance-546397589-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:43:20.370137 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.policy [None req-68727cc1-d172-4f5f-a9c6-8461cf12b9f6 tempest-VolumesActionsTest-731506124 tempest-VolumesActionsTest-731506124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f39e076a9e6b401db6de9a2846519591', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa93879e60e470185e8dd71efaaf1a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129321) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:43:20.384827 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: INFO nova.api.openstack.requestlog [None req-68727cc1-d172-4f5f-a9c6-8461cf12b9f6 tempest-VolumesActionsTest-731506124 tempest-VolumesActionsTest-731506124-project] 10.222.0.75 "GET /compute/v2.1/servers/3fd057be-56c1-462d-8ea2-9ca668166ccf" status: 200 len: 1314 microversion: 2.1 time: 0.281546 May 26 12:43:20.386229 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: [pid: 129321|app: 0|req: 307/634] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 26 12:43:20 2022] GET /compute/v2.1/servers/3fd057be-56c1-462d-8ea2-9ca668166ccf => generated 1314 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:43:20.447676 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi [None req-4c6452ed-4589-4849-8e3a-18fcb6869b86 tempest-VolumesSnapshotTestJSON-1904508205 tempest-VolumesSnapshotTestJSON-1904508205-project] Calling method '>' {{(pid=129321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:43:20.448700 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.compute.api [None req-4c6452ed-4589-4849-8e3a-18fcb6869b86 tempest-VolumesSnapshotTestJSON-1904508205 tempest-VolumesSnapshotTestJSON-1904508205-project] [instance: 6a87df93-cf49-465a-80dd-102efb0f8b11] Fetching instance by UUID {{(pid=129321) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:43:20.456073 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-4c6452ed-4589-4849-8e3a-18fcb6869b86 tempest-VolumesSnapshotTestJSON-1904508205 tempest-VolumesSnapshotTestJSON-1904508205-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:43:20.456612 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-4c6452ed-4589-4849-8e3a-18fcb6869b86 tempest-VolumesSnapshotTestJSON-1904508205 tempest-VolumesSnapshotTestJSON-1904508205-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:43:20.457473 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-4c6452ed-4589-4849-8e3a-18fcb6869b86 tempest-VolumesSnapshotTestJSON-1904508205 tempest-VolumesSnapshotTestJSON-1904508205-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:43:20.458001 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-4c6452ed-4589-4849-8e3a-18fcb6869b86 tempest-VolumesSnapshotTestJSON-1904508205 tempest-VolumesSnapshotTestJSON-1904508205-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:43:20.511935 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.policy [None req-c562491e-6648-423e-9a35-8ba196db9a1c tempest-TestShelveInstance-546397589 tempest-TestShelveInstance-546397589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d9bf2dcfce24386a1aaf9709d88da45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1f2f503ef674a4b97f848b69f8b63c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129322) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:43:20.540271 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: INFO nova.api.openstack.requestlog [None req-c562491e-6648-423e-9a35-8ba196db9a1c tempest-TestShelveInstance-546397589 tempest-TestShelveInstance-546397589-project] 10.222.0.75 "GET /compute/v2.1/servers/05cf529d-df00-4ff9-b0d2-0e27563d2861" status: 200 len: 1259 microversion: 2.1 time: 0.237406 May 26 12:43:20.541278 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: [pid: 129322|app: 0|req: 328/635] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 26 12:43:20 2022] GET /compute/v2.1/servers/05cf529d-df00-4ff9-b0d2-0e27563d2861 => generated 1259 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 12:43:20.660884 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.policy [None req-4c6452ed-4589-4849-8e3a-18fcb6869b86 tempest-VolumesSnapshotTestJSON-1904508205 tempest-VolumesSnapshotTestJSON-1904508205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '805854e5ce2e412fb9420afd63f73ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72bda4cbb07a43688506e01d06ba89c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129321) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:43:20.671579 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: INFO nova.api.openstack.requestlog [None req-4c6452ed-4589-4849-8e3a-18fcb6869b86 tempest-VolumesSnapshotTestJSON-1904508205 tempest-VolumesSnapshotTestJSON-1904508205-project] 10.222.0.75 "GET /compute/v2.1/servers/6a87df93-cf49-465a-80dd-102efb0f8b11" status: 200 len: 1319 microversion: 2.1 time: 0.230060 May 26 12:43:20.683595 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: [pid: 129321|app: 0|req: 308/636] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 26 12:43:20 2022] GET /compute/v2.1/servers/6a87df93-cf49-465a-80dd-102efb0f8b11 => generated 1319 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 12:43:20.854534 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi [None req-d1eb1fcb-e16b-4106-b7f8-0d518f6296dd tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Calling method '>' {{(pid=129322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:43:20.855264 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.compute.api [None req-d1eb1fcb-e16b-4106-b7f8-0d518f6296dd tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] [instance: bf2f6303-22b9-4cfa-8d4d-61d2503bc554] Fetching instance by UUID {{(pid=129322) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:43:20.873664 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-d1eb1fcb-e16b-4106-b7f8-0d518f6296dd tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:43:20.874488 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-d1eb1fcb-e16b-4106-b7f8-0d518f6296dd tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:43:20.875503 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-d1eb1fcb-e16b-4106-b7f8-0d518f6296dd tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:43:20.878902 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-d1eb1fcb-e16b-4106-b7f8-0d518f6296dd tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:43:21.080319 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.policy [None req-d1eb1fcb-e16b-4106-b7f8-0d518f6296dd tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e811736979c44b02b14fecb74c6bd7ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675272fb40d4847819f83ec04afecef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129322) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:43:21.090919 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.policy [None req-d1eb1fcb-e16b-4106-b7f8-0d518f6296dd tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e811736979c44b02b14fecb74c6bd7ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675272fb40d4847819f83ec04afecef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129322) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:43:21.092891 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.policy [None req-d1eb1fcb-e16b-4106-b7f8-0d518f6296dd tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e811736979c44b02b14fecb74c6bd7ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675272fb40d4847819f83ec04afecef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129322) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:43:21.094337 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: INFO nova.api.openstack.requestlog [None req-d1eb1fcb-e16b-4106-b7f8-0d518f6296dd tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] 10.222.0.75 "GET /compute/v2.1/servers/bf2f6303-22b9-4cfa-8d4d-61d2503bc554" status: 200 len: 1741 microversion: 2.20 time: 0.245044 May 26 12:43:21.105833 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: [pid: 129322|app: 0|req: 329/637] 10.222.0.75 () {60 vars in 1276 bytes} [Thu May 26 12:43:20 2022] GET /compute/v2.1/servers/bf2f6303-22b9-4cfa-8d4d-61d2503bc554 => generated 1741 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 12:43:21.414960 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi [None req-0aadbe21-1418-453d-9c7e-fd18d95050eb tempest-VolumesActionsTest-731506124 tempest-VolumesActionsTest-731506124-project] Calling method '>' {{(pid=129321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:43:21.416058 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.compute.api [None req-0aadbe21-1418-453d-9c7e-fd18d95050eb tempest-VolumesActionsTest-731506124 tempest-VolumesActionsTest-731506124-project] [instance: 3fd057be-56c1-462d-8ea2-9ca668166ccf] Fetching instance by UUID {{(pid=129321) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:43:21.427502 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-0aadbe21-1418-453d-9c7e-fd18d95050eb tempest-VolumesActionsTest-731506124 tempest-VolumesActionsTest-731506124-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:43:21.428323 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-0aadbe21-1418-453d-9c7e-fd18d95050eb tempest-VolumesActionsTest-731506124 tempest-VolumesActionsTest-731506124-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:43:21.429607 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-0aadbe21-1418-453d-9c7e-fd18d95050eb tempest-VolumesActionsTest-731506124 tempest-VolumesActionsTest-731506124-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:43:21.430331 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-0aadbe21-1418-453d-9c7e-fd18d95050eb tempest-VolumesActionsTest-731506124 tempest-VolumesActionsTest-731506124-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:43:21.558791 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi [None req-55819a9e-a0f5-4ded-8e85-457c8650cdf1 tempest-TestShelveInstance-546397589 tempest-TestShelveInstance-546397589-project] Calling method '>' {{(pid=129322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:43:21.559812 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.compute.api [None req-55819a9e-a0f5-4ded-8e85-457c8650cdf1 tempest-TestShelveInstance-546397589 tempest-TestShelveInstance-546397589-project] [instance: 05cf529d-df00-4ff9-b0d2-0e27563d2861] Fetching instance by UUID {{(pid=129322) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:43:21.567959 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-55819a9e-a0f5-4ded-8e85-457c8650cdf1 tempest-TestShelveInstance-546397589 tempest-TestShelveInstance-546397589-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:43:21.568532 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-55819a9e-a0f5-4ded-8e85-457c8650cdf1 tempest-TestShelveInstance-546397589 tempest-TestShelveInstance-546397589-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:43:21.569423 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-55819a9e-a0f5-4ded-8e85-457c8650cdf1 tempest-TestShelveInstance-546397589 tempest-TestShelveInstance-546397589-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:43:21.569765 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-55819a9e-a0f5-4ded-8e85-457c8650cdf1 tempest-TestShelveInstance-546397589 tempest-TestShelveInstance-546397589-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:43:21.651267 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.policy [None req-0aadbe21-1418-453d-9c7e-fd18d95050eb tempest-VolumesActionsTest-731506124 tempest-VolumesActionsTest-731506124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f39e076a9e6b401db6de9a2846519591', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa93879e60e470185e8dd71efaaf1a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129321) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:43:21.666382 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: INFO nova.api.openstack.requestlog [None req-0aadbe21-1418-453d-9c7e-fd18d95050eb tempest-VolumesActionsTest-731506124 tempest-VolumesActionsTest-731506124-project] 10.222.0.75 "GET /compute/v2.1/servers/3fd057be-56c1-462d-8ea2-9ca668166ccf" status: 200 len: 1314 microversion: 2.1 time: 0.258192 May 26 12:43:21.668616 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: [pid: 129321|app: 0|req: 309/638] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 26 12:43:21 2022] GET /compute/v2.1/servers/3fd057be-56c1-462d-8ea2-9ca668166ccf => generated 1314 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:43:21.690894 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi [None req-a15a803e-4219-41a7-a691-968e009df932 tempest-VolumesSnapshotTestJSON-1904508205 tempest-VolumesSnapshotTestJSON-1904508205-project] Calling method '>' {{(pid=129321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:43:21.691509 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.compute.api [None req-a15a803e-4219-41a7-a691-968e009df932 tempest-VolumesSnapshotTestJSON-1904508205 tempest-VolumesSnapshotTestJSON-1904508205-project] [instance: 6a87df93-cf49-465a-80dd-102efb0f8b11] Fetching instance by UUID {{(pid=129321) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:43:21.702627 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-a15a803e-4219-41a7-a691-968e009df932 tempest-VolumesSnapshotTestJSON-1904508205 tempest-VolumesSnapshotTestJSON-1904508205-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:43:21.703102 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-a15a803e-4219-41a7-a691-968e009df932 tempest-VolumesSnapshotTestJSON-1904508205 tempest-VolumesSnapshotTestJSON-1904508205-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:43:21.703896 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-a15a803e-4219-41a7-a691-968e009df932 tempest-VolumesSnapshotTestJSON-1904508205 tempest-VolumesSnapshotTestJSON-1904508205-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:43:21.704324 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-a15a803e-4219-41a7-a691-968e009df932 tempest-VolumesSnapshotTestJSON-1904508205 tempest-VolumesSnapshotTestJSON-1904508205-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:43:21.830410 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.policy [None req-55819a9e-a0f5-4ded-8e85-457c8650cdf1 tempest-TestShelveInstance-546397589 tempest-TestShelveInstance-546397589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d9bf2dcfce24386a1aaf9709d88da45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1f2f503ef674a4b97f848b69f8b63c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129322) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:43:21.846477 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: INFO nova.api.openstack.requestlog [None req-55819a9e-a0f5-4ded-8e85-457c8650cdf1 tempest-TestShelveInstance-546397589 tempest-TestShelveInstance-546397589-project] 10.222.0.75 "GET /compute/v2.1/servers/05cf529d-df00-4ff9-b0d2-0e27563d2861" status: 200 len: 1259 microversion: 2.1 time: 0.292033 May 26 12:43:21.856696 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: [pid: 129322|app: 0|req: 330/639] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 26 12:43:21 2022] GET /compute/v2.1/servers/05cf529d-df00-4ff9-b0d2-0e27563d2861 => generated 1259 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 12:43:21.941644 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.policy [None req-a15a803e-4219-41a7-a691-968e009df932 tempest-VolumesSnapshotTestJSON-1904508205 tempest-VolumesSnapshotTestJSON-1904508205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '805854e5ce2e412fb9420afd63f73ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72bda4cbb07a43688506e01d06ba89c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129321) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:43:21.953677 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: INFO nova.api.openstack.requestlog [None req-a15a803e-4219-41a7-a691-968e009df932 tempest-VolumesSnapshotTestJSON-1904508205 tempest-VolumesSnapshotTestJSON-1904508205-project] 10.222.0.75 "GET /compute/v2.1/servers/6a87df93-cf49-465a-80dd-102efb0f8b11" status: 200 len: 1319 microversion: 2.1 time: 0.267449 May 26 12:43:21.954528 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: [pid: 129321|app: 0|req: 310/640] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 26 12:43:21 2022] GET /compute/v2.1/servers/6a87df93-cf49-465a-80dd-102efb0f8b11 => generated 1319 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 12:43:22.121432 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi [None req-c21e421e-eb5e-4611-bea3-c4b0785f528a tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Calling method '>' {{(pid=129322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:43:22.123917 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.compute.api [None req-c21e421e-eb5e-4611-bea3-c4b0785f528a tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] [instance: bf2f6303-22b9-4cfa-8d4d-61d2503bc554] Fetching instance by UUID {{(pid=129322) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:43:22.141311 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-c21e421e-eb5e-4611-bea3-c4b0785f528a tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:43:22.142398 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-c21e421e-eb5e-4611-bea3-c4b0785f528a tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:43:22.144720 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-c21e421e-eb5e-4611-bea3-c4b0785f528a tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:43:22.145867 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-c21e421e-eb5e-4611-bea3-c4b0785f528a tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:43:22.327698 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.policy [None req-c21e421e-eb5e-4611-bea3-c4b0785f528a tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e811736979c44b02b14fecb74c6bd7ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675272fb40d4847819f83ec04afecef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129322) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:43:22.349234 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.policy [None req-c21e421e-eb5e-4611-bea3-c4b0785f528a tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e811736979c44b02b14fecb74c6bd7ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675272fb40d4847819f83ec04afecef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129322) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:43:22.360787 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.policy [None req-c21e421e-eb5e-4611-bea3-c4b0785f528a tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e811736979c44b02b14fecb74c6bd7ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675272fb40d4847819f83ec04afecef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129322) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:43:22.362506 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: INFO nova.api.openstack.requestlog [None req-c21e421e-eb5e-4611-bea3-c4b0785f528a tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] 10.222.0.75 "GET /compute/v2.1/servers/bf2f6303-22b9-4cfa-8d4d-61d2503bc554" status: 200 len: 1741 microversion: 2.20 time: 0.251242 May 26 12:43:22.362964 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: [pid: 129322|app: 0|req: 331/641] 10.222.0.75 () {60 vars in 1276 bytes} [Thu May 26 12:43:22 2022] GET /compute/v2.1/servers/bf2f6303-22b9-4cfa-8d4d-61d2503bc554 => generated 1741 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 12:43:22.685846 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi [None req-3180d7e0-39a3-4e07-a195-97d441ffbe51 tempest-VolumesActionsTest-731506124 tempest-VolumesActionsTest-731506124-project] Calling method '>' {{(pid=129321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:43:22.686438 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.compute.api [None req-3180d7e0-39a3-4e07-a195-97d441ffbe51 tempest-VolumesActionsTest-731506124 tempest-VolumesActionsTest-731506124-project] [instance: 3fd057be-56c1-462d-8ea2-9ca668166ccf] Fetching instance by UUID {{(pid=129321) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:43:22.694266 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-3180d7e0-39a3-4e07-a195-97d441ffbe51 tempest-VolumesActionsTest-731506124 tempest-VolumesActionsTest-731506124-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:43:22.694700 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-3180d7e0-39a3-4e07-a195-97d441ffbe51 tempest-VolumesActionsTest-731506124 tempest-VolumesActionsTest-731506124-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:43:22.695712 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-3180d7e0-39a3-4e07-a195-97d441ffbe51 tempest-VolumesActionsTest-731506124 tempest-VolumesActionsTest-731506124-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:43:22.696375 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-3180d7e0-39a3-4e07-a195-97d441ffbe51 tempest-VolumesActionsTest-731506124 tempest-VolumesActionsTest-731506124-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:43:22.868047 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi [None req-49065d09-3948-4de8-98a0-91c3b8b4be2a tempest-TestShelveInstance-546397589 tempest-TestShelveInstance-546397589-project] Calling method '>' {{(pid=129322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:43:22.869935 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.compute.api [None req-49065d09-3948-4de8-98a0-91c3b8b4be2a tempest-TestShelveInstance-546397589 tempest-TestShelveInstance-546397589-project] [instance: 05cf529d-df00-4ff9-b0d2-0e27563d2861] Fetching instance by UUID {{(pid=129322) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:43:22.891597 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-49065d09-3948-4de8-98a0-91c3b8b4be2a tempest-TestShelveInstance-546397589 tempest-TestShelveInstance-546397589-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:43:22.892447 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-49065d09-3948-4de8-98a0-91c3b8b4be2a tempest-TestShelveInstance-546397589 tempest-TestShelveInstance-546397589-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:43:22.893764 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-49065d09-3948-4de8-98a0-91c3b8b4be2a tempest-TestShelveInstance-546397589 tempest-TestShelveInstance-546397589-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:43:22.903644 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-49065d09-3948-4de8-98a0-91c3b8b4be2a tempest-TestShelveInstance-546397589 tempest-TestShelveInstance-546397589-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:43:22.911040 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.policy [None req-3180d7e0-39a3-4e07-a195-97d441ffbe51 tempest-VolumesActionsTest-731506124 tempest-VolumesActionsTest-731506124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f39e076a9e6b401db6de9a2846519591', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa93879e60e470185e8dd71efaaf1a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129321) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:43:22.933074 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: INFO nova.api.openstack.requestlog [None req-3180d7e0-39a3-4e07-a195-97d441ffbe51 tempest-VolumesActionsTest-731506124 tempest-VolumesActionsTest-731506124-project] 10.222.0.75 "GET /compute/v2.1/servers/3fd057be-56c1-462d-8ea2-9ca668166ccf" status: 200 len: 1314 microversion: 2.1 time: 0.250540 May 26 12:43:22.948404 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: [pid: 129321|app: 0|req: 311/642] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 26 12:43:22 2022] GET /compute/v2.1/servers/3fd057be-56c1-462d-8ea2-9ca668166ccf => generated 1314 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:43:22.984825 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi [None req-6abeee02-8783-4787-a229-85481e5ddf37 tempest-VolumesSnapshotTestJSON-1904508205 tempest-VolumesSnapshotTestJSON-1904508205-project] Calling method '>' {{(pid=129321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:43:22.987619 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.compute.api [None req-6abeee02-8783-4787-a229-85481e5ddf37 tempest-VolumesSnapshotTestJSON-1904508205 tempest-VolumesSnapshotTestJSON-1904508205-project] [instance: 6a87df93-cf49-465a-80dd-102efb0f8b11] Fetching instance by UUID {{(pid=129321) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:43:23.011290 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-6abeee02-8783-4787-a229-85481e5ddf37 tempest-VolumesSnapshotTestJSON-1904508205 tempest-VolumesSnapshotTestJSON-1904508205-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:43:23.012623 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-6abeee02-8783-4787-a229-85481e5ddf37 tempest-VolumesSnapshotTestJSON-1904508205 tempest-VolumesSnapshotTestJSON-1904508205-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:43:23.014541 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-6abeee02-8783-4787-a229-85481e5ddf37 tempest-VolumesSnapshotTestJSON-1904508205 tempest-VolumesSnapshotTestJSON-1904508205-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:43:23.016232 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-6abeee02-8783-4787-a229-85481e5ddf37 tempest-VolumesSnapshotTestJSON-1904508205 tempest-VolumesSnapshotTestJSON-1904508205-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:43:23.147346 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.policy [None req-49065d09-3948-4de8-98a0-91c3b8b4be2a tempest-TestShelveInstance-546397589 tempest-TestShelveInstance-546397589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d9bf2dcfce24386a1aaf9709d88da45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1f2f503ef674a4b97f848b69f8b63c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129322) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:43:23.162702 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: INFO nova.api.openstack.requestlog [None req-49065d09-3948-4de8-98a0-91c3b8b4be2a tempest-TestShelveInstance-546397589 tempest-TestShelveInstance-546397589-project] 10.222.0.75 "GET /compute/v2.1/servers/05cf529d-df00-4ff9-b0d2-0e27563d2861" status: 200 len: 1259 microversion: 2.1 time: 0.301636 May 26 12:43:23.163741 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: [pid: 129322|app: 0|req: 332/643] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 26 12:43:22 2022] GET /compute/v2.1/servers/05cf529d-df00-4ff9-b0d2-0e27563d2861 => generated 1259 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:43:23.300545 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.policy [None req-6abeee02-8783-4787-a229-85481e5ddf37 tempest-VolumesSnapshotTestJSON-1904508205 tempest-VolumesSnapshotTestJSON-1904508205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '805854e5ce2e412fb9420afd63f73ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72bda4cbb07a43688506e01d06ba89c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129321) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:43:23.310244 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: INFO nova.api.openstack.requestlog [None req-6abeee02-8783-4787-a229-85481e5ddf37 tempest-VolumesSnapshotTestJSON-1904508205 tempest-VolumesSnapshotTestJSON-1904508205-project] 10.222.0.75 "GET /compute/v2.1/servers/6a87df93-cf49-465a-80dd-102efb0f8b11" status: 200 len: 1319 microversion: 2.1 time: 0.340968 May 26 12:43:23.311182 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: [pid: 129321|app: 0|req: 312/644] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 26 12:43:22 2022] GET /compute/v2.1/servers/6a87df93-cf49-465a-80dd-102efb0f8b11 => generated 1319 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:43:23.387895 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi [None req-a35d8e09-316f-4463-afe8-3abadea303fa tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Calling method '>' {{(pid=129322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:43:23.388820 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.compute.api [None req-a35d8e09-316f-4463-afe8-3abadea303fa tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] [instance: bf2f6303-22b9-4cfa-8d4d-61d2503bc554] Fetching instance by UUID {{(pid=129322) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:43:23.397523 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-a35d8e09-316f-4463-afe8-3abadea303fa tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:43:23.398287 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-a35d8e09-316f-4463-afe8-3abadea303fa tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:43:23.399397 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-a35d8e09-316f-4463-afe8-3abadea303fa tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:43:23.400798 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-a35d8e09-316f-4463-afe8-3abadea303fa tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:43:23.659270 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.policy [None req-a35d8e09-316f-4463-afe8-3abadea303fa tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e811736979c44b02b14fecb74c6bd7ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675272fb40d4847819f83ec04afecef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129322) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:43:23.669144 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi [None req-d6b198de-e62a-47b9-bf00-dd51b5f67315 tempest-TestMinimumBasicScenario-102576986 tempest-TestMinimumBasicScenario-102576986-project] Calling method '>' {{(pid=129321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:43:23.672476 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.compute.api [None req-d6b198de-e62a-47b9-bf00-dd51b5f67315 tempest-TestMinimumBasicScenario-102576986 tempest-TestMinimumBasicScenario-102576986-project] [instance: 76661008-e6d3-4646-a9ba-d5d0e83a4b65] Fetching instance by UUID {{(pid=129321) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:43:23.694972 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.policy [None req-a35d8e09-316f-4463-afe8-3abadea303fa tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e811736979c44b02b14fecb74c6bd7ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675272fb40d4847819f83ec04afecef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129322) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:43:23.696780 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-d6b198de-e62a-47b9-bf00-dd51b5f67315 tempest-TestMinimumBasicScenario-102576986 tempest-TestMinimumBasicScenario-102576986-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:43:23.697333 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-d6b198de-e62a-47b9-bf00-dd51b5f67315 tempest-TestMinimumBasicScenario-102576986 tempest-TestMinimumBasicScenario-102576986-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:43:23.700121 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.policy [None req-a35d8e09-316f-4463-afe8-3abadea303fa tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e811736979c44b02b14fecb74c6bd7ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675272fb40d4847819f83ec04afecef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129322) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:43:23.701579 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-d6b198de-e62a-47b9-bf00-dd51b5f67315 tempest-TestMinimumBasicScenario-102576986 tempest-TestMinimumBasicScenario-102576986-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:43:23.703476 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: INFO nova.api.openstack.requestlog [None req-a35d8e09-316f-4463-afe8-3abadea303fa tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] 10.222.0.75 "GET /compute/v2.1/servers/bf2f6303-22b9-4cfa-8d4d-61d2503bc554" status: 200 len: 1741 microversion: 2.20 time: 0.321756 May 26 12:43:23.704511 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-d6b198de-e62a-47b9-bf00-dd51b5f67315 tempest-TestMinimumBasicScenario-102576986 tempest-TestMinimumBasicScenario-102576986-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:43:23.708511 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: [pid: 129322|app: 0|req: 333/645] 10.222.0.75 () {60 vars in 1276 bytes} [Thu May 26 12:43:23 2022] GET /compute/v2.1/servers/bf2f6303-22b9-4cfa-8d4d-61d2503bc554 => generated 1741 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 12:43:23.774954 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi [req-7dd10516-6193-4a36-80a8-f41fbfb6c786 req-1d7d2ef4-ba15-488d-aeb5-6c19e1e9ee7c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6a87df93-cf49-465a-80dd-102efb0f8b11", "name": "network-vif-plugged", "status": "completed", "tag": "dbacc009-79e8-4f19-b33f-318a83e21b17"}]} {{(pid=129322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 12:43:23.790497 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [req-7dd10516-6193-4a36-80a8-f41fbfb6c786 req-1d7d2ef4-ba15-488d-aeb5-6c19e1e9ee7c service nova] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:43:23.792390 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [req-7dd10516-6193-4a36-80a8-f41fbfb6c786 req-1d7d2ef4-ba15-488d-aeb5-6c19e1e9ee7c service nova] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:43:23.811356 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: INFO nova.api.openstack.compute.server_external_events [req-7dd10516-6193-4a36-80a8-f41fbfb6c786 req-1d7d2ef4-ba15-488d-aeb5-6c19e1e9ee7c service nova] Creating event network-vif-plugged:dbacc009-79e8-4f19-b33f-318a83e21b17 for instance 6a87df93-cf49-465a-80dd-102efb0f8b11 on hv-cinder-81966 May 26 12:43:23.821663 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: INFO nova.api.openstack.requestlog [req-7dd10516-6193-4a36-80a8-f41fbfb6c786 req-1d7d2ef4-ba15-488d-aeb5-6c19e1e9ee7c service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052378 May 26 12:43:23.822849 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: [pid: 129322|app: 0|req: 334/646] 10.222.0.75 () {64 vars in 1317 bytes} [Thu May 26 12:43:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 26 12:43:23.926023 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.policy [None req-d6b198de-e62a-47b9-bf00-dd51b5f67315 tempest-TestMinimumBasicScenario-102576986 tempest-TestMinimumBasicScenario-102576986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0352a80bdc174b9a9df4eca60b81eba4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fa2c4d6423444e487d259062656129b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129321) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:43:23.936128 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: INFO nova.api.openstack.requestlog [None req-d6b198de-e62a-47b9-bf00-dd51b5f67315 tempest-TestMinimumBasicScenario-102576986 tempest-TestMinimumBasicScenario-102576986-project] 10.222.0.75 "GET /compute/v2.1/servers/76661008-e6d3-4646-a9ba-d5d0e83a4b65" status: 200 len: 1593 microversion: 2.1 time: 0.275247 May 26 12:43:23.937084 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: [pid: 129321|app: 0|req: 313/647] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 26 12:43:23 2022] GET /compute/v2.1/servers/76661008-e6d3-4646-a9ba-d5d0e83a4b65 => generated 1593 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:43:23.956727 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi [None req-8125af4f-95c8-498b-b165-545e1f54f649 tempest-VolumesActionsTest-731506124 tempest-VolumesActionsTest-731506124-project] Calling method '>' {{(pid=129322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:43:23.958187 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.compute.api [None req-8125af4f-95c8-498b-b165-545e1f54f649 tempest-VolumesActionsTest-731506124 tempest-VolumesActionsTest-731506124-project] [instance: 3fd057be-56c1-462d-8ea2-9ca668166ccf] Fetching instance by UUID {{(pid=129322) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:43:23.966059 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-8125af4f-95c8-498b-b165-545e1f54f649 tempest-VolumesActionsTest-731506124 tempest-VolumesActionsTest-731506124-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:43:23.966658 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-8125af4f-95c8-498b-b165-545e1f54f649 tempest-VolumesActionsTest-731506124 tempest-VolumesActionsTest-731506124-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:43:23.967738 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-8125af4f-95c8-498b-b165-545e1f54f649 tempest-VolumesActionsTest-731506124 tempest-VolumesActionsTest-731506124-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:43:23.968228 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-8125af4f-95c8-498b-b165-545e1f54f649 tempest-VolumesActionsTest-731506124 tempest-VolumesActionsTest-731506124-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:43:24.188992 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi [None req-df35b2fa-1201-4b9a-b796-54625613e300 tempest-TestShelveInstance-546397589 tempest-TestShelveInstance-546397589-project] Calling method '>' {{(pid=129321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:43:24.189844 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.compute.api [None req-df35b2fa-1201-4b9a-b796-54625613e300 tempest-TestShelveInstance-546397589 tempest-TestShelveInstance-546397589-project] [instance: 05cf529d-df00-4ff9-b0d2-0e27563d2861] Fetching instance by UUID {{(pid=129321) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:43:24.197518 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-df35b2fa-1201-4b9a-b796-54625613e300 tempest-TestShelveInstance-546397589 tempest-TestShelveInstance-546397589-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:43:24.198069 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-df35b2fa-1201-4b9a-b796-54625613e300 tempest-TestShelveInstance-546397589 tempest-TestShelveInstance-546397589-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:43:24.198954 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-df35b2fa-1201-4b9a-b796-54625613e300 tempest-TestShelveInstance-546397589 tempest-TestShelveInstance-546397589-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:43:24.199469 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-df35b2fa-1201-4b9a-b796-54625613e300 tempest-TestShelveInstance-546397589 tempest-TestShelveInstance-546397589-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:43:24.273636 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.policy [None req-8125af4f-95c8-498b-b165-545e1f54f649 tempest-VolumesActionsTest-731506124 tempest-VolumesActionsTest-731506124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f39e076a9e6b401db6de9a2846519591', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa93879e60e470185e8dd71efaaf1a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129322) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:43:24.285663 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: INFO nova.api.openstack.requestlog [None req-8125af4f-95c8-498b-b165-545e1f54f649 tempest-VolumesActionsTest-731506124 tempest-VolumesActionsTest-731506124-project] 10.222.0.75 "GET /compute/v2.1/servers/3fd057be-56c1-462d-8ea2-9ca668166ccf" status: 200 len: 1314 microversion: 2.1 time: 0.333957 May 26 12:43:24.289568 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: [pid: 129322|app: 0|req: 335/648] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 26 12:43:23 2022] GET /compute/v2.1/servers/3fd057be-56c1-462d-8ea2-9ca668166ccf => generated 1314 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:43:24.336278 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi [None req-f7dac8e7-21e9-40cc-9350-b9df81d73cc7 tempest-VolumesSnapshotTestJSON-1904508205 tempest-VolumesSnapshotTestJSON-1904508205-project] Calling method '>' {{(pid=129322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:43:24.337459 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.compute.api [None req-f7dac8e7-21e9-40cc-9350-b9df81d73cc7 tempest-VolumesSnapshotTestJSON-1904508205 tempest-VolumesSnapshotTestJSON-1904508205-project] [instance: 6a87df93-cf49-465a-80dd-102efb0f8b11] Fetching instance by UUID {{(pid=129322) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:43:24.349523 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-f7dac8e7-21e9-40cc-9350-b9df81d73cc7 tempest-VolumesSnapshotTestJSON-1904508205 tempest-VolumesSnapshotTestJSON-1904508205-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:43:24.350484 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-f7dac8e7-21e9-40cc-9350-b9df81d73cc7 tempest-VolumesSnapshotTestJSON-1904508205 tempest-VolumesSnapshotTestJSON-1904508205-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:43:24.353462 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-f7dac8e7-21e9-40cc-9350-b9df81d73cc7 tempest-VolumesSnapshotTestJSON-1904508205 tempest-VolumesSnapshotTestJSON-1904508205-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:43:24.357118 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-f7dac8e7-21e9-40cc-9350-b9df81d73cc7 tempest-VolumesSnapshotTestJSON-1904508205 tempest-VolumesSnapshotTestJSON-1904508205-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:43:24.435053 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.policy [None req-df35b2fa-1201-4b9a-b796-54625613e300 tempest-TestShelveInstance-546397589 tempest-TestShelveInstance-546397589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d9bf2dcfce24386a1aaf9709d88da45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1f2f503ef674a4b97f848b69f8b63c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129321) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:43:24.446959 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: INFO nova.api.openstack.requestlog [None req-df35b2fa-1201-4b9a-b796-54625613e300 tempest-TestShelveInstance-546397589 tempest-TestShelveInstance-546397589-project] 10.222.0.75 "GET /compute/v2.1/servers/05cf529d-df00-4ff9-b0d2-0e27563d2861" status: 200 len: 1259 microversion: 2.1 time: 0.262188 May 26 12:43:24.448594 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: [pid: 129321|app: 0|req: 314/649] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 26 12:43:24 2022] GET /compute/v2.1/servers/05cf529d-df00-4ff9-b0d2-0e27563d2861 => generated 1259 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:43:24.670700 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.policy [None req-f7dac8e7-21e9-40cc-9350-b9df81d73cc7 tempest-VolumesSnapshotTestJSON-1904508205 tempest-VolumesSnapshotTestJSON-1904508205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '805854e5ce2e412fb9420afd63f73ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72bda4cbb07a43688506e01d06ba89c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129322) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:43:24.683048 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: INFO nova.api.openstack.requestlog [None req-f7dac8e7-21e9-40cc-9350-b9df81d73cc7 tempest-VolumesSnapshotTestJSON-1904508205 tempest-VolumesSnapshotTestJSON-1904508205-project] 10.222.0.75 "GET /compute/v2.1/servers/6a87df93-cf49-465a-80dd-102efb0f8b11" status: 200 len: 1319 microversion: 2.1 time: 0.352142 May 26 12:43:24.684947 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: [pid: 129322|app: 0|req: 336/650] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 26 12:43:24 2022] GET /compute/v2.1/servers/6a87df93-cf49-465a-80dd-102efb0f8b11 => generated 1319 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:43:24.732546 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi [None req-e28993eb-8bbd-4e77-9a8e-d48dccbf861c tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Calling method '>' {{(pid=129321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:43:24.733714 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.compute.api [None req-e28993eb-8bbd-4e77-9a8e-d48dccbf861c tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] [instance: bf2f6303-22b9-4cfa-8d4d-61d2503bc554] Fetching instance by UUID {{(pid=129321) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:43:24.750503 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-e28993eb-8bbd-4e77-9a8e-d48dccbf861c tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:43:24.750503 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-e28993eb-8bbd-4e77-9a8e-d48dccbf861c tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:43:24.750503 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-e28993eb-8bbd-4e77-9a8e-d48dccbf861c tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:43:24.750503 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-e28993eb-8bbd-4e77-9a8e-d48dccbf861c tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:43:25.069274 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.policy [None req-e28993eb-8bbd-4e77-9a8e-d48dccbf861c tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e811736979c44b02b14fecb74c6bd7ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675272fb40d4847819f83ec04afecef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129321) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:43:25.086431 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.policy [None req-e28993eb-8bbd-4e77-9a8e-d48dccbf861c tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e811736979c44b02b14fecb74c6bd7ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675272fb40d4847819f83ec04afecef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129321) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:43:25.088150 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.policy [None req-e28993eb-8bbd-4e77-9a8e-d48dccbf861c tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e811736979c44b02b14fecb74c6bd7ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675272fb40d4847819f83ec04afecef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129321) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:43:25.089624 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: INFO nova.api.openstack.requestlog [None req-e28993eb-8bbd-4e77-9a8e-d48dccbf861c tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] 10.222.0.75 "GET /compute/v2.1/servers/bf2f6303-22b9-4cfa-8d4d-61d2503bc554" status: 200 len: 1741 microversion: 2.20 time: 0.365766 May 26 12:43:25.090383 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: [pid: 129321|app: 0|req: 315/651] 10.222.0.75 () {60 vars in 1276 bytes} [Thu May 26 12:43:24 2022] GET /compute/v2.1/servers/bf2f6303-22b9-4cfa-8d4d-61d2503bc554 => generated 1741 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 12:43:25.309840 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi [None req-251dd2df-027a-4903-9d94-1d8e58608f8c tempest-VolumesActionsTest-731506124 tempest-VolumesActionsTest-731506124-project] Calling method '>' {{(pid=129322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:43:25.310695 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.compute.api [None req-251dd2df-027a-4903-9d94-1d8e58608f8c tempest-VolumesActionsTest-731506124 tempest-VolumesActionsTest-731506124-project] [instance: 3fd057be-56c1-462d-8ea2-9ca668166ccf] Fetching instance by UUID {{(pid=129322) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:43:25.338381 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-251dd2df-027a-4903-9d94-1d8e58608f8c tempest-VolumesActionsTest-731506124 tempest-VolumesActionsTest-731506124-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:43:25.340068 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-251dd2df-027a-4903-9d94-1d8e58608f8c tempest-VolumesActionsTest-731506124 tempest-VolumesActionsTest-731506124-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:43:25.340957 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-251dd2df-027a-4903-9d94-1d8e58608f8c tempest-VolumesActionsTest-731506124 tempest-VolumesActionsTest-731506124-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:43:25.341398 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-251dd2df-027a-4903-9d94-1d8e58608f8c tempest-VolumesActionsTest-731506124 tempest-VolumesActionsTest-731506124-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:43:25.470316 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi [None req-8c7707a8-5919-4c89-bcb0-ee72824971f7 tempest-TestShelveInstance-546397589 tempest-TestShelveInstance-546397589-project] Calling method '>' {{(pid=129321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:43:25.471027 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.compute.api [None req-8c7707a8-5919-4c89-bcb0-ee72824971f7 tempest-TestShelveInstance-546397589 tempest-TestShelveInstance-546397589-project] [instance: 05cf529d-df00-4ff9-b0d2-0e27563d2861] Fetching instance by UUID {{(pid=129321) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:43:25.480807 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-8c7707a8-5919-4c89-bcb0-ee72824971f7 tempest-TestShelveInstance-546397589 tempest-TestShelveInstance-546397589-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:43:25.481531 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-8c7707a8-5919-4c89-bcb0-ee72824971f7 tempest-TestShelveInstance-546397589 tempest-TestShelveInstance-546397589-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:43:25.482439 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-8c7707a8-5919-4c89-bcb0-ee72824971f7 tempest-TestShelveInstance-546397589 tempest-TestShelveInstance-546397589-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:43:25.482964 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-8c7707a8-5919-4c89-bcb0-ee72824971f7 tempest-TestShelveInstance-546397589 tempest-TestShelveInstance-546397589-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:43:25.500342 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG dbcounter [-] [129321] Writing DB stats nova_cell1:SELECT=100 {{(pid=129321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:43:25.645519 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.policy [None req-251dd2df-027a-4903-9d94-1d8e58608f8c tempest-VolumesActionsTest-731506124 tempest-VolumesActionsTest-731506124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f39e076a9e6b401db6de9a2846519591', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa93879e60e470185e8dd71efaaf1a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129322) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:43:25.673134 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: INFO nova.api.openstack.requestlog [None req-251dd2df-027a-4903-9d94-1d8e58608f8c tempest-VolumesActionsTest-731506124 tempest-VolumesActionsTest-731506124-project] 10.222.0.75 "GET /compute/v2.1/servers/3fd057be-56c1-462d-8ea2-9ca668166ccf" status: 200 len: 1498 microversion: 2.1 time: 0.358902 May 26 12:43:25.674624 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: [pid: 129322|app: 0|req: 337/652] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 26 12:43:25 2022] GET /compute/v2.1/servers/3fd057be-56c1-462d-8ea2-9ca668166ccf => generated 1498 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:43:25.706096 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi [None req-7a22da5a-75d0-4ee4-8c74-3c49034fbb28 tempest-VolumesSnapshotTestJSON-1904508205 tempest-VolumesSnapshotTestJSON-1904508205-project] Calling method '>' {{(pid=129322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:43:25.707393 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.compute.api [None req-7a22da5a-75d0-4ee4-8c74-3c49034fbb28 tempest-VolumesSnapshotTestJSON-1904508205 tempest-VolumesSnapshotTestJSON-1904508205-project] [instance: 6a87df93-cf49-465a-80dd-102efb0f8b11] Fetching instance by UUID {{(pid=129322) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:43:25.717928 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-7a22da5a-75d0-4ee4-8c74-3c49034fbb28 tempest-VolumesSnapshotTestJSON-1904508205 tempest-VolumesSnapshotTestJSON-1904508205-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:43:25.718420 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.policy [None req-8c7707a8-5919-4c89-bcb0-ee72824971f7 tempest-TestShelveInstance-546397589 tempest-TestShelveInstance-546397589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d9bf2dcfce24386a1aaf9709d88da45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1f2f503ef674a4b97f848b69f8b63c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129321) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:43:25.719438 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-7a22da5a-75d0-4ee4-8c74-3c49034fbb28 tempest-VolumesSnapshotTestJSON-1904508205 tempest-VolumesSnapshotTestJSON-1904508205-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:43:25.720982 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-7a22da5a-75d0-4ee4-8c74-3c49034fbb28 tempest-VolumesSnapshotTestJSON-1904508205 tempest-VolumesSnapshotTestJSON-1904508205-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:43:25.721904 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-7a22da5a-75d0-4ee4-8c74-3c49034fbb28 tempest-VolumesSnapshotTestJSON-1904508205 tempest-VolumesSnapshotTestJSON-1904508205-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:43:25.734893 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: INFO nova.api.openstack.requestlog [None req-8c7707a8-5919-4c89-bcb0-ee72824971f7 tempest-TestShelveInstance-546397589 tempest-TestShelveInstance-546397589-project] 10.222.0.75 "GET /compute/v2.1/servers/05cf529d-df00-4ff9-b0d2-0e27563d2861" status: 200 len: 1443 microversion: 2.1 time: 0.270400 May 26 12:43:25.748777 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: [pid: 129321|app: 0|req: 316/653] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 26 12:43:25 2022] GET /compute/v2.1/servers/05cf529d-df00-4ff9-b0d2-0e27563d2861 => generated 1443 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 12:43:25.776609 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi [None req-6b16f526-eca9-48eb-83e2-786891f07745 tempest-TestShelveInstance-546397589 tempest-TestShelveInstance-546397589-project] Calling method '>' {{(pid=129321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:43:25.777736 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.compute.api [None req-6b16f526-eca9-48eb-83e2-786891f07745 tempest-TestShelveInstance-546397589 tempest-TestShelveInstance-546397589-project] [instance: 05cf529d-df00-4ff9-b0d2-0e27563d2861] Fetching instance by UUID {{(pid=129321) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:43:25.809951 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-6b16f526-eca9-48eb-83e2-786891f07745 tempest-TestShelveInstance-546397589 tempest-TestShelveInstance-546397589-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:43:25.810667 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-6b16f526-eca9-48eb-83e2-786891f07745 tempest-TestShelveInstance-546397589 tempest-TestShelveInstance-546397589-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:43:25.820771 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-6b16f526-eca9-48eb-83e2-786891f07745 tempest-TestShelveInstance-546397589 tempest-TestShelveInstance-546397589-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:43:25.821598 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-6b16f526-eca9-48eb-83e2-786891f07745 tempest-TestShelveInstance-546397589 tempest-TestShelveInstance-546397589-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:43:26.068099 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.policy [None req-6b16f526-eca9-48eb-83e2-786891f07745 tempest-TestShelveInstance-546397589 tempest-TestShelveInstance-546397589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d9bf2dcfce24386a1aaf9709d88da45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1f2f503ef674a4b97f848b69f8b63c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129321) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:43:26.079098 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: INFO nova.api.openstack.requestlog [None req-6b16f526-eca9-48eb-83e2-786891f07745 tempest-TestShelveInstance-546397589 tempest-TestShelveInstance-546397589-project] 10.222.0.75 "GET /compute/v2.1/servers/05cf529d-df00-4ff9-b0d2-0e27563d2861" status: 200 len: 1443 microversion: 2.1 time: 0.313833 May 26 12:43:26.079730 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: [pid: 129321|app: 0|req: 317/654] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 26 12:43:25 2022] GET /compute/v2.1/servers/05cf529d-df00-4ff9-b0d2-0e27563d2861 => generated 1443 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:43:26.112863 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi [None req-5cc7a6e9-df19-4c91-b3a5-47f40044494a tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Calling method '>' {{(pid=129321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:43:26.113484 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.compute.api [None req-5cc7a6e9-df19-4c91-b3a5-47f40044494a tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] [instance: bf2f6303-22b9-4cfa-8d4d-61d2503bc554] Fetching instance by UUID {{(pid=129321) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:43:26.121657 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG dbcounter [-] [129321] Writing DB stats nova_api:SELECT=100 {{(pid=129321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:43:26.128167 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-5cc7a6e9-df19-4c91-b3a5-47f40044494a tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:43:26.129100 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-5cc7a6e9-df19-4c91-b3a5-47f40044494a tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:43:26.130066 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-5cc7a6e9-df19-4c91-b3a5-47f40044494a tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:43:26.131979 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-5cc7a6e9-df19-4c91-b3a5-47f40044494a tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:43:26.377341 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.policy [None req-5cc7a6e9-df19-4c91-b3a5-47f40044494a tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e811736979c44b02b14fecb74c6bd7ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675272fb40d4847819f83ec04afecef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129321) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:43:26.387318 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.policy [None req-5cc7a6e9-df19-4c91-b3a5-47f40044494a tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e811736979c44b02b14fecb74c6bd7ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675272fb40d4847819f83ec04afecef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129321) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:43:26.389875 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.policy [None req-5cc7a6e9-df19-4c91-b3a5-47f40044494a tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e811736979c44b02b14fecb74c6bd7ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675272fb40d4847819f83ec04afecef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129321) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:43:26.392046 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: INFO nova.api.openstack.requestlog [None req-5cc7a6e9-df19-4c91-b3a5-47f40044494a tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] 10.222.0.75 "GET /compute/v2.1/servers/bf2f6303-22b9-4cfa-8d4d-61d2503bc554" status: 200 len: 1741 microversion: 2.20 time: 0.284070 May 26 12:43:26.392703 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: [pid: 129321|app: 0|req: 318/655] 10.222.0.75 () {60 vars in 1276 bytes} [Thu May 26 12:43:26 2022] GET /compute/v2.1/servers/bf2f6303-22b9-4cfa-8d4d-61d2503bc554 => generated 1741 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 26 12:43:26.448455 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.policy [None req-7a22da5a-75d0-4ee4-8c74-3c49034fbb28 tempest-VolumesSnapshotTestJSON-1904508205 tempest-VolumesSnapshotTestJSON-1904508205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '805854e5ce2e412fb9420afd63f73ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72bda4cbb07a43688506e01d06ba89c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129322) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:43:26.456933 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: INFO nova.api.openstack.requestlog [None req-7a22da5a-75d0-4ee4-8c74-3c49034fbb28 tempest-VolumesSnapshotTestJSON-1904508205 tempest-VolumesSnapshotTestJSON-1904508205-project] 10.222.0.75 "GET /compute/v2.1/servers/6a87df93-cf49-465a-80dd-102efb0f8b11" status: 200 len: 1319 microversion: 2.1 time: 0.757185 May 26 12:43:26.458070 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: [pid: 129322|app: 0|req: 338/656] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 26 12:43:25 2022] GET /compute/v2.1/servers/6a87df93-cf49-465a-80dd-102efb0f8b11 => generated 1319 bytes in 759 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:43:26.506576 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi [None req-8dc6ca7f-dbfa-47d8-83de-f883e6837a60 tempest-VolumesActionsTest-731506124 tempest-VolumesActionsTest-731506124-project] Calling method '>' {{(pid=129321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:43:26.507084 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.compute.api [None req-8dc6ca7f-dbfa-47d8-83de-f883e6837a60 tempest-VolumesActionsTest-731506124 tempest-VolumesActionsTest-731506124-project] [instance: 3fd057be-56c1-462d-8ea2-9ca668166ccf] Fetching instance by UUID {{(pid=129321) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:43:26.513545 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-8dc6ca7f-dbfa-47d8-83de-f883e6837a60 tempest-VolumesActionsTest-731506124 tempest-VolumesActionsTest-731506124-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:43:26.513984 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-8dc6ca7f-dbfa-47d8-83de-f883e6837a60 tempest-VolumesActionsTest-731506124 tempest-VolumesActionsTest-731506124-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:43:26.514751 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-8dc6ca7f-dbfa-47d8-83de-f883e6837a60 tempest-VolumesActionsTest-731506124 tempest-VolumesActionsTest-731506124-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:43:26.515161 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-8dc6ca7f-dbfa-47d8-83de-f883e6837a60 tempest-VolumesActionsTest-731506124 tempest-VolumesActionsTest-731506124-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:43:26.549857 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.compute.api [None req-8dc6ca7f-dbfa-47d8-83de-f883e6837a60 tempest-VolumesActionsTest-731506124 tempest-VolumesActionsTest-731506124-project] [instance: 3fd057be-56c1-462d-8ea2-9ca668166ccf] Going to try to terminate instance {{(pid=129321) delete /opt/stack/nova/nova/compute/api.py:2664}} May 26 12:43:26.633866 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: INFO nova.api.openstack.requestlog [None req-8dc6ca7f-dbfa-47d8-83de-f883e6837a60 tempest-VolumesActionsTest-731506124 tempest-VolumesActionsTest-731506124-project] 10.222.0.75 "DELETE /compute/v2.1/servers/3fd057be-56c1-462d-8ea2-9ca668166ccf" status: 204 len: 0 microversion: 2.1 time: 0.131504 May 26 12:43:26.634442 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: [pid: 129321|app: 0|req: 319/657] 10.222.0.75 () {58 vars in 1238 bytes} [Thu May 26 12:43:26 2022] DELETE /compute/v2.1/servers/3fd057be-56c1-462d-8ea2-9ca668166ccf => generated 0 bytes in 133 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 26 12:43:26.643357 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi [None req-dd63b9d5-c19a-4e13-88e4-f4f6543e43df tempest-VolumesActionsTest-731506124 tempest-VolumesActionsTest-731506124-project] Calling method '>' {{(pid=129322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:43:26.644118 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.compute.api [None req-dd63b9d5-c19a-4e13-88e4-f4f6543e43df tempest-VolumesActionsTest-731506124 tempest-VolumesActionsTest-731506124-project] [instance: 3fd057be-56c1-462d-8ea2-9ca668166ccf] Fetching instance by UUID {{(pid=129322) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:43:26.652635 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-dd63b9d5-c19a-4e13-88e4-f4f6543e43df tempest-VolumesActionsTest-731506124 tempest-VolumesActionsTest-731506124-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:43:26.653159 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-dd63b9d5-c19a-4e13-88e4-f4f6543e43df tempest-VolumesActionsTest-731506124 tempest-VolumesActionsTest-731506124-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:43:26.654174 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-dd63b9d5-c19a-4e13-88e4-f4f6543e43df tempest-VolumesActionsTest-731506124 tempest-VolumesActionsTest-731506124-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:43:26.655665 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-dd63b9d5-c19a-4e13-88e4-f4f6543e43df tempest-VolumesActionsTest-731506124 tempest-VolumesActionsTest-731506124-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:43:26.977728 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.policy [None req-dd63b9d5-c19a-4e13-88e4-f4f6543e43df tempest-VolumesActionsTest-731506124 tempest-VolumesActionsTest-731506124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f39e076a9e6b401db6de9a2846519591', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa93879e60e470185e8dd71efaaf1a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129322) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:43:26.985654 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: INFO nova.api.openstack.requestlog [None req-dd63b9d5-c19a-4e13-88e4-f4f6543e43df tempest-VolumesActionsTest-731506124 tempest-VolumesActionsTest-731506124-project] 10.222.0.75 "GET /compute/v2.1/servers/3fd057be-56c1-462d-8ea2-9ca668166ccf" status: 200 len: 1504 microversion: 2.1 time: 0.346500 May 26 12:43:26.986337 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: [pid: 129322|app: 0|req: 339/658] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 26 12:43:26 2022] GET /compute/v2.1/servers/3fd057be-56c1-462d-8ea2-9ca668166ccf => generated 1504 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:43:27.418045 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi [None req-013c8ae5-a5ae-4ba9-93b2-4e0e78d69305 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Calling method '>' {{(pid=129321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:43:27.418956 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.compute.api [None req-013c8ae5-a5ae-4ba9-93b2-4e0e78d69305 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] [instance: bf2f6303-22b9-4cfa-8d4d-61d2503bc554] Fetching instance by UUID {{(pid=129321) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:43:27.426383 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-013c8ae5-a5ae-4ba9-93b2-4e0e78d69305 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:43:27.426886 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-013c8ae5-a5ae-4ba9-93b2-4e0e78d69305 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:43:27.427626 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-013c8ae5-a5ae-4ba9-93b2-4e0e78d69305 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:43:27.428910 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-013c8ae5-a5ae-4ba9-93b2-4e0e78d69305 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:43:27.476088 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi [None req-a8d91742-130a-48d3-ad94-5ae4dabc8fed tempest-VolumesSnapshotTestJSON-1904508205 tempest-VolumesSnapshotTestJSON-1904508205-project] Calling method '>' {{(pid=129322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:43:27.476726 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.compute.api [None req-a8d91742-130a-48d3-ad94-5ae4dabc8fed tempest-VolumesSnapshotTestJSON-1904508205 tempest-VolumesSnapshotTestJSON-1904508205-project] [instance: 6a87df93-cf49-465a-80dd-102efb0f8b11] Fetching instance by UUID {{(pid=129322) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:43:27.491861 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-a8d91742-130a-48d3-ad94-5ae4dabc8fed tempest-VolumesSnapshotTestJSON-1904508205 tempest-VolumesSnapshotTestJSON-1904508205-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:43:27.492600 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-a8d91742-130a-48d3-ad94-5ae4dabc8fed tempest-VolumesSnapshotTestJSON-1904508205 tempest-VolumesSnapshotTestJSON-1904508205-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:43:27.493582 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-a8d91742-130a-48d3-ad94-5ae4dabc8fed tempest-VolumesSnapshotTestJSON-1904508205 tempest-VolumesSnapshotTestJSON-1904508205-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:43:27.493987 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-a8d91742-130a-48d3-ad94-5ae4dabc8fed tempest-VolumesSnapshotTestJSON-1904508205 tempest-VolumesSnapshotTestJSON-1904508205-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:43:27.589808 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.policy [None req-013c8ae5-a5ae-4ba9-93b2-4e0e78d69305 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e811736979c44b02b14fecb74c6bd7ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675272fb40d4847819f83ec04afecef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129321) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:43:27.598206 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.policy [None req-013c8ae5-a5ae-4ba9-93b2-4e0e78d69305 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e811736979c44b02b14fecb74c6bd7ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675272fb40d4847819f83ec04afecef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129321) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:43:27.599809 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.policy [None req-013c8ae5-a5ae-4ba9-93b2-4e0e78d69305 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e811736979c44b02b14fecb74c6bd7ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675272fb40d4847819f83ec04afecef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129321) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:43:27.601125 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: INFO nova.api.openstack.requestlog [None req-013c8ae5-a5ae-4ba9-93b2-4e0e78d69305 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] 10.222.0.75 "GET /compute/v2.1/servers/bf2f6303-22b9-4cfa-8d4d-61d2503bc554" status: 200 len: 1741 microversion: 2.20 time: 0.188065 May 26 12:43:27.602211 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: [pid: 129321|app: 0|req: 320/659] 10.222.0.75 () {60 vars in 1276 bytes} [Thu May 26 12:43:27 2022] GET /compute/v2.1/servers/bf2f6303-22b9-4cfa-8d4d-61d2503bc554 => generated 1741 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 12:43:27.795888 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.policy [None req-a8d91742-130a-48d3-ad94-5ae4dabc8fed tempest-VolumesSnapshotTestJSON-1904508205 tempest-VolumesSnapshotTestJSON-1904508205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '805854e5ce2e412fb9420afd63f73ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72bda4cbb07a43688506e01d06ba89c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129322) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:43:27.804426 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: INFO nova.api.openstack.requestlog [None req-a8d91742-130a-48d3-ad94-5ae4dabc8fed tempest-VolumesSnapshotTestJSON-1904508205 tempest-VolumesSnapshotTestJSON-1904508205-project] 10.222.0.75 "GET /compute/v2.1/servers/6a87df93-cf49-465a-80dd-102efb0f8b11" status: 200 len: 1319 microversion: 2.1 time: 0.332603 May 26 12:43:27.805026 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: [pid: 129322|app: 0|req: 340/660] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 26 12:43:27 2022] GET /compute/v2.1/servers/6a87df93-cf49-465a-80dd-102efb0f8b11 => generated 1319 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:43:28.005853 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi [None req-1cbefbc2-487b-47a9-afb2-f6c75df6345b tempest-VolumesActionsTest-731506124 tempest-VolumesActionsTest-731506124-project] Calling method '>' {{(pid=129321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:43:28.006609 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.compute.api [None req-1cbefbc2-487b-47a9-afb2-f6c75df6345b tempest-VolumesActionsTest-731506124 tempest-VolumesActionsTest-731506124-project] [instance: 3fd057be-56c1-462d-8ea2-9ca668166ccf] Fetching instance by UUID {{(pid=129321) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:43:28.013597 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-1cbefbc2-487b-47a9-afb2-f6c75df6345b tempest-VolumesActionsTest-731506124 tempest-VolumesActionsTest-731506124-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:43:28.014026 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-1cbefbc2-487b-47a9-afb2-f6c75df6345b tempest-VolumesActionsTest-731506124 tempest-VolumesActionsTest-731506124-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:43:28.014811 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-1cbefbc2-487b-47a9-afb2-f6c75df6345b tempest-VolumesActionsTest-731506124 tempest-VolumesActionsTest-731506124-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:43:28.015240 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-1cbefbc2-487b-47a9-afb2-f6c75df6345b tempest-VolumesActionsTest-731506124 tempest-VolumesActionsTest-731506124-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:43:28.169090 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.policy [None req-1cbefbc2-487b-47a9-afb2-f6c75df6345b tempest-VolumesActionsTest-731506124 tempest-VolumesActionsTest-731506124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f39e076a9e6b401db6de9a2846519591', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa93879e60e470185e8dd71efaaf1a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129321) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:43:28.178768 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: INFO nova.api.openstack.requestlog [None req-1cbefbc2-487b-47a9-afb2-f6c75df6345b tempest-VolumesActionsTest-731506124 tempest-VolumesActionsTest-731506124-project] 10.222.0.75 "GET /compute/v2.1/servers/3fd057be-56c1-462d-8ea2-9ca668166ccf" status: 200 len: 1504 microversion: 2.1 time: 0.176675 May 26 12:43:28.179400 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: [pid: 129321|app: 0|req: 321/661] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 26 12:43:28 2022] GET /compute/v2.1/servers/3fd057be-56c1-462d-8ea2-9ca668166ccf => generated 1504 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:43:28.234619 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi [req-4e1e14e3-421f-403f-a312-97e12c220a0c req-c619aeae-b88f-4482-b95d-13787263482d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "76661008-e6d3-4646-a9ba-d5d0e83a4b65", "tag": "4aebdf54-88c1-42d5-a224-778a4410cff0"}]} {{(pid=129322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 12:43:28.244636 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [req-4e1e14e3-421f-403f-a312-97e12c220a0c req-c619aeae-b88f-4482-b95d-13787263482d service nova] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:43:28.245393 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [req-4e1e14e3-421f-403f-a312-97e12c220a0c req-c619aeae-b88f-4482-b95d-13787263482d service nova] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:43:28.260392 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: INFO nova.api.openstack.compute.server_external_events [req-4e1e14e3-421f-403f-a312-97e12c220a0c req-c619aeae-b88f-4482-b95d-13787263482d service nova] Creating event network-changed:4aebdf54-88c1-42d5-a224-778a4410cff0 for instance 76661008-e6d3-4646-a9ba-d5d0e83a4b65 on hv-cinder-81966 May 26 12:43:28.270705 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: INFO nova.api.openstack.requestlog [req-4e1e14e3-421f-403f-a312-97e12c220a0c req-c619aeae-b88f-4482-b95d-13787263482d service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039512 May 26 12:43:28.271874 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: [pid: 129322|app: 0|req: 341/662] 10.222.0.75 () {64 vars in 1317 bytes} [Thu May 26 12:43:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 12:43:28.628595 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi [None req-8093ebe3-a307-49ca-9135-a374102757d3 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Calling method '>' {{(pid=129321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:43:28.629894 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.compute.api [None req-8093ebe3-a307-49ca-9135-a374102757d3 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] [instance: bf2f6303-22b9-4cfa-8d4d-61d2503bc554] Fetching instance by UUID {{(pid=129321) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:43:28.638177 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-8093ebe3-a307-49ca-9135-a374102757d3 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:43:28.639302 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-8093ebe3-a307-49ca-9135-a374102757d3 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:43:28.640517 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-8093ebe3-a307-49ca-9135-a374102757d3 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:43:28.641156 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-8093ebe3-a307-49ca-9135-a374102757d3 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:43:28.824912 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi [None req-33cb69f0-1ded-44de-b46a-6f92beb820ea tempest-VolumesSnapshotTestJSON-1904508205 tempest-VolumesSnapshotTestJSON-1904508205-project] Calling method '>' {{(pid=129322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:43:28.826502 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.compute.api [None req-33cb69f0-1ded-44de-b46a-6f92beb820ea tempest-VolumesSnapshotTestJSON-1904508205 tempest-VolumesSnapshotTestJSON-1904508205-project] [instance: 6a87df93-cf49-465a-80dd-102efb0f8b11] Fetching instance by UUID {{(pid=129322) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:43:28.836869 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-33cb69f0-1ded-44de-b46a-6f92beb820ea tempest-VolumesSnapshotTestJSON-1904508205 tempest-VolumesSnapshotTestJSON-1904508205-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:43:28.837958 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-33cb69f0-1ded-44de-b46a-6f92beb820ea tempest-VolumesSnapshotTestJSON-1904508205 tempest-VolumesSnapshotTestJSON-1904508205-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:43:28.839350 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-33cb69f0-1ded-44de-b46a-6f92beb820ea tempest-VolumesSnapshotTestJSON-1904508205 tempest-VolumesSnapshotTestJSON-1904508205-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:43:28.840224 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-33cb69f0-1ded-44de-b46a-6f92beb820ea tempest-VolumesSnapshotTestJSON-1904508205 tempest-VolumesSnapshotTestJSON-1904508205-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:43:28.873091 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.policy [None req-8093ebe3-a307-49ca-9135-a374102757d3 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e811736979c44b02b14fecb74c6bd7ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675272fb40d4847819f83ec04afecef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129321) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:43:28.884747 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.policy [None req-8093ebe3-a307-49ca-9135-a374102757d3 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e811736979c44b02b14fecb74c6bd7ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675272fb40d4847819f83ec04afecef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129321) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:43:28.886293 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.policy [None req-8093ebe3-a307-49ca-9135-a374102757d3 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e811736979c44b02b14fecb74c6bd7ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675272fb40d4847819f83ec04afecef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129321) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:43:28.887878 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: INFO nova.api.openstack.requestlog [None req-8093ebe3-a307-49ca-9135-a374102757d3 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] 10.222.0.75 "GET /compute/v2.1/servers/bf2f6303-22b9-4cfa-8d4d-61d2503bc554" status: 200 len: 1741 microversion: 2.20 time: 0.263227 May 26 12:43:28.888789 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: [pid: 129321|app: 0|req: 322/663] 10.222.0.75 () {60 vars in 1276 bytes} [Thu May 26 12:43:28 2022] GET /compute/v2.1/servers/bf2f6303-22b9-4cfa-8d4d-61d2503bc554 => generated 1741 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 26 12:43:29.211160 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi [None req-01097eb0-aef3-4553-a878-f397a50debd4 tempest-VolumesActionsTest-731506124 tempest-VolumesActionsTest-731506124-project] Calling method '>' {{(pid=129321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:43:29.212397 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.policy [None req-33cb69f0-1ded-44de-b46a-6f92beb820ea tempest-VolumesSnapshotTestJSON-1904508205 tempest-VolumesSnapshotTestJSON-1904508205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '805854e5ce2e412fb9420afd63f73ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72bda4cbb07a43688506e01d06ba89c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129322) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:43:29.212690 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.compute.api [None req-01097eb0-aef3-4553-a878-f397a50debd4 tempest-VolumesActionsTest-731506124 tempest-VolumesActionsTest-731506124-project] [instance: 3fd057be-56c1-462d-8ea2-9ca668166ccf] Fetching instance by UUID {{(pid=129321) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:43:29.223570 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-01097eb0-aef3-4553-a878-f397a50debd4 tempest-VolumesActionsTest-731506124 tempest-VolumesActionsTest-731506124-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:43:29.224336 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-01097eb0-aef3-4553-a878-f397a50debd4 tempest-VolumesActionsTest-731506124 tempest-VolumesActionsTest-731506124-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:43:29.226072 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-01097eb0-aef3-4553-a878-f397a50debd4 tempest-VolumesActionsTest-731506124 tempest-VolumesActionsTest-731506124-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:43:29.228192 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-01097eb0-aef3-4553-a878-f397a50debd4 tempest-VolumesActionsTest-731506124 tempest-VolumesActionsTest-731506124-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:43:29.235339 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: INFO nova.api.openstack.requestlog [None req-33cb69f0-1ded-44de-b46a-6f92beb820ea tempest-VolumesSnapshotTestJSON-1904508205 tempest-VolumesSnapshotTestJSON-1904508205-project] 10.222.0.75 "GET /compute/v2.1/servers/6a87df93-cf49-465a-80dd-102efb0f8b11" status: 200 len: 1319 microversion: 2.1 time: 0.413913 May 26 12:43:29.237446 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: [pid: 129322|app: 0|req: 342/664] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 26 12:43:28 2022] GET /compute/v2.1/servers/6a87df93-cf49-465a-80dd-102efb0f8b11 => generated 1319 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:43:29.438127 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.policy [None req-01097eb0-aef3-4553-a878-f397a50debd4 tempest-VolumesActionsTest-731506124 tempest-VolumesActionsTest-731506124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f39e076a9e6b401db6de9a2846519591', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa93879e60e470185e8dd71efaaf1a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129321) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:43:29.450786 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: INFO nova.api.openstack.requestlog [None req-01097eb0-aef3-4553-a878-f397a50debd4 tempest-VolumesActionsTest-731506124 tempest-VolumesActionsTest-731506124-project] 10.222.0.75 "GET /compute/v2.1/servers/3fd057be-56c1-462d-8ea2-9ca668166ccf" status: 200 len: 1504 microversion: 2.1 time: 0.252273 May 26 12:43:29.464133 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: [pid: 129321|app: 0|req: 323/665] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 26 12:43:29 2022] GET /compute/v2.1/servers/3fd057be-56c1-462d-8ea2-9ca668166ccf => generated 1504 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:43:29.892492 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi [None req-f21ac5d8-e5ab-42e2-bc28-414d85d16526 tempest-TestMinimumBasicScenario-102576986 tempest-TestMinimumBasicScenario-102576986-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-291455924"}} {{(pid=129322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 12:43:29.894439 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.compute.api [None req-f21ac5d8-e5ab-42e2-bc28-414d85d16526 tempest-TestMinimumBasicScenario-102576986 tempest-TestMinimumBasicScenario-102576986-project] [instance: 76661008-e6d3-4646-a9ba-d5d0e83a4b65] Fetching instance by UUID {{(pid=129322) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:43:29.904471 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-f21ac5d8-e5ab-42e2-bc28-414d85d16526 tempest-TestMinimumBasicScenario-102576986 tempest-TestMinimumBasicScenario-102576986-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:43:29.905065 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-f21ac5d8-e5ab-42e2-bc28-414d85d16526 tempest-TestMinimumBasicScenario-102576986 tempest-TestMinimumBasicScenario-102576986-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:43:29.906574 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-f21ac5d8-e5ab-42e2-bc28-414d85d16526 tempest-TestMinimumBasicScenario-102576986 tempest-TestMinimumBasicScenario-102576986-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:43:29.906574 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-f21ac5d8-e5ab-42e2-bc28-414d85d16526 tempest-TestMinimumBasicScenario-102576986 tempest-TestMinimumBasicScenario-102576986-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:43:29.908513 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi [None req-fbafb20e-afd9-434b-af1c-e8d01b9a9300 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Calling method '>' {{(pid=129321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:43:29.909280 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.compute.api [None req-fbafb20e-afd9-434b-af1c-e8d01b9a9300 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] [instance: bf2f6303-22b9-4cfa-8d4d-61d2503bc554] Fetching instance by UUID {{(pid=129321) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:43:29.916283 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-fbafb20e-afd9-434b-af1c-e8d01b9a9300 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:43:29.917450 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-fbafb20e-afd9-434b-af1c-e8d01b9a9300 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:43:29.918484 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-fbafb20e-afd9-434b-af1c-e8d01b9a9300 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:43:29.919123 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-fbafb20e-afd9-434b-af1c-e8d01b9a9300 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:43:30.092357 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: INFO nova.network.security_group_api [None req-f21ac5d8-e5ab-42e2-bc28-414d85d16526 tempest-TestMinimumBasicScenario-102576986 tempest-TestMinimumBasicScenario-102576986-project] Adding security group 3370a4d8-716a-4536-a60f-b07cbf0f7ade to port 4aebdf54-88c1-42d5-a224-778a4410cff0 May 26 12:43:30.108711 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.policy [None req-fbafb20e-afd9-434b-af1c-e8d01b9a9300 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e811736979c44b02b14fecb74c6bd7ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675272fb40d4847819f83ec04afecef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129321) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:43:30.121601 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.policy [None req-fbafb20e-afd9-434b-af1c-e8d01b9a9300 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e811736979c44b02b14fecb74c6bd7ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675272fb40d4847819f83ec04afecef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129321) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:43:30.125004 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.policy [None req-fbafb20e-afd9-434b-af1c-e8d01b9a9300 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e811736979c44b02b14fecb74c6bd7ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675272fb40d4847819f83ec04afecef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129321) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:43:30.126937 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: INFO nova.api.openstack.requestlog [None req-fbafb20e-afd9-434b-af1c-e8d01b9a9300 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] 10.222.0.75 "GET /compute/v2.1/servers/bf2f6303-22b9-4cfa-8d4d-61d2503bc554" status: 200 len: 1723 microversion: 2.20 time: 0.222275 May 26 12:43:30.127949 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: [pid: 129321|app: 0|req: 324/666] 10.222.0.75 () {60 vars in 1276 bytes} [Thu May 26 12:43:29 2022] GET /compute/v2.1/servers/bf2f6303-22b9-4cfa-8d4d-61d2503bc554 => generated 1723 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 12:43:30.257798 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi [None req-c7303633-d813-46e6-96bc-60b92bed7b2d tempest-VolumesSnapshotTestJSON-1904508205 tempest-VolumesSnapshotTestJSON-1904508205-project] Calling method '>' {{(pid=129321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:43:30.258705 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.compute.api [None req-c7303633-d813-46e6-96bc-60b92bed7b2d tempest-VolumesSnapshotTestJSON-1904508205 tempest-VolumesSnapshotTestJSON-1904508205-project] [instance: 6a87df93-cf49-465a-80dd-102efb0f8b11] Fetching instance by UUID {{(pid=129321) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:43:30.265527 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-c7303633-d813-46e6-96bc-60b92bed7b2d tempest-VolumesSnapshotTestJSON-1904508205 tempest-VolumesSnapshotTestJSON-1904508205-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:43:30.266254 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-c7303633-d813-46e6-96bc-60b92bed7b2d tempest-VolumesSnapshotTestJSON-1904508205 tempest-VolumesSnapshotTestJSON-1904508205-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:43:30.267022 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-c7303633-d813-46e6-96bc-60b92bed7b2d tempest-VolumesSnapshotTestJSON-1904508205 tempest-VolumesSnapshotTestJSON-1904508205-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:43:30.267678 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-c7303633-d813-46e6-96bc-60b92bed7b2d tempest-VolumesSnapshotTestJSON-1904508205 tempest-VolumesSnapshotTestJSON-1904508205-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:43:30.455061 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.policy [None req-c7303633-d813-46e6-96bc-60b92bed7b2d tempest-VolumesSnapshotTestJSON-1904508205 tempest-VolumesSnapshotTestJSON-1904508205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '805854e5ce2e412fb9420afd63f73ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72bda4cbb07a43688506e01d06ba89c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129321) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:43:30.465576 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: INFO nova.api.openstack.requestlog [None req-c7303633-d813-46e6-96bc-60b92bed7b2d tempest-VolumesSnapshotTestJSON-1904508205 tempest-VolumesSnapshotTestJSON-1904508205-project] 10.222.0.75 "GET /compute/v2.1/servers/6a87df93-cf49-465a-80dd-102efb0f8b11" status: 200 len: 1507 microversion: 2.1 time: 0.213232 May 26 12:43:30.466095 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: [pid: 129321|app: 0|req: 325/667] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 26 12:43:30 2022] GET /compute/v2.1/servers/6a87df93-cf49-465a-80dd-102efb0f8b11 => generated 1507 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:43:30.478810 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi [req-a9b50d86-a66d-4334-b351-28bd6674fa48 req-cbb96d9d-1d26-4a87-80e8-d423043260a4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "05cf529d-df00-4ff9-b0d2-0e27563d2861", "tag": "6408ddad-3849-44bf-b29b-b7e4852f543d"}]} {{(pid=129321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 12:43:30.489266 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [req-a9b50d86-a66d-4334-b351-28bd6674fa48 req-cbb96d9d-1d26-4a87-80e8-d423043260a4 service nova] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:43:30.490022 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [req-a9b50d86-a66d-4334-b351-28bd6674fa48 req-cbb96d9d-1d26-4a87-80e8-d423043260a4 service nova] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:43:30.505204 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: INFO nova.api.openstack.compute.server_external_events [req-a9b50d86-a66d-4334-b351-28bd6674fa48 req-cbb96d9d-1d26-4a87-80e8-d423043260a4 service nova] Creating event network-changed:6408ddad-3849-44bf-b29b-b7e4852f543d for instance 05cf529d-df00-4ff9-b0d2-0e27563d2861 on hv-cinder-81966 May 26 12:43:30.521008 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: INFO nova.api.openstack.requestlog [req-a9b50d86-a66d-4334-b351-28bd6674fa48 req-cbb96d9d-1d26-4a87-80e8-d423043260a4 service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053570 May 26 12:43:30.524003 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: [pid: 129321|app: 0|req: 326/668] 10.222.0.75 () {64 vars in 1317 bytes} [Thu May 26 12:43:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 12:43:30.536150 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi [None req-37b5ef5f-ee74-40f5-97cc-61416242fc2c tempest-VolumesActionsTest-731506124 tempest-VolumesActionsTest-731506124-project] Calling method '>' {{(pid=129321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:43:30.537100 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.compute.api [None req-37b5ef5f-ee74-40f5-97cc-61416242fc2c tempest-VolumesActionsTest-731506124 tempest-VolumesActionsTest-731506124-project] [instance: 3fd057be-56c1-462d-8ea2-9ca668166ccf] Fetching instance by UUID {{(pid=129321) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:43:30.544981 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-37b5ef5f-ee74-40f5-97cc-61416242fc2c tempest-VolumesActionsTest-731506124 tempest-VolumesActionsTest-731506124-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:43:30.545681 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-37b5ef5f-ee74-40f5-97cc-61416242fc2c tempest-VolumesActionsTest-731506124 tempest-VolumesActionsTest-731506124-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:43:30.546738 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-37b5ef5f-ee74-40f5-97cc-61416242fc2c tempest-VolumesActionsTest-731506124 tempest-VolumesActionsTest-731506124-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:43:30.547351 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-37b5ef5f-ee74-40f5-97cc-61416242fc2c tempest-VolumesActionsTest-731506124 tempest-VolumesActionsTest-731506124-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:43:30.665530 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: INFO nova.api.openstack.requestlog [None req-f21ac5d8-e5ab-42e2-bc28-414d85d16526 tempest-TestMinimumBasicScenario-102576986 tempest-TestMinimumBasicScenario-102576986-project] 10.222.0.75 "POST /compute/v2.1/servers/76661008-e6d3-4646-a9ba-d5d0e83a4b65/action" status: 202 len: 0 microversion: 2.1 time: 0.780331 May 26 12:43:30.666664 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: [pid: 129322|app: 0|req: 343/669] 10.222.0.75 () {60 vars in 1277 bytes} [Thu May 26 12:43:29 2022] POST /compute/v2.1/servers/76661008-e6d3-4646-a9ba-d5d0e83a4b65/action => generated 0 bytes in 783 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 26 12:43:30.672644 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi [None req-b4281f03-649e-49f2-8b74-79fe6052d26b tempest-VolumesSnapshotTestJSON-1904508205 tempest-VolumesSnapshotTestJSON-1904508205-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e8006328-9910-4679-b64c-db32c8ba4810", "device": "/dev/sdb"}} {{(pid=129322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 12:43:30.674585 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.compute.api [None req-b4281f03-649e-49f2-8b74-79fe6052d26b tempest-VolumesSnapshotTestJSON-1904508205 tempest-VolumesSnapshotTestJSON-1904508205-project] [instance: 6a87df93-cf49-465a-80dd-102efb0f8b11] Fetching instance by UUID {{(pid=129322) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:43:30.696035 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-b4281f03-649e-49f2-8b74-79fe6052d26b tempest-VolumesSnapshotTestJSON-1904508205 tempest-VolumesSnapshotTestJSON-1904508205-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:43:30.697868 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-b4281f03-649e-49f2-8b74-79fe6052d26b tempest-VolumesSnapshotTestJSON-1904508205 tempest-VolumesSnapshotTestJSON-1904508205-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:43:30.698834 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-b4281f03-649e-49f2-8b74-79fe6052d26b tempest-VolumesSnapshotTestJSON-1904508205 tempest-VolumesSnapshotTestJSON-1904508205-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:43:30.710551 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-b4281f03-649e-49f2-8b74-79fe6052d26b tempest-VolumesSnapshotTestJSON-1904508205 tempest-VolumesSnapshotTestJSON-1904508205-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:43:31.166172 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG dbcounter [-] [129322] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=2 {{(pid=129322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:43:31.182091 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: INFO nova.api.openstack.requestlog [None req-b4281f03-649e-49f2-8b74-79fe6052d26b tempest-VolumesSnapshotTestJSON-1904508205 tempest-VolumesSnapshotTestJSON-1904508205-project] 10.222.0.75 "POST /compute/v2.1/servers/6a87df93-cf49-465a-80dd-102efb0f8b11/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.513758 May 26 12:43:31.183069 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: [pid: 129322|app: 0|req: 344/670] 10.222.0.75 () {60 vars in 1322 bytes} [Thu May 26 12:43:30 2022] POST /compute/v2.1/servers/6a87df93-cf49-465a-80dd-102efb0f8b11/os-volume_attachments => generated 194 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 12:43:31.213908 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi [None req-d7bfc298-e8f5-480d-9b0a-975d14694dce tempest-TestMinimumBasicScenario-102576986 tempest-TestMinimumBasicScenario-102576986-project] Calling method '>' {{(pid=129322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:43:31.215006 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.compute.api [None req-d7bfc298-e8f5-480d-9b0a-975d14694dce tempest-TestMinimumBasicScenario-102576986 tempest-TestMinimumBasicScenario-102576986-project] [instance: 76661008-e6d3-4646-a9ba-d5d0e83a4b65] Fetching instance by UUID {{(pid=129322) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:43:31.223797 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-d7bfc298-e8f5-480d-9b0a-975d14694dce tempest-TestMinimumBasicScenario-102576986 tempest-TestMinimumBasicScenario-102576986-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:43:31.224589 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-d7bfc298-e8f5-480d-9b0a-975d14694dce tempest-TestMinimumBasicScenario-102576986 tempest-TestMinimumBasicScenario-102576986-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:43:31.227151 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-d7bfc298-e8f5-480d-9b0a-975d14694dce tempest-TestMinimumBasicScenario-102576986 tempest-TestMinimumBasicScenario-102576986-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:43:31.227987 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-d7bfc298-e8f5-480d-9b0a-975d14694dce tempest-TestMinimumBasicScenario-102576986 tempest-TestMinimumBasicScenario-102576986-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:43:31.474059 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.policy [None req-d7bfc298-e8f5-480d-9b0a-975d14694dce tempest-TestMinimumBasicScenario-102576986 tempest-TestMinimumBasicScenario-102576986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0352a80bdc174b9a9df4eca60b81eba4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fa2c4d6423444e487d259062656129b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129322) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:43:31.492691 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: INFO nova.api.openstack.requestlog [None req-d7bfc298-e8f5-480d-9b0a-975d14694dce tempest-TestMinimumBasicScenario-102576986 tempest-TestMinimumBasicScenario-102576986-project] 10.222.0.75 "GET /compute/v2.1/servers/76661008-e6d3-4646-a9ba-d5d0e83a4b65" status: 200 len: 1639 microversion: 2.1 time: 0.290710 May 26 12:43:31.495876 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: [pid: 129322|app: 0|req: 345/671] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 26 12:43:31 2022] GET /compute/v2.1/servers/76661008-e6d3-4646-a9ba-d5d0e83a4b65 => generated 1639 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:43:31.501863 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi [None req-e160726e-8ced-41b7-ad26-208e623aff21 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Calling method '>' {{(pid=129322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:43:31.502795 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.compute.api [None req-e160726e-8ced-41b7-ad26-208e623aff21 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] [instance: bf2f6303-22b9-4cfa-8d4d-61d2503bc554] Fetching instance by UUID {{(pid=129322) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:43:31.512612 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-e160726e-8ced-41b7-ad26-208e623aff21 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:43:31.513257 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-e160726e-8ced-41b7-ad26-208e623aff21 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:43:31.514255 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-e160726e-8ced-41b7-ad26-208e623aff21 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:43:31.515070 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-e160726e-8ced-41b7-ad26-208e623aff21 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:43:31.609992 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.policy [None req-37b5ef5f-ee74-40f5-97cc-61416242fc2c tempest-VolumesActionsTest-731506124 tempest-VolumesActionsTest-731506124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f39e076a9e6b401db6de9a2846519591', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa93879e60e470185e8dd71efaaf1a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129321) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:43:31.625106 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: INFO nova.api.openstack.requestlog [None req-37b5ef5f-ee74-40f5-97cc-61416242fc2c tempest-VolumesActionsTest-731506124 tempest-VolumesActionsTest-731506124-project] 10.222.0.75 "GET /compute/v2.1/servers/3fd057be-56c1-462d-8ea2-9ca668166ccf" status: 200 len: 1504 microversion: 2.1 time: 1.093710 May 26 12:43:31.630150 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: [pid: 129321|app: 0|req: 327/672] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 26 12:43:30 2022] GET /compute/v2.1/servers/3fd057be-56c1-462d-8ea2-9ca668166ccf => generated 1504 bytes in 1105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:43:31.688911 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.policy [None req-e160726e-8ced-41b7-ad26-208e623aff21 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e811736979c44b02b14fecb74c6bd7ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675272fb40d4847819f83ec04afecef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129322) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:43:31.706782 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.policy [None req-e160726e-8ced-41b7-ad26-208e623aff21 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e811736979c44b02b14fecb74c6bd7ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675272fb40d4847819f83ec04afecef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129322) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:43:31.708575 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.policy [None req-e160726e-8ced-41b7-ad26-208e623aff21 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e811736979c44b02b14fecb74c6bd7ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675272fb40d4847819f83ec04afecef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129322) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:43:31.710742 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: INFO nova.api.openstack.requestlog [None req-e160726e-8ced-41b7-ad26-208e623aff21 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] 10.222.0.75 "GET /compute/v2.1/servers/bf2f6303-22b9-4cfa-8d4d-61d2503bc554" status: 200 len: 1723 microversion: 2.20 time: 0.212761 May 26 12:43:31.725169 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: [pid: 129322|app: 0|req: 346/673] 10.222.0.75 () {60 vars in 1276 bytes} [Thu May 26 12:43:31 2022] GET /compute/v2.1/servers/bf2f6303-22b9-4cfa-8d4d-61d2503bc554 => generated 1723 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 12:43:31.828076 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi [req-15383244-3e02-48df-858c-c2f234571dea req-34edc350-99d8-44ac-aec1-bf57c31c39af service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bf2f6303-22b9-4cfa-8d4d-61d2503bc554", "name": "network-vif-unplugged", "status": "completed", "tag": "fe40ed8f-f450-48f7-876a-abe2fea7abe5"}]} {{(pid=129321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 12:43:31.837299 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [req-15383244-3e02-48df-858c-c2f234571dea req-34edc350-99d8-44ac-aec1-bf57c31c39af service nova] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:43:31.838160 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [req-15383244-3e02-48df-858c-c2f234571dea req-34edc350-99d8-44ac-aec1-bf57c31c39af service nova] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:43:31.853011 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: INFO nova.api.openstack.compute.server_external_events [req-15383244-3e02-48df-858c-c2f234571dea req-34edc350-99d8-44ac-aec1-bf57c31c39af service nova] Creating event network-vif-unplugged:fe40ed8f-f450-48f7-876a-abe2fea7abe5 for instance bf2f6303-22b9-4cfa-8d4d-61d2503bc554 on hv-cinder-81966 May 26 12:43:31.859060 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: INFO nova.api.openstack.requestlog [req-15383244-3e02-48df-858c-c2f234571dea req-34edc350-99d8-44ac-aec1-bf57c31c39af service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.034813 May 26 12:43:31.860446 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: [pid: 129321|app: 0|req: 328/674] 10.222.0.75 () {64 vars in 1317 bytes} [Thu May 26 12:43:31 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 12:43:32.543627 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi [req-cae92c6d-da4a-47cc-b31a-889e77cec1ac req-3d3a60d3-0759-4a3b-a1cc-7d7e8b8b847d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "76661008-e6d3-4646-a9ba-d5d0e83a4b65", "tag": "4aebdf54-88c1-42d5-a224-778a4410cff0"}]} {{(pid=129322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 12:43:32.555972 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [req-cae92c6d-da4a-47cc-b31a-889e77cec1ac req-3d3a60d3-0759-4a3b-a1cc-7d7e8b8b847d service nova] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:43:32.556526 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [req-cae92c6d-da4a-47cc-b31a-889e77cec1ac req-3d3a60d3-0759-4a3b-a1cc-7d7e8b8b847d service nova] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:43:32.573305 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: INFO nova.api.openstack.compute.server_external_events [req-cae92c6d-da4a-47cc-b31a-889e77cec1ac req-3d3a60d3-0759-4a3b-a1cc-7d7e8b8b847d service nova] Creating event network-changed:4aebdf54-88c1-42d5-a224-778a4410cff0 for instance 76661008-e6d3-4646-a9ba-d5d0e83a4b65 on hv-cinder-81966 May 26 12:43:32.579919 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: INFO nova.api.openstack.requestlog [req-cae92c6d-da4a-47cc-b31a-889e77cec1ac req-3d3a60d3-0759-4a3b-a1cc-7d7e8b8b847d service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039819 May 26 12:43:32.581162 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: [pid: 129322|app: 0|req: 347/675] 10.222.0.75 () {64 vars in 1317 bytes} [Thu May 26 12:43:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 12:43:32.647786 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi [None req-21411a01-fa9a-43e0-8cb1-50cf520254b1 tempest-VolumesActionsTest-731506124 tempest-VolumesActionsTest-731506124-project] Calling method '>' {{(pid=129321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:43:32.648547 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.compute.api [None req-21411a01-fa9a-43e0-8cb1-50cf520254b1 tempest-VolumesActionsTest-731506124 tempest-VolumesActionsTest-731506124-project] [instance: 3fd057be-56c1-462d-8ea2-9ca668166ccf] Fetching instance by UUID {{(pid=129321) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:43:32.655656 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-21411a01-fa9a-43e0-8cb1-50cf520254b1 tempest-VolumesActionsTest-731506124 tempest-VolumesActionsTest-731506124-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:43:32.656114 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-21411a01-fa9a-43e0-8cb1-50cf520254b1 tempest-VolumesActionsTest-731506124 tempest-VolumesActionsTest-731506124-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:43:32.656900 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-21411a01-fa9a-43e0-8cb1-50cf520254b1 tempest-VolumesActionsTest-731506124 tempest-VolumesActionsTest-731506124-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:43:32.657341 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-21411a01-fa9a-43e0-8cb1-50cf520254b1 tempest-VolumesActionsTest-731506124 tempest-VolumesActionsTest-731506124-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:43:32.755253 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi [req-9ea8a22f-d55f-45a7-be72-31676cd39aa2 req-cd093b67-5ef8-41d1-8551-6b888875fd12 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3fd057be-56c1-462d-8ea2-9ca668166ccf", "name": "network-vif-deleted", "tag": "fb8f79ae-b609-4e5d-bbcf-2886fb227ed9"}]} {{(pid=129322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 12:43:32.769363 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [req-9ea8a22f-d55f-45a7-be72-31676cd39aa2 req-cd093b67-5ef8-41d1-8551-6b888875fd12 service nova] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:43:32.769703 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.policy [None req-21411a01-fa9a-43e0-8cb1-50cf520254b1 tempest-VolumesActionsTest-731506124 tempest-VolumesActionsTest-731506124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f39e076a9e6b401db6de9a2846519591', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa93879e60e470185e8dd71efaaf1a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129321) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:43:32.770147 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [req-9ea8a22f-d55f-45a7-be72-31676cd39aa2 req-cd093b67-5ef8-41d1-8551-6b888875fd12 service nova] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:43:32.781635 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: INFO nova.api.openstack.requestlog [None req-21411a01-fa9a-43e0-8cb1-50cf520254b1 tempest-VolumesActionsTest-731506124 tempest-VolumesActionsTest-731506124-project] 10.222.0.75 "GET /compute/v2.1/servers/3fd057be-56c1-462d-8ea2-9ca668166ccf" status: 200 len: 1462 microversion: 2.1 time: 0.138921 May 26 12:43:32.782556 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: [pid: 129321|app: 0|req: 329/676] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 26 12:43:32 2022] GET /compute/v2.1/servers/3fd057be-56c1-462d-8ea2-9ca668166ccf => generated 1462 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:43:32.787135 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi [None req-29917e7e-9f75-4d88-a98c-0538a7294e71 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Calling method '>' {{(pid=129321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:43:32.787815 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.compute.api [None req-29917e7e-9f75-4d88-a98c-0538a7294e71 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] [instance: bf2f6303-22b9-4cfa-8d4d-61d2503bc554] Fetching instance by UUID {{(pid=129321) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:43:32.794788 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-29917e7e-9f75-4d88-a98c-0538a7294e71 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:43:32.795232 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-29917e7e-9f75-4d88-a98c-0538a7294e71 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:43:32.796318 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-29917e7e-9f75-4d88-a98c-0538a7294e71 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:43:32.796908 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-29917e7e-9f75-4d88-a98c-0538a7294e71 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:43:32.800649 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: INFO nova.api.openstack.compute.server_external_events [req-9ea8a22f-d55f-45a7-be72-31676cd39aa2 req-cd093b67-5ef8-41d1-8551-6b888875fd12 service nova] Creating event network-vif-deleted:fb8f79ae-b609-4e5d-bbcf-2886fb227ed9 for instance 3fd057be-56c1-462d-8ea2-9ca668166ccf on hv-cinder-81966 May 26 12:43:32.808304 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: INFO nova.api.openstack.requestlog [req-9ea8a22f-d55f-45a7-be72-31676cd39aa2 req-cd093b67-5ef8-41d1-8551-6b888875fd12 service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.139729 May 26 12:43:32.809776 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: [pid: 129322|app: 0|req: 348/677] 10.222.0.75 () {64 vars in 1317 bytes} [Thu May 26 12:43:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 26 12:43:33.033980 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.policy [None req-29917e7e-9f75-4d88-a98c-0538a7294e71 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e811736979c44b02b14fecb74c6bd7ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675272fb40d4847819f83ec04afecef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129321) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:43:33.042271 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.policy [None req-29917e7e-9f75-4d88-a98c-0538a7294e71 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e811736979c44b02b14fecb74c6bd7ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675272fb40d4847819f83ec04afecef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129321) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:43:33.043790 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.policy [None req-29917e7e-9f75-4d88-a98c-0538a7294e71 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e811736979c44b02b14fecb74c6bd7ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675272fb40d4847819f83ec04afecef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129321) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:43:33.044961 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: INFO nova.api.openstack.requestlog [None req-29917e7e-9f75-4d88-a98c-0538a7294e71 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] 10.222.0.75 "GET /compute/v2.1/servers/bf2f6303-22b9-4cfa-8d4d-61d2503bc554" status: 200 len: 1723 microversion: 2.20 time: 0.261647 May 26 12:43:33.045525 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: [pid: 129321|app: 0|req: 330/678] 10.222.0.75 () {60 vars in 1276 bytes} [Thu May 26 12:43:32 2022] GET /compute/v2.1/servers/bf2f6303-22b9-4cfa-8d4d-61d2503bc554 => generated 1723 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 12:43:33.802376 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi [None req-769f46c0-7c0d-480c-b173-fbd8c785c6b8 tempest-VolumesActionsTest-731506124 tempest-VolumesActionsTest-731506124-project] Calling method '>' {{(pid=129322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:43:33.803105 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.compute.api [None req-769f46c0-7c0d-480c-b173-fbd8c785c6b8 tempest-VolumesActionsTest-731506124 tempest-VolumesActionsTest-731506124-project] [instance: 3fd057be-56c1-462d-8ea2-9ca668166ccf] Fetching instance by UUID {{(pid=129322) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:43:33.810891 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-769f46c0-7c0d-480c-b173-fbd8c785c6b8 tempest-VolumesActionsTest-731506124 tempest-VolumesActionsTest-731506124-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:43:33.811338 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-769f46c0-7c0d-480c-b173-fbd8c785c6b8 tempest-VolumesActionsTest-731506124 tempest-VolumesActionsTest-731506124-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:43:33.812133 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-769f46c0-7c0d-480c-b173-fbd8c785c6b8 tempest-VolumesActionsTest-731506124 tempest-VolumesActionsTest-731506124-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:43:33.812565 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-769f46c0-7c0d-480c-b173-fbd8c785c6b8 tempest-VolumesActionsTest-731506124 tempest-VolumesActionsTest-731506124-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:43:33.847719 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-769f46c0-7c0d-480c-b173-fbd8c785c6b8 tempest-VolumesActionsTest-731506124 tempest-VolumesActionsTest-731506124-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:43:33.848192 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-769f46c0-7c0d-480c-b173-fbd8c785c6b8 tempest-VolumesActionsTest-731506124 tempest-VolumesActionsTest-731506124-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:43:33.848767 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.objects.instance [None req-769f46c0-7c0d-480c-b173-fbd8c785c6b8 tempest-VolumesActionsTest-731506124 tempest-VolumesActionsTest-731506124-project] Lazy-loading 'fault' on Instance uuid 3fd057be-56c1-462d-8ea2-9ca668166ccf {{(pid=129322) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 26 12:43:33.902300 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.policy [None req-769f46c0-7c0d-480c-b173-fbd8c785c6b8 tempest-VolumesActionsTest-731506124 tempest-VolumesActionsTest-731506124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f39e076a9e6b401db6de9a2846519591', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa93879e60e470185e8dd71efaaf1a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129322) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:43:33.910005 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: INFO nova.api.openstack.requestlog [None req-769f46c0-7c0d-480c-b173-fbd8c785c6b8 tempest-VolumesActionsTest-731506124 tempest-VolumesActionsTest-731506124-project] 10.222.0.75 "GET /compute/v2.1/servers/3fd057be-56c1-462d-8ea2-9ca668166ccf" status: 200 len: 1304 microversion: 2.1 time: 0.111939 May 26 12:43:33.910578 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: [pid: 129322|app: 0|req: 349/679] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 26 12:43:33 2022] GET /compute/v2.1/servers/3fd057be-56c1-462d-8ea2-9ca668166ccf => generated 1304 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:43:34.064031 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi [None req-f0c35a51-9a24-4ab8-9217-69c2b35727f6 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Calling method '>' {{(pid=129321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:43:34.064612 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.compute.api [None req-f0c35a51-9a24-4ab8-9217-69c2b35727f6 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] [instance: bf2f6303-22b9-4cfa-8d4d-61d2503bc554] Fetching instance by UUID {{(pid=129321) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:43:34.072645 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-f0c35a51-9a24-4ab8-9217-69c2b35727f6 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:43:34.073088 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-f0c35a51-9a24-4ab8-9217-69c2b35727f6 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:43:34.073891 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-f0c35a51-9a24-4ab8-9217-69c2b35727f6 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:43:34.074317 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-f0c35a51-9a24-4ab8-9217-69c2b35727f6 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:43:34.214755 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.policy [None req-f0c35a51-9a24-4ab8-9217-69c2b35727f6 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e811736979c44b02b14fecb74c6bd7ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675272fb40d4847819f83ec04afecef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129321) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:43:34.227226 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.policy [None req-f0c35a51-9a24-4ab8-9217-69c2b35727f6 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e811736979c44b02b14fecb74c6bd7ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675272fb40d4847819f83ec04afecef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129321) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:43:34.228748 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.policy [None req-f0c35a51-9a24-4ab8-9217-69c2b35727f6 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e811736979c44b02b14fecb74c6bd7ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675272fb40d4847819f83ec04afecef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129321) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:43:34.229883 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: INFO nova.api.openstack.requestlog [None req-f0c35a51-9a24-4ab8-9217-69c2b35727f6 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] 10.222.0.75 "GET /compute/v2.1/servers/bf2f6303-22b9-4cfa-8d4d-61d2503bc554" status: 200 len: 1723 microversion: 2.20 time: 0.170039 May 26 12:43:34.230433 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: [pid: 129321|app: 0|req: 331/680] 10.222.0.75 () {60 vars in 1276 bytes} [Thu May 26 12:43:34 2022] GET /compute/v2.1/servers/bf2f6303-22b9-4cfa-8d4d-61d2503bc554 => generated 1723 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 12:43:34.928640 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi [None req-e17f4562-30b0-458d-83da-7e7711467eaf tempest-VolumesActionsTest-731506124 tempest-VolumesActionsTest-731506124-project] Calling method '>' {{(pid=129322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:43:34.929330 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.compute.api [None req-e17f4562-30b0-458d-83da-7e7711467eaf tempest-VolumesActionsTest-731506124 tempest-VolumesActionsTest-731506124-project] [instance: 3fd057be-56c1-462d-8ea2-9ca668166ccf] Fetching instance by UUID {{(pid=129322) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:43:34.937900 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-e17f4562-30b0-458d-83da-7e7711467eaf tempest-VolumesActionsTest-731506124 tempest-VolumesActionsTest-731506124-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:43:34.938402 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-e17f4562-30b0-458d-83da-7e7711467eaf tempest-VolumesActionsTest-731506124 tempest-VolumesActionsTest-731506124-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:43:34.939167 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-e17f4562-30b0-458d-83da-7e7711467eaf tempest-VolumesActionsTest-731506124 tempest-VolumesActionsTest-731506124-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:43:34.940451 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-e17f4562-30b0-458d-83da-7e7711467eaf tempest-VolumesActionsTest-731506124 tempest-VolumesActionsTest-731506124-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:43:34.976026 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-e17f4562-30b0-458d-83da-7e7711467eaf tempest-VolumesActionsTest-731506124 tempest-VolumesActionsTest-731506124-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:43:34.976465 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-e17f4562-30b0-458d-83da-7e7711467eaf tempest-VolumesActionsTest-731506124 tempest-VolumesActionsTest-731506124-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:43:34.976914 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.objects.instance [None req-e17f4562-30b0-458d-83da-7e7711467eaf tempest-VolumesActionsTest-731506124 tempest-VolumesActionsTest-731506124-project] Lazy-loading 'fault' on Instance uuid 3fd057be-56c1-462d-8ea2-9ca668166ccf {{(pid=129322) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 26 12:43:35.020542 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.policy [None req-e17f4562-30b0-458d-83da-7e7711467eaf tempest-VolumesActionsTest-731506124 tempest-VolumesActionsTest-731506124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f39e076a9e6b401db6de9a2846519591', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa93879e60e470185e8dd71efaaf1a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129322) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:43:35.030233 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: INFO nova.api.openstack.requestlog [None req-e17f4562-30b0-458d-83da-7e7711467eaf tempest-VolumesActionsTest-731506124 tempest-VolumesActionsTest-731506124-project] 10.222.0.75 "GET /compute/v2.1/servers/3fd057be-56c1-462d-8ea2-9ca668166ccf" status: 200 len: 1304 microversion: 2.1 time: 0.105578 May 26 12:43:35.030974 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: [pid: 129322|app: 0|req: 350/681] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 26 12:43:34 2022] GET /compute/v2.1/servers/3fd057be-56c1-462d-8ea2-9ca668166ccf => generated 1304 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:43:35.250411 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi [None req-ab140d29-8824-4fe2-ba67-05f52f7197ae tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Calling method '>' {{(pid=129321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:43:35.251768 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.compute.api [None req-ab140d29-8824-4fe2-ba67-05f52f7197ae tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] [instance: bf2f6303-22b9-4cfa-8d4d-61d2503bc554] Fetching instance by UUID {{(pid=129321) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:43:35.258689 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-ab140d29-8824-4fe2-ba67-05f52f7197ae tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:43:35.260281 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-ab140d29-8824-4fe2-ba67-05f52f7197ae tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:43:35.261079 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-ab140d29-8824-4fe2-ba67-05f52f7197ae tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:43:35.261518 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-ab140d29-8824-4fe2-ba67-05f52f7197ae tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:43:35.401815 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.policy [None req-ab140d29-8824-4fe2-ba67-05f52f7197ae tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e811736979c44b02b14fecb74c6bd7ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675272fb40d4847819f83ec04afecef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129321) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:43:35.404173 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG dbcounter [-] [129321] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:43:35.411503 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.policy [None req-ab140d29-8824-4fe2-ba67-05f52f7197ae tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e811736979c44b02b14fecb74c6bd7ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675272fb40d4847819f83ec04afecef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129321) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:43:35.413034 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.policy [None req-ab140d29-8824-4fe2-ba67-05f52f7197ae tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e811736979c44b02b14fecb74c6bd7ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675272fb40d4847819f83ec04afecef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129321) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:43:35.414205 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: INFO nova.api.openstack.requestlog [None req-ab140d29-8824-4fe2-ba67-05f52f7197ae tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] 10.222.0.75 "GET /compute/v2.1/servers/bf2f6303-22b9-4cfa-8d4d-61d2503bc554" status: 200 len: 1726 microversion: 2.20 time: 0.168248 May 26 12:43:35.414769 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: [pid: 129321|app: 0|req: 332/682] 10.222.0.75 () {60 vars in 1276 bytes} [Thu May 26 12:43:35 2022] GET /compute/v2.1/servers/bf2f6303-22b9-4cfa-8d4d-61d2503bc554 => generated 1726 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 26 12:43:35.432423 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi [None req-1575bcef-7d2d-4686-b38d-ee105a540d48 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f7a8830d-4a07-494b-b732-c6b0d0879d8e"}} {{(pid=129322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 12:43:35.433500 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.compute.api [None req-1575bcef-7d2d-4686-b38d-ee105a540d48 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] [instance: bf2f6303-22b9-4cfa-8d4d-61d2503bc554] Fetching instance by UUID {{(pid=129322) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:43:35.439927 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-1575bcef-7d2d-4686-b38d-ee105a540d48 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:43:35.440375 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-1575bcef-7d2d-4686-b38d-ee105a540d48 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:43:35.441137 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-1575bcef-7d2d-4686-b38d-ee105a540d48 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:43:35.441569 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-1575bcef-7d2d-4686-b38d-ee105a540d48 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:43:35.760125 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: INFO nova.api.openstack.requestlog [None req-1575bcef-7d2d-4686-b38d-ee105a540d48 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] 10.222.0.75 "POST /compute/v2.1/servers/bf2f6303-22b9-4cfa-8d4d-61d2503bc554/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.330575 May 26 12:43:35.761025 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: [pid: 129322|app: 0|req: 351/683] 10.222.0.75 () {62 vars in 1363 bytes} [Thu May 26 12:43:35 2022] POST /compute/v2.1/servers/bf2f6303-22b9-4cfa-8d4d-61d2503bc554/os-volume_attachments => generated 188 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 26 12:43:35.901645 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi [None req-29e3033a-2051-4b0c-bc5e-20ede744d6e6 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=129321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 12:43:35.902262 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.compute.api [None req-29e3033a-2051-4b0c-bc5e-20ede744d6e6 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] [instance: bf2f6303-22b9-4cfa-8d4d-61d2503bc554] Fetching instance by UUID {{(pid=129321) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:43:35.911381 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-29e3033a-2051-4b0c-bc5e-20ede744d6e6 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:43:35.911859 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-29e3033a-2051-4b0c-bc5e-20ede744d6e6 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:43:35.912772 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-29e3033a-2051-4b0c-bc5e-20ede744d6e6 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:43:35.913263 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-29e3033a-2051-4b0c-bc5e-20ede744d6e6 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:43:36.049781 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi [None req-12bc9d14-9f97-49a3-9b01-69396a2c4cb2 tempest-VolumesActionsTest-731506124 tempest-VolumesActionsTest-731506124-project] Calling method '>' {{(pid=129322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:43:36.050399 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.compute.api [None req-12bc9d14-9f97-49a3-9b01-69396a2c4cb2 tempest-VolumesActionsTest-731506124 tempest-VolumesActionsTest-731506124-project] [instance: 3fd057be-56c1-462d-8ea2-9ca668166ccf] Fetching instance by UUID {{(pid=129322) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:43:36.059436 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-12bc9d14-9f97-49a3-9b01-69396a2c4cb2 tempest-VolumesActionsTest-731506124 tempest-VolumesActionsTest-731506124-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:43:36.060164 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-12bc9d14-9f97-49a3-9b01-69396a2c4cb2 tempest-VolumesActionsTest-731506124 tempest-VolumesActionsTest-731506124-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:43:36.061270 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-12bc9d14-9f97-49a3-9b01-69396a2c4cb2 tempest-VolumesActionsTest-731506124 tempest-VolumesActionsTest-731506124-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:43:36.061757 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-12bc9d14-9f97-49a3-9b01-69396a2c4cb2 tempest-VolumesActionsTest-731506124 tempest-VolumesActionsTest-731506124-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:43:36.079080 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: INFO nova.api.openstack.wsgi [None req-12bc9d14-9f97-49a3-9b01-69396a2c4cb2 tempest-VolumesActionsTest-731506124 tempest-VolumesActionsTest-731506124-project] HTTP exception thrown: Instance 3fd057be-56c1-462d-8ea2-9ca668166ccf could not be found. May 26 12:43:36.081127 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi [None req-12bc9d14-9f97-49a3-9b01-69396a2c4cb2 tempest-VolumesActionsTest-731506124 tempest-VolumesActionsTest-731506124-project] Request method failure captured: May 26 12:43:36.081127 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: request: GET /compute/v2.1/servers/3fd057be-56c1-462d-8ea2-9ca668166ccf HTTP/1.1 May 26 12:43:36.081127 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: Accept: application/json May 26 12:43:36.081127 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: Accept-Encoding: identity May 26 12:43:36.081127 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: Connection: close May 26 12:43:36.081127 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: Content-Length: 0 May 26 12:43:36.081127 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: Content-Type: application/json May 26 12:43:36.081127 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: Host: 10.222.0.75 May 26 12:43:36.081127 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: Openstack-System-Scope: None May 26 12:43:36.081127 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: User-Agent: python-urllib3/1.26.9 May 26 12:43:36.081127 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: X-Auth-Token: gAAAAABij3WCYJlZSEeK71zmOEeiB2Vk2q7v2Efm6wlf-SbvkS3YiHLenQrvkqoY4w88HPjpmZBfe_H8VAzWqRh2rmcLg1u_Xy5ulDPlKShP1p8TZ6yK83QCjfTknL2ofeNtsx0dfdDfdoxUHW0QsO6JrvEaGpqTh8AdrtNvwCXoDIqAEnmX7Xg May 26 12:43:36.081127 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: X-Domain-Id: None May 26 12:43:36.081127 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: X-Domain-Name: None May 26 12:43:36.081127 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: X-Identity-Status: Confirmed May 26 12:43:36.081127 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: X-Is-Admin-Project: True May 26 12:43:36.081127 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: X-Project-Domain-Id: default May 26 12:43:36.081127 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: X-Project-Domain-Name: Default May 26 12:43:36.081127 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: X-Project-Id: ffa93879e60e470185e8dd71efaaf1a9 May 26 12:43:36.081127 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: X-Project-Name: tempest-VolumesActionsTest-731506124 May 26 12:43:36.081127 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: X-Role: member,reader May 26 12:43:36.081127 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: X-Roles: member,reader May 26 12:43:36.084120 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/ffa93879e60e470185e8dd71efaaf1a9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.75:8080", "publicURL": "http://10.222.0.75:8080/v1/AUTH_ffa93879e60e470185e8dd71efaaf1a9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2/ffa93879e60e470185e8dd71efaaf1a9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/ffa93879e60e470185e8dd71efaaf1a9"}]}] May 26 12:43:36.084120 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: X-Tenant: tempest-VolumesActionsTest-731506124 May 26 12:43:36.084120 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: X-Tenant-Id: ffa93879e60e470185e8dd71efaaf1a9 May 26 12:43:36.084120 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: X-Tenant-Name: tempest-VolumesActionsTest-731506124 May 26 12:43:36.084120 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: X-User: tempest-VolumesActionsTest-731506124-project May 26 12:43:36.084120 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: X-User-Domain-Id: default May 26 12:43:36.084120 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: X-User-Domain-Name: Default May 26 12:43:36.084120 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: X-User-Id: f39e076a9e6b401db6de9a2846519591 May 26 12:43:36.084120 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: X-User-Name: tempest-VolumesActionsTest-731506124-project May 26 12:43:36.084120 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: method: > May 26 12:43:36.084120 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: exception: Instance 3fd057be-56c1-462d-8ea2-9ca668166ccf could not be found. May 26 12:43:36.084120 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: action_args: {'id': '3fd057be-56c1-462d-8ea2-9ca668166ccf'} May 26 12:43:36.085745 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: {{(pid=129322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 12:43:36.085745 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 12:43:36.085745 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 26 12:43:36.085745 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 26 12:43:36.085745 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 26 12:43:36.085745 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 26 12:43:36.085745 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 26 12:43:36.085745 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 26 12:43:36.085745 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 26 12:43:36.085745 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 26 12:43:36.085745 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3fd057be-56c1-462d-8ea2-9ca668166ccf could not be found. May 26 12:43:36.085745 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi May 26 12:43:36.085745 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 12:43:36.085745 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi May 26 12:43:36.085745 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 12:43:36.085745 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 12:43:36.085745 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 12:43:36.085745 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 12:43:36.085745 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 12:43:36.085745 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 12:43:36.089890 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 12:43:36.089890 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 26 12:43:36.089890 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 26 12:43:36.089890 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 26 12:43:36.089890 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 26 12:43:36.089890 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 26 12:43:36.089890 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 12:43:36.089890 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3fd057be-56c1-462d-8ea2-9ca668166ccf could not be found. May 26 12:43:36.089890 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi May 26 12:43:36.089890 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 12:43:36.089890 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi May 26 12:43:36.089890 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 12:43:36.089890 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 12:43:36.089890 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 12:43:36.089890 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 12:43:36.089890 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 12:43:36.089890 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3fd057be-56c1-462d-8ea2-9ca668166ccf could not be found. May 26 12:43:36.089890 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi May 26 12:43:36.092459 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi [None req-12bc9d14-9f97-49a3-9b01-69396a2c4cb2 tempest-VolumesActionsTest-731506124 tempest-VolumesActionsTest-731506124-project] Returning 404 to user: Instance 3fd057be-56c1-462d-8ea2-9ca668166ccf could not be found. {{(pid=129322) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 12:43:36.092459 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: INFO nova.api.openstack.requestlog [None req-12bc9d14-9f97-49a3-9b01-69396a2c4cb2 tempest-VolumesActionsTest-731506124 tempest-VolumesActionsTest-731506124-project] 10.222.0.75 "GET /compute/v2.1/servers/3fd057be-56c1-462d-8ea2-9ca668166ccf" status: 404 len: 111 microversion: 2.1 time: 0.036988 May 26 12:43:36.092459 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: [pid: 129322|app: 0|req: 352/684] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 26 12:43:36 2022] GET /compute/v2.1/servers/3fd057be-56c1-462d-8ea2-9ca668166ccf => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 26 12:43:36.122229 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: INFO nova.api.openstack.requestlog [None req-29e3033a-2051-4b0c-bc5e-20ede744d6e6 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] 10.222.0.75 "POST /compute/v2.1/servers/bf2f6303-22b9-4cfa-8d4d-61d2503bc554/action" status: 202 len: 0 microversion: 2.20 time: 0.225074 May 26 12:43:36.123135 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: [pid: 129321|app: 0|req: 333/685] 10.222.0.75 () {62 vars in 1318 bytes} [Thu May 26 12:43:35 2022] POST /compute/v2.1/servers/bf2f6303-22b9-4cfa-8d4d-61d2503bc554/action => generated 0 bytes in 227 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) May 26 12:43:36.131731 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi [None req-f6e7296c-3695-404a-bb7e-6cb056f052d2 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Calling method '>' {{(pid=129322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:43:36.132649 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.compute.api [None req-f6e7296c-3695-404a-bb7e-6cb056f052d2 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] [instance: bf2f6303-22b9-4cfa-8d4d-61d2503bc554] Fetching instance by UUID {{(pid=129322) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:43:36.141503 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-f6e7296c-3695-404a-bb7e-6cb056f052d2 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:43:36.141959 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-f6e7296c-3695-404a-bb7e-6cb056f052d2 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:43:36.142749 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-f6e7296c-3695-404a-bb7e-6cb056f052d2 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:43:36.143176 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-f6e7296c-3695-404a-bb7e-6cb056f052d2 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:43:36.296512 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.policy [None req-f6e7296c-3695-404a-bb7e-6cb056f052d2 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e811736979c44b02b14fecb74c6bd7ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675272fb40d4847819f83ec04afecef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129322) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:43:36.307148 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.policy [None req-f6e7296c-3695-404a-bb7e-6cb056f052d2 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e811736979c44b02b14fecb74c6bd7ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675272fb40d4847819f83ec04afecef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129322) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:43:36.309030 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.policy [None req-f6e7296c-3695-404a-bb7e-6cb056f052d2 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e811736979c44b02b14fecb74c6bd7ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675272fb40d4847819f83ec04afecef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129322) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:43:36.310444 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: INFO nova.api.openstack.requestlog [None req-f6e7296c-3695-404a-bb7e-6cb056f052d2 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] 10.222.0.75 "GET /compute/v2.1/servers/bf2f6303-22b9-4cfa-8d4d-61d2503bc554" status: 200 len: 1752 microversion: 2.20 time: 0.182796 May 26 12:43:36.311069 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: [pid: 129322|app: 0|req: 353/686] 10.222.0.75 () {60 vars in 1276 bytes} [Thu May 26 12:43:36 2022] GET /compute/v2.1/servers/bf2f6303-22b9-4cfa-8d4d-61d2503bc554 => generated 1752 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 26 12:43:37.332507 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi [None req-0ecc835e-1c22-47e6-a7f8-ed864ba18c41 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Calling method '>' {{(pid=129321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:43:37.333089 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.compute.api [None req-0ecc835e-1c22-47e6-a7f8-ed864ba18c41 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] [instance: bf2f6303-22b9-4cfa-8d4d-61d2503bc554] Fetching instance by UUID {{(pid=129321) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:43:37.340265 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-0ecc835e-1c22-47e6-a7f8-ed864ba18c41 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:43:37.340713 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-0ecc835e-1c22-47e6-a7f8-ed864ba18c41 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:43:37.341488 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-0ecc835e-1c22-47e6-a7f8-ed864ba18c41 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:43:37.341923 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-0ecc835e-1c22-47e6-a7f8-ed864ba18c41 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:43:37.489810 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.policy [None req-0ecc835e-1c22-47e6-a7f8-ed864ba18c41 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e811736979c44b02b14fecb74c6bd7ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675272fb40d4847819f83ec04afecef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129321) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:43:37.498964 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.policy [None req-0ecc835e-1c22-47e6-a7f8-ed864ba18c41 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e811736979c44b02b14fecb74c6bd7ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675272fb40d4847819f83ec04afecef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129321) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:43:37.500472 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.policy [None req-0ecc835e-1c22-47e6-a7f8-ed864ba18c41 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e811736979c44b02b14fecb74c6bd7ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675272fb40d4847819f83ec04afecef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129321) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:43:37.501643 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: INFO nova.api.openstack.requestlog [None req-0ecc835e-1c22-47e6-a7f8-ed864ba18c41 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] 10.222.0.75 "GET /compute/v2.1/servers/bf2f6303-22b9-4cfa-8d4d-61d2503bc554" status: 200 len: 1752 microversion: 2.20 time: 0.174638 May 26 12:43:37.502200 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: [pid: 129321|app: 0|req: 334/687] 10.222.0.75 () {60 vars in 1276 bytes} [Thu May 26 12:43:37 2022] GET /compute/v2.1/servers/bf2f6303-22b9-4cfa-8d4d-61d2503bc554 => generated 1752 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 12:43:38.520733 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi [None req-66861b57-1e29-4b81-85e2-74ec31831c97 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Calling method '>' {{(pid=129322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:43:38.521327 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.compute.api [None req-66861b57-1e29-4b81-85e2-74ec31831c97 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] [instance: bf2f6303-22b9-4cfa-8d4d-61d2503bc554] Fetching instance by UUID {{(pid=129322) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:43:38.523909 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG dbcounter [-] [129322] Writing DB stats nova_api:SELECT=98 {{(pid=129322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:43:38.530462 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-66861b57-1e29-4b81-85e2-74ec31831c97 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:43:38.530889 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-66861b57-1e29-4b81-85e2-74ec31831c97 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:43:38.532077 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-66861b57-1e29-4b81-85e2-74ec31831c97 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:43:38.532516 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-66861b57-1e29-4b81-85e2-74ec31831c97 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:43:38.680156 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.policy [None req-66861b57-1e29-4b81-85e2-74ec31831c97 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e811736979c44b02b14fecb74c6bd7ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675272fb40d4847819f83ec04afecef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129322) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:43:38.691052 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.policy [None req-66861b57-1e29-4b81-85e2-74ec31831c97 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e811736979c44b02b14fecb74c6bd7ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675272fb40d4847819f83ec04afecef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129322) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:43:38.692766 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.policy [None req-66861b57-1e29-4b81-85e2-74ec31831c97 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e811736979c44b02b14fecb74c6bd7ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675272fb40d4847819f83ec04afecef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129322) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:43:38.694498 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: INFO nova.api.openstack.requestlog [None req-66861b57-1e29-4b81-85e2-74ec31831c97 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] 10.222.0.75 "GET /compute/v2.1/servers/bf2f6303-22b9-4cfa-8d4d-61d2503bc554" status: 200 len: 1752 microversion: 2.20 time: 0.177677 May 26 12:43:38.695298 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: [pid: 129322|app: 0|req: 354/688] 10.222.0.75 () {60 vars in 1276 bytes} [Thu May 26 12:43:38 2022] GET /compute/v2.1/servers/bf2f6303-22b9-4cfa-8d4d-61d2503bc554 => generated 1752 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 12:43:39.727255 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi [None req-d048e5c2-b883-4ce1-8e33-f549ef61377c tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Calling method '>' {{(pid=129321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:43:39.728475 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.compute.api [None req-d048e5c2-b883-4ce1-8e33-f549ef61377c tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] [instance: bf2f6303-22b9-4cfa-8d4d-61d2503bc554] Fetching instance by UUID {{(pid=129321) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:43:39.738839 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-d048e5c2-b883-4ce1-8e33-f549ef61377c tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:43:39.739651 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-d048e5c2-b883-4ce1-8e33-f549ef61377c tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:43:39.740868 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-d048e5c2-b883-4ce1-8e33-f549ef61377c tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:43:39.741615 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-d048e5c2-b883-4ce1-8e33-f549ef61377c tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:43:39.910603 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.policy [None req-d048e5c2-b883-4ce1-8e33-f549ef61377c tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e811736979c44b02b14fecb74c6bd7ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675272fb40d4847819f83ec04afecef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129321) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:43:39.920388 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.policy [None req-d048e5c2-b883-4ce1-8e33-f549ef61377c tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e811736979c44b02b14fecb74c6bd7ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675272fb40d4847819f83ec04afecef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129321) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:43:39.921880 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.policy [None req-d048e5c2-b883-4ce1-8e33-f549ef61377c tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e811736979c44b02b14fecb74c6bd7ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675272fb40d4847819f83ec04afecef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129321) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:43:39.923046 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: INFO nova.api.openstack.requestlog [None req-d048e5c2-b883-4ce1-8e33-f549ef61377c tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] 10.222.0.75 "GET /compute/v2.1/servers/bf2f6303-22b9-4cfa-8d4d-61d2503bc554" status: 200 len: 1752 microversion: 2.20 time: 0.208402 May 26 12:43:39.923629 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: [pid: 129321|app: 0|req: 335/689] 10.222.0.75 () {60 vars in 1276 bytes} [Thu May 26 12:43:39 2022] GET /compute/v2.1/servers/bf2f6303-22b9-4cfa-8d4d-61d2503bc554 => generated 1752 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 12:43:40.942725 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi [None req-0d819381-11d8-4ab1-ac69-fea45dd7a769 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Calling method '>' {{(pid=129322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:43:40.947360 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.compute.api [None req-0d819381-11d8-4ab1-ac69-fea45dd7a769 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] [instance: bf2f6303-22b9-4cfa-8d4d-61d2503bc554] Fetching instance by UUID {{(pid=129322) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:43:40.954442 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-0d819381-11d8-4ab1-ac69-fea45dd7a769 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:43:40.954891 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-0d819381-11d8-4ab1-ac69-fea45dd7a769 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:43:40.955737 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-0d819381-11d8-4ab1-ac69-fea45dd7a769 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:43:40.956124 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-0d819381-11d8-4ab1-ac69-fea45dd7a769 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:43:41.115853 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.policy [None req-0d819381-11d8-4ab1-ac69-fea45dd7a769 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e811736979c44b02b14fecb74c6bd7ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675272fb40d4847819f83ec04afecef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129322) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:43:41.128425 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.policy [None req-0d819381-11d8-4ab1-ac69-fea45dd7a769 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e811736979c44b02b14fecb74c6bd7ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675272fb40d4847819f83ec04afecef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129322) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:43:41.130000 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.policy [None req-0d819381-11d8-4ab1-ac69-fea45dd7a769 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e811736979c44b02b14fecb74c6bd7ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675272fb40d4847819f83ec04afecef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129322) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:43:41.131197 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: INFO nova.api.openstack.requestlog [None req-0d819381-11d8-4ab1-ac69-fea45dd7a769 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] 10.222.0.75 "GET /compute/v2.1/servers/bf2f6303-22b9-4cfa-8d4d-61d2503bc554" status: 200 len: 1752 microversion: 2.20 time: 0.192539 May 26 12:43:41.131803 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: [pid: 129322|app: 0|req: 355/690] 10.222.0.75 () {60 vars in 1276 bytes} [Thu May 26 12:43:40 2022] GET /compute/v2.1/servers/bf2f6303-22b9-4cfa-8d4d-61d2503bc554 => generated 1752 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 26 12:43:42.153267 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi [None req-2387619c-5a9d-4454-9ac9-312c3df6c284 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Calling method '>' {{(pid=129321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:43:42.154109 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.compute.api [None req-2387619c-5a9d-4454-9ac9-312c3df6c284 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] [instance: bf2f6303-22b9-4cfa-8d4d-61d2503bc554] Fetching instance by UUID {{(pid=129321) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:43:42.163963 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-2387619c-5a9d-4454-9ac9-312c3df6c284 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:43:42.164595 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-2387619c-5a9d-4454-9ac9-312c3df6c284 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:43:42.166262 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-2387619c-5a9d-4454-9ac9-312c3df6c284 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:43:42.166900 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-2387619c-5a9d-4454-9ac9-312c3df6c284 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:43:42.330452 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.policy [None req-2387619c-5a9d-4454-9ac9-312c3df6c284 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e811736979c44b02b14fecb74c6bd7ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675272fb40d4847819f83ec04afecef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129321) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:43:42.342548 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.policy [None req-2387619c-5a9d-4454-9ac9-312c3df6c284 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e811736979c44b02b14fecb74c6bd7ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675272fb40d4847819f83ec04afecef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129321) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:43:42.345519 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.policy [None req-2387619c-5a9d-4454-9ac9-312c3df6c284 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e811736979c44b02b14fecb74c6bd7ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675272fb40d4847819f83ec04afecef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129321) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:43:42.347740 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: INFO nova.api.openstack.requestlog [None req-2387619c-5a9d-4454-9ac9-312c3df6c284 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] 10.222.0.75 "GET /compute/v2.1/servers/bf2f6303-22b9-4cfa-8d4d-61d2503bc554" status: 200 len: 1754 microversion: 2.20 time: 0.201114 May 26 12:43:42.348709 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: [pid: 129321|app: 0|req: 336/691] 10.222.0.75 () {60 vars in 1276 bytes} [Thu May 26 12:43:42 2022] GET /compute/v2.1/servers/bf2f6303-22b9-4cfa-8d4d-61d2503bc554 => generated 1754 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 12:43:43.368264 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi [None req-19e19b85-8869-4062-88c6-dfe544310f1d tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Calling method '>' {{(pid=129322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:43:43.369125 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.compute.api [None req-19e19b85-8869-4062-88c6-dfe544310f1d tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] [instance: bf2f6303-22b9-4cfa-8d4d-61d2503bc554] Fetching instance by UUID {{(pid=129322) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:43:43.376321 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-19e19b85-8869-4062-88c6-dfe544310f1d tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:43:43.376765 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-19e19b85-8869-4062-88c6-dfe544310f1d tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:43:43.377524 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-19e19b85-8869-4062-88c6-dfe544310f1d tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:43:43.377953 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-19e19b85-8869-4062-88c6-dfe544310f1d tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:43:43.530367 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.policy [None req-19e19b85-8869-4062-88c6-dfe544310f1d tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e811736979c44b02b14fecb74c6bd7ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675272fb40d4847819f83ec04afecef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129322) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:43:43.539777 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.policy [None req-19e19b85-8869-4062-88c6-dfe544310f1d tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e811736979c44b02b14fecb74c6bd7ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675272fb40d4847819f83ec04afecef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129322) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:43:43.542164 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.policy [None req-19e19b85-8869-4062-88c6-dfe544310f1d tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e811736979c44b02b14fecb74c6bd7ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675272fb40d4847819f83ec04afecef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129322) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:43:43.543363 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: INFO nova.api.openstack.requestlog [None req-19e19b85-8869-4062-88c6-dfe544310f1d tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] 10.222.0.75 "GET /compute/v2.1/servers/bf2f6303-22b9-4cfa-8d4d-61d2503bc554" status: 200 len: 1754 microversion: 2.20 time: 0.180433 May 26 12:43:43.543969 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: [pid: 129322|app: 0|req: 356/692] 10.222.0.75 () {60 vars in 1276 bytes} [Thu May 26 12:43:43 2022] GET /compute/v2.1/servers/bf2f6303-22b9-4cfa-8d4d-61d2503bc554 => generated 1754 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 12:43:44.565846 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi [None req-42e6339f-0dba-4cfb-a288-176c2d890c40 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Calling method '>' {{(pid=129321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:43:44.567365 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.compute.api [None req-42e6339f-0dba-4cfb-a288-176c2d890c40 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] [instance: bf2f6303-22b9-4cfa-8d4d-61d2503bc554] Fetching instance by UUID {{(pid=129321) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:43:44.582096 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-42e6339f-0dba-4cfb-a288-176c2d890c40 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:43:44.583211 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-42e6339f-0dba-4cfb-a288-176c2d890c40 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:43:44.584744 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-42e6339f-0dba-4cfb-a288-176c2d890c40 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:43:44.585436 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-42e6339f-0dba-4cfb-a288-176c2d890c40 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:43:44.822779 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.policy [None req-42e6339f-0dba-4cfb-a288-176c2d890c40 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e811736979c44b02b14fecb74c6bd7ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675272fb40d4847819f83ec04afecef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129321) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:43:44.838120 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.policy [None req-42e6339f-0dba-4cfb-a288-176c2d890c40 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e811736979c44b02b14fecb74c6bd7ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675272fb40d4847819f83ec04afecef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129321) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:43:44.840532 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.policy [None req-42e6339f-0dba-4cfb-a288-176c2d890c40 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e811736979c44b02b14fecb74c6bd7ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675272fb40d4847819f83ec04afecef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129321) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:43:44.842473 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: INFO nova.api.openstack.requestlog [None req-42e6339f-0dba-4cfb-a288-176c2d890c40 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] 10.222.0.75 "GET /compute/v2.1/servers/bf2f6303-22b9-4cfa-8d4d-61d2503bc554" status: 200 len: 1810 microversion: 2.20 time: 0.283226 May 26 12:43:44.843310 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: [pid: 129321|app: 0|req: 337/693] 10.222.0.75 () {60 vars in 1276 bytes} [Thu May 26 12:43:44 2022] GET /compute/v2.1/servers/bf2f6303-22b9-4cfa-8d4d-61d2503bc554 => generated 1810 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 12:43:45.878981 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi [None req-c67f7ad4-c6d4-4d39-82a3-0226813f6366 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Calling method '>' {{(pid=129322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:43:45.880297 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.compute.api [None req-c67f7ad4-c6d4-4d39-82a3-0226813f6366 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] [instance: bf2f6303-22b9-4cfa-8d4d-61d2503bc554] Fetching instance by UUID {{(pid=129322) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:43:45.887767 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-c67f7ad4-c6d4-4d39-82a3-0226813f6366 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:43:45.888212 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-c67f7ad4-c6d4-4d39-82a3-0226813f6366 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:43:45.888994 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-c67f7ad4-c6d4-4d39-82a3-0226813f6366 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:43:45.889456 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-c67f7ad4-c6d4-4d39-82a3-0226813f6366 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:43:46.111242 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.policy [None req-c67f7ad4-c6d4-4d39-82a3-0226813f6366 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e811736979c44b02b14fecb74c6bd7ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675272fb40d4847819f83ec04afecef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129322) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:43:46.124040 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.policy [None req-c67f7ad4-c6d4-4d39-82a3-0226813f6366 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e811736979c44b02b14fecb74c6bd7ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675272fb40d4847819f83ec04afecef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129322) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:43:46.126157 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.policy [None req-c67f7ad4-c6d4-4d39-82a3-0226813f6366 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e811736979c44b02b14fecb74c6bd7ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675272fb40d4847819f83ec04afecef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129322) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:43:46.127369 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: INFO nova.api.openstack.requestlog [None req-c67f7ad4-c6d4-4d39-82a3-0226813f6366 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] 10.222.0.75 "GET /compute/v2.1/servers/bf2f6303-22b9-4cfa-8d4d-61d2503bc554" status: 200 len: 1810 microversion: 2.20 time: 0.252404 May 26 12:43:46.127987 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: [pid: 129322|app: 0|req: 357/694] 10.222.0.75 () {60 vars in 1276 bytes} [Thu May 26 12:43:45 2022] GET /compute/v2.1/servers/bf2f6303-22b9-4cfa-8d4d-61d2503bc554 => generated 1810 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 26 12:43:47.148053 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi [None req-1cf0af51-7678-4430-adfe-9abdfc717818 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Calling method '>' {{(pid=129321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:43:47.150017 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.compute.api [None req-1cf0af51-7678-4430-adfe-9abdfc717818 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] [instance: bf2f6303-22b9-4cfa-8d4d-61d2503bc554] Fetching instance by UUID {{(pid=129321) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:43:47.159355 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-1cf0af51-7678-4430-adfe-9abdfc717818 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:43:47.160391 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-1cf0af51-7678-4430-adfe-9abdfc717818 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:43:47.161793 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-1cf0af51-7678-4430-adfe-9abdfc717818 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:43:47.162460 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-1cf0af51-7678-4430-adfe-9abdfc717818 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:43:47.373785 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.policy [None req-1cf0af51-7678-4430-adfe-9abdfc717818 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e811736979c44b02b14fecb74c6bd7ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675272fb40d4847819f83ec04afecef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129321) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:43:47.387281 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.policy [None req-1cf0af51-7678-4430-adfe-9abdfc717818 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e811736979c44b02b14fecb74c6bd7ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675272fb40d4847819f83ec04afecef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129321) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:43:47.389574 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.policy [None req-1cf0af51-7678-4430-adfe-9abdfc717818 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e811736979c44b02b14fecb74c6bd7ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675272fb40d4847819f83ec04afecef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129321) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:43:47.390446 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: INFO nova.api.openstack.requestlog [None req-1cf0af51-7678-4430-adfe-9abdfc717818 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] 10.222.0.75 "GET /compute/v2.1/servers/bf2f6303-22b9-4cfa-8d4d-61d2503bc554" status: 200 len: 1810 microversion: 2.20 time: 0.247317 May 26 12:43:47.395727 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: [pid: 129321|app: 0|req: 338/695] 10.222.0.75 () {60 vars in 1276 bytes} [Thu May 26 12:43:47 2022] GET /compute/v2.1/servers/bf2f6303-22b9-4cfa-8d4d-61d2503bc554 => generated 1810 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 26 12:43:48.413286 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi [None req-909fd08b-cf86-4985-a1bd-c4c230cc073a tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Calling method '>' {{(pid=129322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:43:48.414221 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.compute.api [None req-909fd08b-cf86-4985-a1bd-c4c230cc073a tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] [instance: bf2f6303-22b9-4cfa-8d4d-61d2503bc554] Fetching instance by UUID {{(pid=129322) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:43:48.421496 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-909fd08b-cf86-4985-a1bd-c4c230cc073a tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:43:48.421977 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-909fd08b-cf86-4985-a1bd-c4c230cc073a tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:43:48.422764 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-909fd08b-cf86-4985-a1bd-c4c230cc073a tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:43:48.423166 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-909fd08b-cf86-4985-a1bd-c4c230cc073a tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:43:48.616857 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.policy [None req-909fd08b-cf86-4985-a1bd-c4c230cc073a tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e811736979c44b02b14fecb74c6bd7ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675272fb40d4847819f83ec04afecef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129322) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:43:48.630189 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.policy [None req-909fd08b-cf86-4985-a1bd-c4c230cc073a tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e811736979c44b02b14fecb74c6bd7ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675272fb40d4847819f83ec04afecef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129322) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:43:48.632845 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.policy [None req-909fd08b-cf86-4985-a1bd-c4c230cc073a tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e811736979c44b02b14fecb74c6bd7ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675272fb40d4847819f83ec04afecef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129322) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:43:48.634420 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: INFO nova.api.openstack.requestlog [None req-909fd08b-cf86-4985-a1bd-c4c230cc073a tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] 10.222.0.75 "GET /compute/v2.1/servers/bf2f6303-22b9-4cfa-8d4d-61d2503bc554" status: 200 len: 1810 microversion: 2.20 time: 0.225301 May 26 12:43:48.641825 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: [pid: 129322|app: 0|req: 358/696] 10.222.0.75 () {60 vars in 1276 bytes} [Thu May 26 12:43:48 2022] GET /compute/v2.1/servers/bf2f6303-22b9-4cfa-8d4d-61d2503bc554 => generated 1810 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 12:43:49.656702 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi [None req-eb95d17a-380a-4688-a8ea-dcdef70c1d0e tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Calling method '>' {{(pid=129321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:43:49.657632 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.compute.api [None req-eb95d17a-380a-4688-a8ea-dcdef70c1d0e tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] [instance: bf2f6303-22b9-4cfa-8d4d-61d2503bc554] Fetching instance by UUID {{(pid=129321) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:43:49.664920 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-eb95d17a-380a-4688-a8ea-dcdef70c1d0e tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:43:49.665348 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-eb95d17a-380a-4688-a8ea-dcdef70c1d0e tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:43:49.666562 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-eb95d17a-380a-4688-a8ea-dcdef70c1d0e tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:43:49.667410 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-eb95d17a-380a-4688-a8ea-dcdef70c1d0e tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:43:50.157054 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.policy [None req-eb95d17a-380a-4688-a8ea-dcdef70c1d0e tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e811736979c44b02b14fecb74c6bd7ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675272fb40d4847819f83ec04afecef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129321) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:43:50.174603 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.policy [None req-eb95d17a-380a-4688-a8ea-dcdef70c1d0e tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e811736979c44b02b14fecb74c6bd7ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675272fb40d4847819f83ec04afecef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129321) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:43:50.182964 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.policy [None req-eb95d17a-380a-4688-a8ea-dcdef70c1d0e tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e811736979c44b02b14fecb74c6bd7ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675272fb40d4847819f83ec04afecef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129321) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:43:50.187213 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: INFO nova.api.openstack.requestlog [None req-eb95d17a-380a-4688-a8ea-dcdef70c1d0e tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] 10.222.0.75 "GET /compute/v2.1/servers/bf2f6303-22b9-4cfa-8d4d-61d2503bc554" status: 200 len: 1810 microversion: 2.20 time: 0.536666 May 26 12:43:50.189311 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: [pid: 129321|app: 0|req: 339/697] 10.222.0.75 () {60 vars in 1276 bytes} [Thu May 26 12:43:49 2022] GET /compute/v2.1/servers/bf2f6303-22b9-4cfa-8d4d-61d2503bc554 => generated 1810 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 12:43:51.207144 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi [None req-e69aa0e9-0c67-490b-a635-3e65b6d46d37 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Calling method '>' {{(pid=129322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:43:51.208540 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.compute.api [None req-e69aa0e9-0c67-490b-a635-3e65b6d46d37 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] [instance: bf2f6303-22b9-4cfa-8d4d-61d2503bc554] Fetching instance by UUID {{(pid=129322) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:43:51.218621 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-e69aa0e9-0c67-490b-a635-3e65b6d46d37 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:43:51.219082 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-e69aa0e9-0c67-490b-a635-3e65b6d46d37 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:43:51.219899 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-e69aa0e9-0c67-490b-a635-3e65b6d46d37 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:43:51.220951 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-e69aa0e9-0c67-490b-a635-3e65b6d46d37 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:43:51.406814 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.policy [None req-e69aa0e9-0c67-490b-a635-3e65b6d46d37 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e811736979c44b02b14fecb74c6bd7ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675272fb40d4847819f83ec04afecef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129322) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:43:51.418228 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.policy [None req-e69aa0e9-0c67-490b-a635-3e65b6d46d37 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e811736979c44b02b14fecb74c6bd7ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675272fb40d4847819f83ec04afecef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129322) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:43:51.420138 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.policy [None req-e69aa0e9-0c67-490b-a635-3e65b6d46d37 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e811736979c44b02b14fecb74c6bd7ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675272fb40d4847819f83ec04afecef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129322) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:43:51.421617 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: INFO nova.api.openstack.requestlog [None req-e69aa0e9-0c67-490b-a635-3e65b6d46d37 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] 10.222.0.75 "GET /compute/v2.1/servers/bf2f6303-22b9-4cfa-8d4d-61d2503bc554" status: 200 len: 1810 microversion: 2.20 time: 0.218764 May 26 12:43:51.432310 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: [pid: 129322|app: 0|req: 359/698] 10.222.0.75 () {60 vars in 1276 bytes} [Thu May 26 12:43:51 2022] GET /compute/v2.1/servers/bf2f6303-22b9-4cfa-8d4d-61d2503bc554 => generated 1810 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 12:43:52.442779 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi [None req-c70de62a-6e36-4454-adcb-7166bbcc2cb9 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Calling method '>' {{(pid=129321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:43:52.444758 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.compute.api [None req-c70de62a-6e36-4454-adcb-7166bbcc2cb9 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] [instance: bf2f6303-22b9-4cfa-8d4d-61d2503bc554] Fetching instance by UUID {{(pid=129321) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:43:52.460280 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-c70de62a-6e36-4454-adcb-7166bbcc2cb9 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:43:52.461544 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-c70de62a-6e36-4454-adcb-7166bbcc2cb9 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:43:52.462657 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-c70de62a-6e36-4454-adcb-7166bbcc2cb9 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:43:52.468464 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-c70de62a-6e36-4454-adcb-7166bbcc2cb9 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:43:52.747575 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.policy [None req-c70de62a-6e36-4454-adcb-7166bbcc2cb9 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e811736979c44b02b14fecb74c6bd7ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675272fb40d4847819f83ec04afecef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129321) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:43:52.758460 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.policy [None req-c70de62a-6e36-4454-adcb-7166bbcc2cb9 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e811736979c44b02b14fecb74c6bd7ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675272fb40d4847819f83ec04afecef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129321) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:43:52.760570 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.policy [None req-c70de62a-6e36-4454-adcb-7166bbcc2cb9 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e811736979c44b02b14fecb74c6bd7ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675272fb40d4847819f83ec04afecef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129321) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:43:52.762063 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: INFO nova.api.openstack.requestlog [None req-c70de62a-6e36-4454-adcb-7166bbcc2cb9 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] 10.222.0.75 "GET /compute/v2.1/servers/bf2f6303-22b9-4cfa-8d4d-61d2503bc554" status: 200 len: 1810 microversion: 2.20 time: 0.324629 May 26 12:43:52.762866 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: [pid: 129321|app: 0|req: 340/699] 10.222.0.75 () {60 vars in 1276 bytes} [Thu May 26 12:43:52 2022] GET /compute/v2.1/servers/bf2f6303-22b9-4cfa-8d4d-61d2503bc554 => generated 1810 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 12:43:53.787247 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi [None req-25d1a36f-b98a-4e24-9f97-3aed9afa9d89 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Calling method '>' {{(pid=129322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:43:53.788619 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.compute.api [None req-25d1a36f-b98a-4e24-9f97-3aed9afa9d89 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] [instance: bf2f6303-22b9-4cfa-8d4d-61d2503bc554] Fetching instance by UUID {{(pid=129322) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:43:53.797478 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-25d1a36f-b98a-4e24-9f97-3aed9afa9d89 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:43:53.798270 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-25d1a36f-b98a-4e24-9f97-3aed9afa9d89 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:43:53.799313 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-25d1a36f-b98a-4e24-9f97-3aed9afa9d89 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:43:53.799972 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-25d1a36f-b98a-4e24-9f97-3aed9afa9d89 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:43:53.803640 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG dbcounter [-] [129322] Writing DB stats nova_cell1:INSERT=4,nova_cell1:SELECT=92,nova_cell1:UPDATE=4 {{(pid=129322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:43:53.976989 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.policy [None req-25d1a36f-b98a-4e24-9f97-3aed9afa9d89 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e811736979c44b02b14fecb74c6bd7ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675272fb40d4847819f83ec04afecef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129322) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:43:53.991219 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.policy [None req-25d1a36f-b98a-4e24-9f97-3aed9afa9d89 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e811736979c44b02b14fecb74c6bd7ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675272fb40d4847819f83ec04afecef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129322) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:43:53.994784 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.policy [None req-25d1a36f-b98a-4e24-9f97-3aed9afa9d89 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e811736979c44b02b14fecb74c6bd7ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675272fb40d4847819f83ec04afecef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129322) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:43:53.996643 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: INFO nova.api.openstack.requestlog [None req-25d1a36f-b98a-4e24-9f97-3aed9afa9d89 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] 10.222.0.75 "GET /compute/v2.1/servers/bf2f6303-22b9-4cfa-8d4d-61d2503bc554" status: 200 len: 1810 microversion: 2.20 time: 0.217920 May 26 12:43:53.997634 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: [pid: 129322|app: 0|req: 360/700] 10.222.0.75 () {60 vars in 1276 bytes} [Thu May 26 12:43:53 2022] GET /compute/v2.1/servers/bf2f6303-22b9-4cfa-8d4d-61d2503bc554 => generated 1810 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 12:43:55.017217 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi [None req-c41e5abb-2d2f-4478-bf8c-1a946fe26d98 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Calling method '>' {{(pid=129321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:43:55.018865 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.compute.api [None req-c41e5abb-2d2f-4478-bf8c-1a946fe26d98 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] [instance: bf2f6303-22b9-4cfa-8d4d-61d2503bc554] Fetching instance by UUID {{(pid=129321) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:43:55.027056 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-c41e5abb-2d2f-4478-bf8c-1a946fe26d98 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:43:55.027997 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-c41e5abb-2d2f-4478-bf8c-1a946fe26d98 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:43:55.029164 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-c41e5abb-2d2f-4478-bf8c-1a946fe26d98 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:43:55.029798 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-c41e5abb-2d2f-4478-bf8c-1a946fe26d98 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:43:55.195223 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.policy [None req-c41e5abb-2d2f-4478-bf8c-1a946fe26d98 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e811736979c44b02b14fecb74c6bd7ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675272fb40d4847819f83ec04afecef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129321) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:43:55.206481 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.policy [None req-c41e5abb-2d2f-4478-bf8c-1a946fe26d98 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e811736979c44b02b14fecb74c6bd7ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675272fb40d4847819f83ec04afecef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129321) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:43:55.208621 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.policy [None req-c41e5abb-2d2f-4478-bf8c-1a946fe26d98 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e811736979c44b02b14fecb74c6bd7ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675272fb40d4847819f83ec04afecef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129321) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:43:55.210126 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: INFO nova.api.openstack.requestlog [None req-c41e5abb-2d2f-4478-bf8c-1a946fe26d98 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] 10.222.0.75 "GET /compute/v2.1/servers/bf2f6303-22b9-4cfa-8d4d-61d2503bc554" status: 200 len: 1810 microversion: 2.20 time: 0.197088 May 26 12:43:55.210911 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: [pid: 129321|app: 0|req: 341/701] 10.222.0.75 () {60 vars in 1276 bytes} [Thu May 26 12:43:55 2022] GET /compute/v2.1/servers/bf2f6303-22b9-4cfa-8d4d-61d2503bc554 => generated 1810 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 12:43:56.246152 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi [None req-013a6c1d-a88f-4401-9f50-2949477acfad tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Calling method '>' {{(pid=129322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:43:56.248356 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.compute.api [None req-013a6c1d-a88f-4401-9f50-2949477acfad tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] [instance: bf2f6303-22b9-4cfa-8d4d-61d2503bc554] Fetching instance by UUID {{(pid=129322) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:43:56.263215 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-013a6c1d-a88f-4401-9f50-2949477acfad tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:43:56.263805 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-013a6c1d-a88f-4401-9f50-2949477acfad tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:43:56.264943 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-013a6c1d-a88f-4401-9f50-2949477acfad tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:43:56.266402 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-013a6c1d-a88f-4401-9f50-2949477acfad tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:43:56.504272 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.policy [None req-013a6c1d-a88f-4401-9f50-2949477acfad tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e811736979c44b02b14fecb74c6bd7ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675272fb40d4847819f83ec04afecef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129322) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:43:56.524720 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.policy [None req-013a6c1d-a88f-4401-9f50-2949477acfad tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e811736979c44b02b14fecb74c6bd7ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675272fb40d4847819f83ec04afecef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129322) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:43:56.527724 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.policy [None req-013a6c1d-a88f-4401-9f50-2949477acfad tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e811736979c44b02b14fecb74c6bd7ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675272fb40d4847819f83ec04afecef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129322) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:43:56.529430 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: INFO nova.api.openstack.requestlog [None req-013a6c1d-a88f-4401-9f50-2949477acfad tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] 10.222.0.75 "GET /compute/v2.1/servers/bf2f6303-22b9-4cfa-8d4d-61d2503bc554" status: 200 len: 1810 microversion: 2.20 time: 0.289933 May 26 12:43:56.544250 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: [pid: 129322|app: 0|req: 361/702] 10.222.0.75 () {60 vars in 1276 bytes} [Thu May 26 12:43:56 2022] GET /compute/v2.1/servers/bf2f6303-22b9-4cfa-8d4d-61d2503bc554 => generated 1810 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 12:43:57.561026 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi [None req-0885474b-f315-4cfd-bb4d-6ee9ed1a3517 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Calling method '>' {{(pid=129321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:43:57.561026 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.compute.api [None req-0885474b-f315-4cfd-bb4d-6ee9ed1a3517 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] [instance: bf2f6303-22b9-4cfa-8d4d-61d2503bc554] Fetching instance by UUID {{(pid=129321) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:43:57.571446 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG dbcounter [-] [129321] Writing DB stats nova_api:SELECT=55,nova_api:UPDATE=1 {{(pid=129321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:43:57.573058 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-0885474b-f315-4cfd-bb4d-6ee9ed1a3517 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:43:57.573453 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-0885474b-f315-4cfd-bb4d-6ee9ed1a3517 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:43:57.574224 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-0885474b-f315-4cfd-bb4d-6ee9ed1a3517 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:43:57.574649 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-0885474b-f315-4cfd-bb4d-6ee9ed1a3517 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:43:57.769209 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.policy [None req-0885474b-f315-4cfd-bb4d-6ee9ed1a3517 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e811736979c44b02b14fecb74c6bd7ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675272fb40d4847819f83ec04afecef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129321) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:43:57.797759 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.policy [None req-0885474b-f315-4cfd-bb4d-6ee9ed1a3517 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e811736979c44b02b14fecb74c6bd7ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675272fb40d4847819f83ec04afecef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129321) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:43:57.799755 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.policy [None req-0885474b-f315-4cfd-bb4d-6ee9ed1a3517 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e811736979c44b02b14fecb74c6bd7ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675272fb40d4847819f83ec04afecef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129321) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:43:57.802620 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: INFO nova.api.openstack.requestlog [None req-0885474b-f315-4cfd-bb4d-6ee9ed1a3517 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] 10.222.0.75 "GET /compute/v2.1/servers/bf2f6303-22b9-4cfa-8d4d-61d2503bc554" status: 200 len: 1810 microversion: 2.20 time: 0.248019 May 26 12:43:57.805024 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: [pid: 129321|app: 0|req: 342/703] 10.222.0.75 () {60 vars in 1276 bytes} [Thu May 26 12:43:57 2022] GET /compute/v2.1/servers/bf2f6303-22b9-4cfa-8d4d-61d2503bc554 => generated 1810 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 12:43:58.831777 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi [None req-e8419a68-6c49-4995-aef2-3f73eda4ede9 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Calling method '>' {{(pid=129322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:43:58.832899 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.compute.api [None req-e8419a68-6c49-4995-aef2-3f73eda4ede9 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] [instance: bf2f6303-22b9-4cfa-8d4d-61d2503bc554] Fetching instance by UUID {{(pid=129322) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:43:58.845901 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-e8419a68-6c49-4995-aef2-3f73eda4ede9 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:43:58.846744 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-e8419a68-6c49-4995-aef2-3f73eda4ede9 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:43:58.848149 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-e8419a68-6c49-4995-aef2-3f73eda4ede9 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:43:58.849987 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-e8419a68-6c49-4995-aef2-3f73eda4ede9 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:43:59.053809 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.policy [None req-e8419a68-6c49-4995-aef2-3f73eda4ede9 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e811736979c44b02b14fecb74c6bd7ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675272fb40d4847819f83ec04afecef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129322) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:43:59.062989 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.policy [None req-e8419a68-6c49-4995-aef2-3f73eda4ede9 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e811736979c44b02b14fecb74c6bd7ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675272fb40d4847819f83ec04afecef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129322) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:43:59.064509 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.policy [None req-e8419a68-6c49-4995-aef2-3f73eda4ede9 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e811736979c44b02b14fecb74c6bd7ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675272fb40d4847819f83ec04afecef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129322) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:43:59.065675 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: INFO nova.api.openstack.requestlog [None req-e8419a68-6c49-4995-aef2-3f73eda4ede9 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] 10.222.0.75 "GET /compute/v2.1/servers/bf2f6303-22b9-4cfa-8d4d-61d2503bc554" status: 200 len: 1810 microversion: 2.20 time: 0.241422 May 26 12:43:59.066226 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: [pid: 129322|app: 0|req: 362/704] 10.222.0.75 () {60 vars in 1276 bytes} [Thu May 26 12:43:58 2022] GET /compute/v2.1/servers/bf2f6303-22b9-4cfa-8d4d-61d2503bc554 => generated 1810 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 12:44:00.084448 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi [None req-a3e30831-78d2-4c9f-848a-10abae12e072 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Calling method '>' {{(pid=129321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:44:00.085880 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.compute.api [None req-a3e30831-78d2-4c9f-848a-10abae12e072 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] [instance: bf2f6303-22b9-4cfa-8d4d-61d2503bc554] Fetching instance by UUID {{(pid=129321) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:44:00.093389 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-a3e30831-78d2-4c9f-848a-10abae12e072 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:44:00.093886 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-a3e30831-78d2-4c9f-848a-10abae12e072 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:44:00.094661 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-a3e30831-78d2-4c9f-848a-10abae12e072 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:44:00.095093 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-a3e30831-78d2-4c9f-848a-10abae12e072 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:44:00.271792 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.policy [None req-a3e30831-78d2-4c9f-848a-10abae12e072 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e811736979c44b02b14fecb74c6bd7ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675272fb40d4847819f83ec04afecef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129321) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:44:00.284004 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.policy [None req-a3e30831-78d2-4c9f-848a-10abae12e072 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e811736979c44b02b14fecb74c6bd7ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675272fb40d4847819f83ec04afecef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129321) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:44:00.285794 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.policy [None req-a3e30831-78d2-4c9f-848a-10abae12e072 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e811736979c44b02b14fecb74c6bd7ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675272fb40d4847819f83ec04afecef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129321) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:44:00.287131 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: INFO nova.api.openstack.requestlog [None req-a3e30831-78d2-4c9f-848a-10abae12e072 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] 10.222.0.75 "GET /compute/v2.1/servers/bf2f6303-22b9-4cfa-8d4d-61d2503bc554" status: 200 len: 1810 microversion: 2.20 time: 0.206642 May 26 12:44:00.287908 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: [pid: 129321|app: 0|req: 343/705] 10.222.0.75 () {60 vars in 1276 bytes} [Thu May 26 12:44:00 2022] GET /compute/v2.1/servers/bf2f6303-22b9-4cfa-8d4d-61d2503bc554 => generated 1810 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 12:44:01.311901 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi [None req-e7c55958-2079-4f26-a03f-4ff3d72d83b5 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Calling method '>' {{(pid=129322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:44:01.317690 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.compute.api [None req-e7c55958-2079-4f26-a03f-4ff3d72d83b5 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] [instance: bf2f6303-22b9-4cfa-8d4d-61d2503bc554] Fetching instance by UUID {{(pid=129322) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:44:01.328807 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-e7c55958-2079-4f26-a03f-4ff3d72d83b5 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:44:01.330200 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-e7c55958-2079-4f26-a03f-4ff3d72d83b5 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:44:01.331211 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-e7c55958-2079-4f26-a03f-4ff3d72d83b5 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:44:01.331945 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-e7c55958-2079-4f26-a03f-4ff3d72d83b5 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:44:01.483741 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.policy [None req-e7c55958-2079-4f26-a03f-4ff3d72d83b5 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e811736979c44b02b14fecb74c6bd7ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675272fb40d4847819f83ec04afecef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129322) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:44:01.493158 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.policy [None req-e7c55958-2079-4f26-a03f-4ff3d72d83b5 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e811736979c44b02b14fecb74c6bd7ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675272fb40d4847819f83ec04afecef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129322) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:44:01.494627 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.policy [None req-e7c55958-2079-4f26-a03f-4ff3d72d83b5 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e811736979c44b02b14fecb74c6bd7ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675272fb40d4847819f83ec04afecef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129322) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:44:01.495922 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: INFO nova.api.openstack.requestlog [None req-e7c55958-2079-4f26-a03f-4ff3d72d83b5 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] 10.222.0.75 "GET /compute/v2.1/servers/bf2f6303-22b9-4cfa-8d4d-61d2503bc554" status: 200 len: 1810 microversion: 2.20 time: 0.193035 May 26 12:44:01.496486 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: [pid: 129322|app: 0|req: 363/706] 10.222.0.75 () {60 vars in 1276 bytes} [Thu May 26 12:44:01 2022] GET /compute/v2.1/servers/bf2f6303-22b9-4cfa-8d4d-61d2503bc554 => generated 1810 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 12:44:02.518013 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi [None req-befd7dbd-b92f-4693-b8b3-c86a39aa7aef tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Calling method '>' {{(pid=129321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:44:02.518849 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.compute.api [None req-befd7dbd-b92f-4693-b8b3-c86a39aa7aef tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] [instance: bf2f6303-22b9-4cfa-8d4d-61d2503bc554] Fetching instance by UUID {{(pid=129321) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:44:02.532909 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-befd7dbd-b92f-4693-b8b3-c86a39aa7aef tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:44:02.533720 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-befd7dbd-b92f-4693-b8b3-c86a39aa7aef tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:44:02.535324 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-befd7dbd-b92f-4693-b8b3-c86a39aa7aef tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:44:02.536206 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-befd7dbd-b92f-4693-b8b3-c86a39aa7aef tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:44:02.746761 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.policy [None req-befd7dbd-b92f-4693-b8b3-c86a39aa7aef tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e811736979c44b02b14fecb74c6bd7ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675272fb40d4847819f83ec04afecef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129321) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:44:02.756568 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.policy [None req-befd7dbd-b92f-4693-b8b3-c86a39aa7aef tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e811736979c44b02b14fecb74c6bd7ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675272fb40d4847819f83ec04afecef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129321) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:44:02.757894 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.policy [None req-befd7dbd-b92f-4693-b8b3-c86a39aa7aef tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e811736979c44b02b14fecb74c6bd7ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675272fb40d4847819f83ec04afecef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129321) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:44:02.759095 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: INFO nova.api.openstack.requestlog [None req-befd7dbd-b92f-4693-b8b3-c86a39aa7aef tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] 10.222.0.75 "GET /compute/v2.1/servers/bf2f6303-22b9-4cfa-8d4d-61d2503bc554" status: 200 len: 1810 microversion: 2.20 time: 0.248621 May 26 12:44:02.759717 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: [pid: 129321|app: 0|req: 344/707] 10.222.0.75 () {60 vars in 1276 bytes} [Thu May 26 12:44:02 2022] GET /compute/v2.1/servers/bf2f6303-22b9-4cfa-8d4d-61d2503bc554 => generated 1810 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 12:44:03.608352 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi [None req-4fca459b-e484-4d95-88a2-afb5753e808d tempest-VolumesSnapshotTestJSON-1904508205 tempest-VolumesSnapshotTestJSON-1904508205-project] Calling method '>' {{(pid=129322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:44:03.608857 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.compute.api [None req-4fca459b-e484-4d95-88a2-afb5753e808d tempest-VolumesSnapshotTestJSON-1904508205 tempest-VolumesSnapshotTestJSON-1904508205-project] [instance: 6a87df93-cf49-465a-80dd-102efb0f8b11] Fetching instance by UUID {{(pid=129322) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:44:03.615953 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-4fca459b-e484-4d95-88a2-afb5753e808d tempest-VolumesSnapshotTestJSON-1904508205 tempest-VolumesSnapshotTestJSON-1904508205-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:44:03.616781 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-4fca459b-e484-4d95-88a2-afb5753e808d tempest-VolumesSnapshotTestJSON-1904508205 tempest-VolumesSnapshotTestJSON-1904508205-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:44:03.617747 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-4fca459b-e484-4d95-88a2-afb5753e808d tempest-VolumesSnapshotTestJSON-1904508205 tempest-VolumesSnapshotTestJSON-1904508205-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:44:03.618481 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-4fca459b-e484-4d95-88a2-afb5753e808d tempest-VolumesSnapshotTestJSON-1904508205 tempest-VolumesSnapshotTestJSON-1904508205-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:44:03.766888 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.objects.instance [None req-4fca459b-e484-4d95-88a2-afb5753e808d tempest-VolumesSnapshotTestJSON-1904508205 tempest-VolumesSnapshotTestJSON-1904508205-project] Lazy-loading 'services' on Instance uuid 6a87df93-cf49-465a-80dd-102efb0f8b11 {{(pid=129322) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 26 12:44:03.783689 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi [None req-7a17f2b8-16c5-449c-bdd7-bf4fb6332a6f tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Calling method '>' {{(pid=129321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:44:03.785846 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.compute.api [None req-7a17f2b8-16c5-449c-bdd7-bf4fb6332a6f tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] [instance: bf2f6303-22b9-4cfa-8d4d-61d2503bc554] Fetching instance by UUID {{(pid=129321) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:44:03.812840 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-7a17f2b8-16c5-449c-bdd7-bf4fb6332a6f tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:44:03.813799 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-7a17f2b8-16c5-449c-bdd7-bf4fb6332a6f tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:44:03.814845 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-7a17f2b8-16c5-449c-bdd7-bf4fb6332a6f tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:44:03.815524 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-7a17f2b8-16c5-449c-bdd7-bf4fb6332a6f tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:44:03.965084 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: INFO nova.api.openstack.requestlog [None req-4fca459b-e484-4d95-88a2-afb5753e808d tempest-VolumesSnapshotTestJSON-1904508205 tempest-VolumesSnapshotTestJSON-1904508205-project] 10.222.0.75 "DELETE /compute/v2.1/servers/6a87df93-cf49-465a-80dd-102efb0f8b11/os-volume_attachments/e8006328-9910-4679-b64c-db32c8ba4810" status: 202 len: 0 microversion: 2.1 time: 0.357781 May 26 12:44:03.966506 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: [pid: 129322|app: 0|req: 364/708] 10.222.0.75 () {58 vars in 1415 bytes} [Thu May 26 12:44:03 2022] DELETE /compute/v2.1/servers/6a87df93-cf49-465a-80dd-102efb0f8b11/os-volume_attachments/e8006328-9910-4679-b64c-db32c8ba4810 => generated 0 bytes in 364 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 26 12:44:03.999807 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.policy [None req-7a17f2b8-16c5-449c-bdd7-bf4fb6332a6f tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e811736979c44b02b14fecb74c6bd7ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675272fb40d4847819f83ec04afecef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129321) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:44:04.013842 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.policy [None req-7a17f2b8-16c5-449c-bdd7-bf4fb6332a6f tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e811736979c44b02b14fecb74c6bd7ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675272fb40d4847819f83ec04afecef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129321) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:44:04.015675 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.policy [None req-7a17f2b8-16c5-449c-bdd7-bf4fb6332a6f tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e811736979c44b02b14fecb74c6bd7ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675272fb40d4847819f83ec04afecef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129321) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:44:04.016916 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: INFO nova.api.openstack.requestlog [None req-7a17f2b8-16c5-449c-bdd7-bf4fb6332a6f tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] 10.222.0.75 "GET /compute/v2.1/servers/bf2f6303-22b9-4cfa-8d4d-61d2503bc554" status: 200 len: 1810 microversion: 2.20 time: 0.240463 May 26 12:44:04.017813 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: [pid: 129321|app: 0|req: 345/709] 10.222.0.75 () {60 vars in 1276 bytes} [Thu May 26 12:44:03 2022] GET /compute/v2.1/servers/bf2f6303-22b9-4cfa-8d4d-61d2503bc554 => generated 1810 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 12:44:05.038393 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi [None req-c84f7a14-4a73-437d-aef3-628c721ff8fe tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Calling method '>' {{(pid=129322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:44:05.039475 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.compute.api [None req-c84f7a14-4a73-437d-aef3-628c721ff8fe tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] [instance: bf2f6303-22b9-4cfa-8d4d-61d2503bc554] Fetching instance by UUID {{(pid=129322) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:44:05.046519 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-c84f7a14-4a73-437d-aef3-628c721ff8fe tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:44:05.047407 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-c84f7a14-4a73-437d-aef3-628c721ff8fe tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:44:05.047768 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-c84f7a14-4a73-437d-aef3-628c721ff8fe tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:44:05.048166 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-c84f7a14-4a73-437d-aef3-628c721ff8fe tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:44:05.200059 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.policy [None req-c84f7a14-4a73-437d-aef3-628c721ff8fe tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e811736979c44b02b14fecb74c6bd7ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675272fb40d4847819f83ec04afecef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129322) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:44:05.211470 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.policy [None req-c84f7a14-4a73-437d-aef3-628c721ff8fe tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e811736979c44b02b14fecb74c6bd7ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675272fb40d4847819f83ec04afecef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129322) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:44:05.213546 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.policy [None req-c84f7a14-4a73-437d-aef3-628c721ff8fe tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e811736979c44b02b14fecb74c6bd7ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675272fb40d4847819f83ec04afecef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129322) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:44:05.217008 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: INFO nova.api.openstack.requestlog [None req-c84f7a14-4a73-437d-aef3-628c721ff8fe tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] 10.222.0.75 "GET /compute/v2.1/servers/bf2f6303-22b9-4cfa-8d4d-61d2503bc554" status: 200 len: 1810 microversion: 2.20 time: 0.181707 May 26 12:44:05.217008 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: [pid: 129322|app: 0|req: 365/710] 10.222.0.75 () {60 vars in 1276 bytes} [Thu May 26 12:44:05 2022] GET /compute/v2.1/servers/bf2f6303-22b9-4cfa-8d4d-61d2503bc554 => generated 1810 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 12:44:06.243771 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi [None req-dc0f1d27-0e31-4cf6-8e8d-ea2fc3d82103 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Calling method '>' {{(pid=129321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:44:06.244534 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.compute.api [None req-dc0f1d27-0e31-4cf6-8e8d-ea2fc3d82103 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] [instance: bf2f6303-22b9-4cfa-8d4d-61d2503bc554] Fetching instance by UUID {{(pid=129321) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:44:06.253326 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-dc0f1d27-0e31-4cf6-8e8d-ea2fc3d82103 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:44:06.253942 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-dc0f1d27-0e31-4cf6-8e8d-ea2fc3d82103 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:44:06.254723 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-dc0f1d27-0e31-4cf6-8e8d-ea2fc3d82103 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:44:06.255149 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-dc0f1d27-0e31-4cf6-8e8d-ea2fc3d82103 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:44:06.258237 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG dbcounter [-] [129321] Writing DB stats nova_cell1:SELECT=84,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:44:06.438904 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.policy [None req-dc0f1d27-0e31-4cf6-8e8d-ea2fc3d82103 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e811736979c44b02b14fecb74c6bd7ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675272fb40d4847819f83ec04afecef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129321) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:44:06.451377 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.policy [None req-dc0f1d27-0e31-4cf6-8e8d-ea2fc3d82103 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e811736979c44b02b14fecb74c6bd7ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675272fb40d4847819f83ec04afecef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129321) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:44:06.452793 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.policy [None req-dc0f1d27-0e31-4cf6-8e8d-ea2fc3d82103 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e811736979c44b02b14fecb74c6bd7ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675272fb40d4847819f83ec04afecef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129321) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:44:06.454011 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: INFO nova.api.openstack.requestlog [None req-dc0f1d27-0e31-4cf6-8e8d-ea2fc3d82103 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] 10.222.0.75 "GET /compute/v2.1/servers/bf2f6303-22b9-4cfa-8d4d-61d2503bc554" status: 200 len: 1810 microversion: 2.20 time: 0.221174 May 26 12:44:06.454783 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: [pid: 129321|app: 0|req: 346/711] 10.222.0.75 () {60 vars in 1276 bytes} [Thu May 26 12:44:06 2022] GET /compute/v2.1/servers/bf2f6303-22b9-4cfa-8d4d-61d2503bc554 => generated 1810 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 12:44:07.472833 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi [None req-25ffdb08-a7c5-431c-b6f5-b11c52f91f4d tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Calling method '>' {{(pid=129322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:44:07.473697 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.compute.api [None req-25ffdb08-a7c5-431c-b6f5-b11c52f91f4d tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] [instance: bf2f6303-22b9-4cfa-8d4d-61d2503bc554] Fetching instance by UUID {{(pid=129322) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:44:07.481405 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-25ffdb08-a7c5-431c-b6f5-b11c52f91f4d tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:44:07.481846 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-25ffdb08-a7c5-431c-b6f5-b11c52f91f4d tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:44:07.482639 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-25ffdb08-a7c5-431c-b6f5-b11c52f91f4d tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:44:07.483073 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-25ffdb08-a7c5-431c-b6f5-b11c52f91f4d tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:44:07.631667 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.policy [None req-25ffdb08-a7c5-431c-b6f5-b11c52f91f4d tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e811736979c44b02b14fecb74c6bd7ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675272fb40d4847819f83ec04afecef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129322) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:44:07.643897 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.policy [None req-25ffdb08-a7c5-431c-b6f5-b11c52f91f4d tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e811736979c44b02b14fecb74c6bd7ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675272fb40d4847819f83ec04afecef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129322) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:44:07.645815 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.policy [None req-25ffdb08-a7c5-431c-b6f5-b11c52f91f4d tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e811736979c44b02b14fecb74c6bd7ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675272fb40d4847819f83ec04afecef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129322) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:44:07.647013 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: INFO nova.api.openstack.requestlog [None req-25ffdb08-a7c5-431c-b6f5-b11c52f91f4d tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] 10.222.0.75 "GET /compute/v2.1/servers/bf2f6303-22b9-4cfa-8d4d-61d2503bc554" status: 200 len: 1810 microversion: 2.20 time: 0.178433 May 26 12:44:07.647686 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: [pid: 129322|app: 0|req: 366/712] 10.222.0.75 () {60 vars in 1276 bytes} [Thu May 26 12:44:07 2022] GET /compute/v2.1/servers/bf2f6303-22b9-4cfa-8d4d-61d2503bc554 => generated 1810 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 12:44:08.668822 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi [None req-346848bc-d7b0-4dfc-9a59-f771342f6944 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Calling method '>' {{(pid=129321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:44:08.669718 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.compute.api [None req-346848bc-d7b0-4dfc-9a59-f771342f6944 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] [instance: bf2f6303-22b9-4cfa-8d4d-61d2503bc554] Fetching instance by UUID {{(pid=129321) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:44:08.676812 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-346848bc-d7b0-4dfc-9a59-f771342f6944 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:44:08.677257 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-346848bc-d7b0-4dfc-9a59-f771342f6944 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:44:08.678021 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-346848bc-d7b0-4dfc-9a59-f771342f6944 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:44:08.678455 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-346848bc-d7b0-4dfc-9a59-f771342f6944 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:44:08.834604 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.policy [None req-346848bc-d7b0-4dfc-9a59-f771342f6944 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e811736979c44b02b14fecb74c6bd7ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675272fb40d4847819f83ec04afecef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129321) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:44:08.844154 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.policy [None req-346848bc-d7b0-4dfc-9a59-f771342f6944 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e811736979c44b02b14fecb74c6bd7ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675272fb40d4847819f83ec04afecef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129321) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:44:08.845656 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.policy [None req-346848bc-d7b0-4dfc-9a59-f771342f6944 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e811736979c44b02b14fecb74c6bd7ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675272fb40d4847819f83ec04afecef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129321) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:44:08.846823 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: INFO nova.api.openstack.requestlog [None req-346848bc-d7b0-4dfc-9a59-f771342f6944 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] 10.222.0.75 "GET /compute/v2.1/servers/bf2f6303-22b9-4cfa-8d4d-61d2503bc554" status: 200 len: 1810 microversion: 2.20 time: 0.184117 May 26 12:44:08.847396 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: [pid: 129321|app: 0|req: 347/713] 10.222.0.75 () {60 vars in 1276 bytes} [Thu May 26 12:44:08 2022] GET /compute/v2.1/servers/bf2f6303-22b9-4cfa-8d4d-61d2503bc554 => generated 1810 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 26 12:44:09.866966 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi [None req-b0ebf950-3a19-4807-a9df-a2ac30e818dc tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Calling method '>' {{(pid=129322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:44:09.867561 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.compute.api [None req-b0ebf950-3a19-4807-a9df-a2ac30e818dc tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] [instance: bf2f6303-22b9-4cfa-8d4d-61d2503bc554] Fetching instance by UUID {{(pid=129322) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:44:09.870013 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG dbcounter [-] [129322] Writing DB stats nova_api:SELECT=26 {{(pid=129322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:44:09.877141 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-b0ebf950-3a19-4807-a9df-a2ac30e818dc tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:44:09.877632 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-b0ebf950-3a19-4807-a9df-a2ac30e818dc tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:44:09.878645 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-b0ebf950-3a19-4807-a9df-a2ac30e818dc tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:44:09.879080 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-b0ebf950-3a19-4807-a9df-a2ac30e818dc tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:44:10.029491 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.policy [None req-b0ebf950-3a19-4807-a9df-a2ac30e818dc tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e811736979c44b02b14fecb74c6bd7ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675272fb40d4847819f83ec04afecef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129322) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:44:10.041127 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.policy [None req-b0ebf950-3a19-4807-a9df-a2ac30e818dc tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e811736979c44b02b14fecb74c6bd7ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675272fb40d4847819f83ec04afecef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129322) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:44:10.042802 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.policy [None req-b0ebf950-3a19-4807-a9df-a2ac30e818dc tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e811736979c44b02b14fecb74c6bd7ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675272fb40d4847819f83ec04afecef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129322) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:44:10.044012 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: INFO nova.api.openstack.requestlog [None req-b0ebf950-3a19-4807-a9df-a2ac30e818dc tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] 10.222.0.75 "GET /compute/v2.1/servers/bf2f6303-22b9-4cfa-8d4d-61d2503bc554" status: 200 len: 1810 microversion: 2.20 time: 0.181720 May 26 12:44:10.044883 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: [pid: 129322|app: 0|req: 367/714] 10.222.0.75 () {60 vars in 1276 bytes} [Thu May 26 12:44:09 2022] GET /compute/v2.1/servers/bf2f6303-22b9-4cfa-8d4d-61d2503bc554 => generated 1810 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 12:44:11.064494 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi [None req-c0794665-9ec9-4c8c-89f4-90b8d22b0501 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Calling method '>' {{(pid=129321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:44:11.065074 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.compute.api [None req-c0794665-9ec9-4c8c-89f4-90b8d22b0501 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] [instance: bf2f6303-22b9-4cfa-8d4d-61d2503bc554] Fetching instance by UUID {{(pid=129321) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:44:11.073450 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-c0794665-9ec9-4c8c-89f4-90b8d22b0501 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:44:11.074057 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-c0794665-9ec9-4c8c-89f4-90b8d22b0501 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:44:11.075062 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-c0794665-9ec9-4c8c-89f4-90b8d22b0501 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:44:11.075962 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-c0794665-9ec9-4c8c-89f4-90b8d22b0501 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:44:11.289039 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.policy [None req-c0794665-9ec9-4c8c-89f4-90b8d22b0501 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e811736979c44b02b14fecb74c6bd7ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675272fb40d4847819f83ec04afecef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129321) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:44:11.304587 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.policy [None req-c0794665-9ec9-4c8c-89f4-90b8d22b0501 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e811736979c44b02b14fecb74c6bd7ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675272fb40d4847819f83ec04afecef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129321) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:44:11.306894 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.policy [None req-c0794665-9ec9-4c8c-89f4-90b8d22b0501 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e811736979c44b02b14fecb74c6bd7ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675272fb40d4847819f83ec04afecef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129321) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:44:11.308559 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: INFO nova.api.openstack.requestlog [None req-c0794665-9ec9-4c8c-89f4-90b8d22b0501 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] 10.222.0.75 "GET /compute/v2.1/servers/bf2f6303-22b9-4cfa-8d4d-61d2503bc554" status: 200 len: 1810 microversion: 2.20 time: 0.248883 May 26 12:44:11.317295 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: [pid: 129321|app: 0|req: 348/715] 10.222.0.75 () {60 vars in 1276 bytes} [Thu May 26 12:44:11 2022] GET /compute/v2.1/servers/bf2f6303-22b9-4cfa-8d4d-61d2503bc554 => generated 1810 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 26 12:44:12.328164 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi [None req-1ce70743-ba53-4e1c-8aa8-76e24f72d718 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Calling method '>' {{(pid=129322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:44:12.329241 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.compute.api [None req-1ce70743-ba53-4e1c-8aa8-76e24f72d718 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] [instance: bf2f6303-22b9-4cfa-8d4d-61d2503bc554] Fetching instance by UUID {{(pid=129322) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:44:12.336859 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-1ce70743-ba53-4e1c-8aa8-76e24f72d718 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:44:12.337450 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-1ce70743-ba53-4e1c-8aa8-76e24f72d718 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:44:12.338239 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-1ce70743-ba53-4e1c-8aa8-76e24f72d718 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:44:12.338662 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-1ce70743-ba53-4e1c-8aa8-76e24f72d718 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:44:12.496195 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.policy [None req-1ce70743-ba53-4e1c-8aa8-76e24f72d718 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e811736979c44b02b14fecb74c6bd7ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675272fb40d4847819f83ec04afecef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129322) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:44:12.506599 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.policy [None req-1ce70743-ba53-4e1c-8aa8-76e24f72d718 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e811736979c44b02b14fecb74c6bd7ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675272fb40d4847819f83ec04afecef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129322) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:44:12.508425 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.policy [None req-1ce70743-ba53-4e1c-8aa8-76e24f72d718 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e811736979c44b02b14fecb74c6bd7ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675272fb40d4847819f83ec04afecef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129322) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:44:12.509932 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: INFO nova.api.openstack.requestlog [None req-1ce70743-ba53-4e1c-8aa8-76e24f72d718 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] 10.222.0.75 "GET /compute/v2.1/servers/bf2f6303-22b9-4cfa-8d4d-61d2503bc554" status: 200 len: 1810 microversion: 2.20 time: 0.185700 May 26 12:44:12.510710 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: [pid: 129322|app: 0|req: 368/716] 10.222.0.75 () {60 vars in 1276 bytes} [Thu May 26 12:44:12 2022] GET /compute/v2.1/servers/bf2f6303-22b9-4cfa-8d4d-61d2503bc554 => generated 1810 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 12:44:12.599040 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi [None req-aa493165-14d0-4f36-b041-2b783188aaf8 tempest-VolumesSnapshotTestJSON-1904508205 tempest-VolumesSnapshotTestJSON-1904508205-project] Calling method '>' {{(pid=129321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:44:12.599656 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.compute.api [None req-aa493165-14d0-4f36-b041-2b783188aaf8 tempest-VolumesSnapshotTestJSON-1904508205 tempest-VolumesSnapshotTestJSON-1904508205-project] [instance: 6a87df93-cf49-465a-80dd-102efb0f8b11] Fetching instance by UUID {{(pid=129321) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:44:12.606770 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-aa493165-14d0-4f36-b041-2b783188aaf8 tempest-VolumesSnapshotTestJSON-1904508205 tempest-VolumesSnapshotTestJSON-1904508205-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:44:12.607215 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-aa493165-14d0-4f36-b041-2b783188aaf8 tempest-VolumesSnapshotTestJSON-1904508205 tempest-VolumesSnapshotTestJSON-1904508205-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:44:12.608097 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-aa493165-14d0-4f36-b041-2b783188aaf8 tempest-VolumesSnapshotTestJSON-1904508205 tempest-VolumesSnapshotTestJSON-1904508205-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:44:12.608528 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-aa493165-14d0-4f36-b041-2b783188aaf8 tempest-VolumesSnapshotTestJSON-1904508205 tempest-VolumesSnapshotTestJSON-1904508205-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:44:12.638687 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.compute.api [None req-aa493165-14d0-4f36-b041-2b783188aaf8 tempest-VolumesSnapshotTestJSON-1904508205 tempest-VolumesSnapshotTestJSON-1904508205-project] [instance: 6a87df93-cf49-465a-80dd-102efb0f8b11] Going to try to terminate instance {{(pid=129321) delete /opt/stack/nova/nova/compute/api.py:2664}} May 26 12:44:12.722646 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: INFO nova.api.openstack.requestlog [None req-aa493165-14d0-4f36-b041-2b783188aaf8 tempest-VolumesSnapshotTestJSON-1904508205 tempest-VolumesSnapshotTestJSON-1904508205-project] 10.222.0.75 "DELETE /compute/v2.1/servers/6a87df93-cf49-465a-80dd-102efb0f8b11" status: 204 len: 0 microversion: 2.1 time: 0.128031 May 26 12:44:12.723348 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: [pid: 129321|app: 0|req: 349/717] 10.222.0.75 () {58 vars in 1238 bytes} [Thu May 26 12:44:12 2022] DELETE /compute/v2.1/servers/6a87df93-cf49-465a-80dd-102efb0f8b11 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) May 26 12:44:12.731777 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi [None req-284afced-c764-4d18-9106-2c4b1f5a4492 tempest-VolumesSnapshotTestJSON-1904508205 tempest-VolumesSnapshotTestJSON-1904508205-project] Calling method '>' {{(pid=129322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:44:12.732387 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.compute.api [None req-284afced-c764-4d18-9106-2c4b1f5a4492 tempest-VolumesSnapshotTestJSON-1904508205 tempest-VolumesSnapshotTestJSON-1904508205-project] [instance: 6a87df93-cf49-465a-80dd-102efb0f8b11] Fetching instance by UUID {{(pid=129322) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:44:12.741281 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-284afced-c764-4d18-9106-2c4b1f5a4492 tempest-VolumesSnapshotTestJSON-1904508205 tempest-VolumesSnapshotTestJSON-1904508205-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:44:12.741729 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-284afced-c764-4d18-9106-2c4b1f5a4492 tempest-VolumesSnapshotTestJSON-1904508205 tempest-VolumesSnapshotTestJSON-1904508205-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:44:12.742578 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-284afced-c764-4d18-9106-2c4b1f5a4492 tempest-VolumesSnapshotTestJSON-1904508205 tempest-VolumesSnapshotTestJSON-1904508205-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:44:12.743048 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-284afced-c764-4d18-9106-2c4b1f5a4492 tempest-VolumesSnapshotTestJSON-1904508205 tempest-VolumesSnapshotTestJSON-1904508205-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:44:12.913088 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.policy [None req-284afced-c764-4d18-9106-2c4b1f5a4492 tempest-VolumesSnapshotTestJSON-1904508205 tempest-VolumesSnapshotTestJSON-1904508205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '805854e5ce2e412fb9420afd63f73ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72bda4cbb07a43688506e01d06ba89c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129322) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:44:12.924371 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: INFO nova.api.openstack.requestlog [None req-284afced-c764-4d18-9106-2c4b1f5a4492 tempest-VolumesSnapshotTestJSON-1904508205 tempest-VolumesSnapshotTestJSON-1904508205-project] 10.222.0.75 "GET /compute/v2.1/servers/6a87df93-cf49-465a-80dd-102efb0f8b11" status: 200 len: 1513 microversion: 2.1 time: 0.195685 May 26 12:44:12.924751 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: [pid: 129322|app: 0|req: 369/718] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 26 12:44:12 2022] GET /compute/v2.1/servers/6a87df93-cf49-465a-80dd-102efb0f8b11 => generated 1513 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:44:13.531784 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi [None req-366679e5-7f67-45c2-848e-3abdf54e8892 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Calling method '>' {{(pid=129321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:44:13.532535 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.compute.api [None req-366679e5-7f67-45c2-848e-3abdf54e8892 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] [instance: bf2f6303-22b9-4cfa-8d4d-61d2503bc554] Fetching instance by UUID {{(pid=129321) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:44:13.538950 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-366679e5-7f67-45c2-848e-3abdf54e8892 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:44:13.539391 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-366679e5-7f67-45c2-848e-3abdf54e8892 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:44:13.540182 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-366679e5-7f67-45c2-848e-3abdf54e8892 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:44:13.540616 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-366679e5-7f67-45c2-848e-3abdf54e8892 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:44:13.705316 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.policy [None req-366679e5-7f67-45c2-848e-3abdf54e8892 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e811736979c44b02b14fecb74c6bd7ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675272fb40d4847819f83ec04afecef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129321) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:44:13.714565 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.policy [None req-366679e5-7f67-45c2-848e-3abdf54e8892 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e811736979c44b02b14fecb74c6bd7ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675272fb40d4847819f83ec04afecef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129321) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:44:13.716072 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.policy [None req-366679e5-7f67-45c2-848e-3abdf54e8892 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e811736979c44b02b14fecb74c6bd7ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675272fb40d4847819f83ec04afecef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129321) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:44:13.717250 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: INFO nova.api.openstack.requestlog [None req-366679e5-7f67-45c2-848e-3abdf54e8892 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] 10.222.0.75 "GET /compute/v2.1/servers/bf2f6303-22b9-4cfa-8d4d-61d2503bc554" status: 200 len: 1810 microversion: 2.20 time: 0.191407 May 26 12:44:13.717816 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: [pid: 129321|app: 0|req: 350/719] 10.222.0.75 () {60 vars in 1276 bytes} [Thu May 26 12:44:13 2022] GET /compute/v2.1/servers/bf2f6303-22b9-4cfa-8d4d-61d2503bc554 => generated 1810 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 26 12:44:13.941770 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi [None req-29b8ca3f-1932-4e49-91ad-707db3d0088f tempest-VolumesSnapshotTestJSON-1904508205 tempest-VolumesSnapshotTestJSON-1904508205-project] Calling method '>' {{(pid=129322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:44:13.942372 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.compute.api [None req-29b8ca3f-1932-4e49-91ad-707db3d0088f tempest-VolumesSnapshotTestJSON-1904508205 tempest-VolumesSnapshotTestJSON-1904508205-project] [instance: 6a87df93-cf49-465a-80dd-102efb0f8b11] Fetching instance by UUID {{(pid=129322) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:44:13.954552 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-29b8ca3f-1932-4e49-91ad-707db3d0088f tempest-VolumesSnapshotTestJSON-1904508205 tempest-VolumesSnapshotTestJSON-1904508205-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:44:13.954879 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-29b8ca3f-1932-4e49-91ad-707db3d0088f tempest-VolumesSnapshotTestJSON-1904508205 tempest-VolumesSnapshotTestJSON-1904508205-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:44:13.955760 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-29b8ca3f-1932-4e49-91ad-707db3d0088f tempest-VolumesSnapshotTestJSON-1904508205 tempest-VolumesSnapshotTestJSON-1904508205-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:44:13.956395 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-29b8ca3f-1932-4e49-91ad-707db3d0088f tempest-VolumesSnapshotTestJSON-1904508205 tempest-VolumesSnapshotTestJSON-1904508205-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:44:14.297898 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.policy [None req-29b8ca3f-1932-4e49-91ad-707db3d0088f tempest-VolumesSnapshotTestJSON-1904508205 tempest-VolumesSnapshotTestJSON-1904508205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '805854e5ce2e412fb9420afd63f73ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72bda4cbb07a43688506e01d06ba89c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129322) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:44:14.306725 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: INFO nova.api.openstack.requestlog [None req-29b8ca3f-1932-4e49-91ad-707db3d0088f tempest-VolumesSnapshotTestJSON-1904508205 tempest-VolumesSnapshotTestJSON-1904508205-project] 10.222.0.75 "GET /compute/v2.1/servers/6a87df93-cf49-465a-80dd-102efb0f8b11" status: 200 len: 1513 microversion: 2.1 time: 0.368843 May 26 12:44:14.307382 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: [pid: 129322|app: 0|req: 370/720] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 26 12:44:13 2022] GET /compute/v2.1/servers/6a87df93-cf49-465a-80dd-102efb0f8b11 => generated 1513 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:44:14.741391 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi [None req-1a585064-657b-4db1-b1f2-a2d7dbcbbf11 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Calling method '>' {{(pid=129321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:44:14.742191 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.compute.api [None req-1a585064-657b-4db1-b1f2-a2d7dbcbbf11 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] [instance: bf2f6303-22b9-4cfa-8d4d-61d2503bc554] Fetching instance by UUID {{(pid=129321) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:44:14.749753 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-1a585064-657b-4db1-b1f2-a2d7dbcbbf11 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:44:14.750206 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-1a585064-657b-4db1-b1f2-a2d7dbcbbf11 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:44:14.750985 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-1a585064-657b-4db1-b1f2-a2d7dbcbbf11 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:44:14.751419 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-1a585064-657b-4db1-b1f2-a2d7dbcbbf11 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:44:14.911556 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.policy [None req-1a585064-657b-4db1-b1f2-a2d7dbcbbf11 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e811736979c44b02b14fecb74c6bd7ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675272fb40d4847819f83ec04afecef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129321) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:44:14.921935 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.policy [None req-1a585064-657b-4db1-b1f2-a2d7dbcbbf11 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e811736979c44b02b14fecb74c6bd7ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675272fb40d4847819f83ec04afecef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129321) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:44:14.923210 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.policy [None req-1a585064-657b-4db1-b1f2-a2d7dbcbbf11 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e811736979c44b02b14fecb74c6bd7ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675272fb40d4847819f83ec04afecef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129321) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:44:14.924622 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: INFO nova.api.openstack.requestlog [None req-1a585064-657b-4db1-b1f2-a2d7dbcbbf11 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] 10.222.0.75 "GET /compute/v2.1/servers/bf2f6303-22b9-4cfa-8d4d-61d2503bc554" status: 200 len: 1810 microversion: 2.20 time: 0.187229 May 26 12:44:14.927733 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: [pid: 129321|app: 0|req: 351/721] 10.222.0.75 () {60 vars in 1276 bytes} [Thu May 26 12:44:14 2022] GET /compute/v2.1/servers/bf2f6303-22b9-4cfa-8d4d-61d2503bc554 => generated 1810 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 12:44:15.326468 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi [None req-95014315-ab8d-464c-8ebb-783bc4a4ae42 tempest-VolumesSnapshotTestJSON-1904508205 tempest-VolumesSnapshotTestJSON-1904508205-project] Calling method '>' {{(pid=129322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:44:15.327493 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.compute.api [None req-95014315-ab8d-464c-8ebb-783bc4a4ae42 tempest-VolumesSnapshotTestJSON-1904508205 tempest-VolumesSnapshotTestJSON-1904508205-project] [instance: 6a87df93-cf49-465a-80dd-102efb0f8b11] Fetching instance by UUID {{(pid=129322) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:44:15.342177 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-95014315-ab8d-464c-8ebb-783bc4a4ae42 tempest-VolumesSnapshotTestJSON-1904508205 tempest-VolumesSnapshotTestJSON-1904508205-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:44:15.342605 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-95014315-ab8d-464c-8ebb-783bc4a4ae42 tempest-VolumesSnapshotTestJSON-1904508205 tempest-VolumesSnapshotTestJSON-1904508205-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:44:15.343489 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-95014315-ab8d-464c-8ebb-783bc4a4ae42 tempest-VolumesSnapshotTestJSON-1904508205 tempest-VolumesSnapshotTestJSON-1904508205-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:44:15.344010 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-95014315-ab8d-464c-8ebb-783bc4a4ae42 tempest-VolumesSnapshotTestJSON-1904508205 tempest-VolumesSnapshotTestJSON-1904508205-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:44:15.497977 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.policy [None req-95014315-ab8d-464c-8ebb-783bc4a4ae42 tempest-VolumesSnapshotTestJSON-1904508205 tempest-VolumesSnapshotTestJSON-1904508205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '805854e5ce2e412fb9420afd63f73ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72bda4cbb07a43688506e01d06ba89c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129322) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:44:15.507944 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: INFO nova.api.openstack.requestlog [None req-95014315-ab8d-464c-8ebb-783bc4a4ae42 tempest-VolumesSnapshotTestJSON-1904508205 tempest-VolumesSnapshotTestJSON-1904508205-project] 10.222.0.75 "GET /compute/v2.1/servers/6a87df93-cf49-465a-80dd-102efb0f8b11" status: 200 len: 1513 microversion: 2.1 time: 0.186250 May 26 12:44:15.508530 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: [pid: 129322|app: 0|req: 371/722] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 26 12:44:15 2022] GET /compute/v2.1/servers/6a87df93-cf49-465a-80dd-102efb0f8b11 => generated 1513 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:44:15.945336 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi [None req-f2ad90fa-a85b-4a89-a27a-5accfcb19e2b tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Calling method '>' {{(pid=129321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:44:15.945928 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.compute.api [None req-f2ad90fa-a85b-4a89-a27a-5accfcb19e2b tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] [instance: bf2f6303-22b9-4cfa-8d4d-61d2503bc554] Fetching instance by UUID {{(pid=129321) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:44:15.956999 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-f2ad90fa-a85b-4a89-a27a-5accfcb19e2b tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:44:15.957466 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-f2ad90fa-a85b-4a89-a27a-5accfcb19e2b tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:44:15.958865 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-f2ad90fa-a85b-4a89-a27a-5accfcb19e2b tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:44:15.959727 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-f2ad90fa-a85b-4a89-a27a-5accfcb19e2b tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:44:16.126046 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.policy [None req-f2ad90fa-a85b-4a89-a27a-5accfcb19e2b tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e811736979c44b02b14fecb74c6bd7ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675272fb40d4847819f83ec04afecef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129321) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:44:16.137853 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.policy [None req-f2ad90fa-a85b-4a89-a27a-5accfcb19e2b tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e811736979c44b02b14fecb74c6bd7ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675272fb40d4847819f83ec04afecef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129321) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:44:16.139346 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.policy [None req-f2ad90fa-a85b-4a89-a27a-5accfcb19e2b tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e811736979c44b02b14fecb74c6bd7ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675272fb40d4847819f83ec04afecef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129321) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:44:16.140595 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: INFO nova.api.openstack.requestlog [None req-f2ad90fa-a85b-4a89-a27a-5accfcb19e2b tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] 10.222.0.75 "GET /compute/v2.1/servers/bf2f6303-22b9-4cfa-8d4d-61d2503bc554" status: 200 len: 1810 microversion: 2.20 time: 0.199952 May 26 12:44:16.141204 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: [pid: 129321|app: 0|req: 352/723] 10.222.0.75 () {60 vars in 1276 bytes} [Thu May 26 12:44:15 2022] GET /compute/v2.1/servers/bf2f6303-22b9-4cfa-8d4d-61d2503bc554 => generated 1810 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 12:44:16.527139 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi [None req-db1218cc-f893-45be-a970-a18a68ffcdbf tempest-VolumesSnapshotTestJSON-1904508205 tempest-VolumesSnapshotTestJSON-1904508205-project] Calling method '>' {{(pid=129322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:44:16.528149 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.compute.api [None req-db1218cc-f893-45be-a970-a18a68ffcdbf tempest-VolumesSnapshotTestJSON-1904508205 tempest-VolumesSnapshotTestJSON-1904508205-project] [instance: 6a87df93-cf49-465a-80dd-102efb0f8b11] Fetching instance by UUID {{(pid=129322) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:44:16.539188 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-db1218cc-f893-45be-a970-a18a68ffcdbf tempest-VolumesSnapshotTestJSON-1904508205 tempest-VolumesSnapshotTestJSON-1904508205-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:44:16.539661 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-db1218cc-f893-45be-a970-a18a68ffcdbf tempest-VolumesSnapshotTestJSON-1904508205 tempest-VolumesSnapshotTestJSON-1904508205-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:44:16.540523 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-db1218cc-f893-45be-a970-a18a68ffcdbf tempest-VolumesSnapshotTestJSON-1904508205 tempest-VolumesSnapshotTestJSON-1904508205-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:44:16.541068 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-db1218cc-f893-45be-a970-a18a68ffcdbf tempest-VolumesSnapshotTestJSON-1904508205 tempest-VolumesSnapshotTestJSON-1904508205-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:44:16.691680 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.policy [None req-db1218cc-f893-45be-a970-a18a68ffcdbf tempest-VolumesSnapshotTestJSON-1904508205 tempest-VolumesSnapshotTestJSON-1904508205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '805854e5ce2e412fb9420afd63f73ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72bda4cbb07a43688506e01d06ba89c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129322) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:44:16.700048 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: INFO nova.api.openstack.requestlog [None req-db1218cc-f893-45be-a970-a18a68ffcdbf tempest-VolumesSnapshotTestJSON-1904508205 tempest-VolumesSnapshotTestJSON-1904508205-project] 10.222.0.75 "GET /compute/v2.1/servers/6a87df93-cf49-465a-80dd-102efb0f8b11" status: 200 len: 1513 microversion: 2.1 time: 0.176847 May 26 12:44:16.700621 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: [pid: 129322|app: 0|req: 372/724] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 26 12:44:16 2022] GET /compute/v2.1/servers/6a87df93-cf49-465a-80dd-102efb0f8b11 => generated 1513 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:44:17.162336 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi [None req-0ce3c54a-f8ec-43cb-8db4-274e847d008e tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Calling method '>' {{(pid=129321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:44:17.162980 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.compute.api [None req-0ce3c54a-f8ec-43cb-8db4-274e847d008e tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] [instance: bf2f6303-22b9-4cfa-8d4d-61d2503bc554] Fetching instance by UUID {{(pid=129321) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:44:17.170172 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-0ce3c54a-f8ec-43cb-8db4-274e847d008e tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:44:17.170615 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-0ce3c54a-f8ec-43cb-8db4-274e847d008e tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:44:17.171385 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-0ce3c54a-f8ec-43cb-8db4-274e847d008e tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:44:17.171836 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-0ce3c54a-f8ec-43cb-8db4-274e847d008e tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:44:17.350919 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.policy [None req-0ce3c54a-f8ec-43cb-8db4-274e847d008e tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e811736979c44b02b14fecb74c6bd7ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675272fb40d4847819f83ec04afecef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129321) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:44:17.360050 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.policy [None req-0ce3c54a-f8ec-43cb-8db4-274e847d008e tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e811736979c44b02b14fecb74c6bd7ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675272fb40d4847819f83ec04afecef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129321) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:44:17.361881 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.policy [None req-0ce3c54a-f8ec-43cb-8db4-274e847d008e tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e811736979c44b02b14fecb74c6bd7ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675272fb40d4847819f83ec04afecef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129321) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:44:17.363385 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: INFO nova.api.openstack.requestlog [None req-0ce3c54a-f8ec-43cb-8db4-274e847d008e tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] 10.222.0.75 "GET /compute/v2.1/servers/bf2f6303-22b9-4cfa-8d4d-61d2503bc554" status: 200 len: 1810 microversion: 2.20 time: 0.206232 May 26 12:44:17.364330 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: [pid: 129321|app: 0|req: 353/725] 10.222.0.75 () {60 vars in 1276 bytes} [Thu May 26 12:44:17 2022] GET /compute/v2.1/servers/bf2f6303-22b9-4cfa-8d4d-61d2503bc554 => generated 1810 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 12:44:17.722645 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi [None req-f75b263e-1f53-43dc-99a4-7fa78a2dd070 tempest-VolumesSnapshotTestJSON-1904508205 tempest-VolumesSnapshotTestJSON-1904508205-project] Calling method '>' {{(pid=129322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:44:17.723249 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.compute.api [None req-f75b263e-1f53-43dc-99a4-7fa78a2dd070 tempest-VolumesSnapshotTestJSON-1904508205 tempest-VolumesSnapshotTestJSON-1904508205-project] [instance: 6a87df93-cf49-465a-80dd-102efb0f8b11] Fetching instance by UUID {{(pid=129322) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:44:17.730885 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-f75b263e-1f53-43dc-99a4-7fa78a2dd070 tempest-VolumesSnapshotTestJSON-1904508205 tempest-VolumesSnapshotTestJSON-1904508205-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:44:17.731333 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-f75b263e-1f53-43dc-99a4-7fa78a2dd070 tempest-VolumesSnapshotTestJSON-1904508205 tempest-VolumesSnapshotTestJSON-1904508205-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:44:17.732160 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-f75b263e-1f53-43dc-99a4-7fa78a2dd070 tempest-VolumesSnapshotTestJSON-1904508205 tempest-VolumesSnapshotTestJSON-1904508205-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:44:17.732589 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-f75b263e-1f53-43dc-99a4-7fa78a2dd070 tempest-VolumesSnapshotTestJSON-1904508205 tempest-VolumesSnapshotTestJSON-1904508205-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:44:17.876806 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.policy [None req-f75b263e-1f53-43dc-99a4-7fa78a2dd070 tempest-VolumesSnapshotTestJSON-1904508205 tempest-VolumesSnapshotTestJSON-1904508205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '805854e5ce2e412fb9420afd63f73ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72bda4cbb07a43688506e01d06ba89c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129322) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:44:17.885055 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: INFO nova.api.openstack.requestlog [None req-f75b263e-1f53-43dc-99a4-7fa78a2dd070 tempest-VolumesSnapshotTestJSON-1904508205 tempest-VolumesSnapshotTestJSON-1904508205-project] 10.222.0.75 "GET /compute/v2.1/servers/6a87df93-cf49-465a-80dd-102efb0f8b11" status: 200 len: 1513 microversion: 2.1 time: 0.166346 May 26 12:44:17.885649 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: [pid: 129322|app: 0|req: 373/726] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 26 12:44:17 2022] GET /compute/v2.1/servers/6a87df93-cf49-465a-80dd-102efb0f8b11 => generated 1513 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:44:18.383033 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi [None req-b117d060-6984-4a08-994c-e0c9efe68cb0 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Calling method '>' {{(pid=129321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:44:18.383665 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.compute.api [None req-b117d060-6984-4a08-994c-e0c9efe68cb0 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] [instance: bf2f6303-22b9-4cfa-8d4d-61d2503bc554] Fetching instance by UUID {{(pid=129321) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:44:18.390405 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-b117d060-6984-4a08-994c-e0c9efe68cb0 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:44:18.390861 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-b117d060-6984-4a08-994c-e0c9efe68cb0 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:44:18.391840 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-b117d060-6984-4a08-994c-e0c9efe68cb0 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:44:18.392258 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-b117d060-6984-4a08-994c-e0c9efe68cb0 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:44:18.552405 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.policy [None req-b117d060-6984-4a08-994c-e0c9efe68cb0 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e811736979c44b02b14fecb74c6bd7ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675272fb40d4847819f83ec04afecef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129321) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:44:18.562122 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.policy [None req-b117d060-6984-4a08-994c-e0c9efe68cb0 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e811736979c44b02b14fecb74c6bd7ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675272fb40d4847819f83ec04afecef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129321) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:44:18.563845 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.policy [None req-b117d060-6984-4a08-994c-e0c9efe68cb0 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e811736979c44b02b14fecb74c6bd7ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675272fb40d4847819f83ec04afecef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129321) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:44:18.565580 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: INFO nova.api.openstack.requestlog [None req-b117d060-6984-4a08-994c-e0c9efe68cb0 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] 10.222.0.75 "GET /compute/v2.1/servers/bf2f6303-22b9-4cfa-8d4d-61d2503bc554" status: 200 len: 1810 microversion: 2.20 time: 0.186762 May 26 12:44:18.566140 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: [pid: 129321|app: 0|req: 354/727] 10.222.0.75 () {60 vars in 1276 bytes} [Thu May 26 12:44:18 2022] GET /compute/v2.1/servers/bf2f6303-22b9-4cfa-8d4d-61d2503bc554 => generated 1810 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 12:44:18.903162 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi [None req-1e1e988b-6e9e-473a-9d92-51eba038981d tempest-VolumesSnapshotTestJSON-1904508205 tempest-VolumesSnapshotTestJSON-1904508205-project] Calling method '>' {{(pid=129322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:44:18.903849 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.compute.api [None req-1e1e988b-6e9e-473a-9d92-51eba038981d tempest-VolumesSnapshotTestJSON-1904508205 tempest-VolumesSnapshotTestJSON-1904508205-project] [instance: 6a87df93-cf49-465a-80dd-102efb0f8b11] Fetching instance by UUID {{(pid=129322) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:44:18.910838 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-1e1e988b-6e9e-473a-9d92-51eba038981d tempest-VolumesSnapshotTestJSON-1904508205 tempest-VolumesSnapshotTestJSON-1904508205-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:44:18.911338 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-1e1e988b-6e9e-473a-9d92-51eba038981d tempest-VolumesSnapshotTestJSON-1904508205 tempest-VolumesSnapshotTestJSON-1904508205-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:44:18.912419 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-1e1e988b-6e9e-473a-9d92-51eba038981d tempest-VolumesSnapshotTestJSON-1904508205 tempest-VolumesSnapshotTestJSON-1904508205-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:44:18.913166 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-1e1e988b-6e9e-473a-9d92-51eba038981d tempest-VolumesSnapshotTestJSON-1904508205 tempest-VolumesSnapshotTestJSON-1904508205-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:44:19.261353 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.policy [None req-1e1e988b-6e9e-473a-9d92-51eba038981d tempest-VolumesSnapshotTestJSON-1904508205 tempest-VolumesSnapshotTestJSON-1904508205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '805854e5ce2e412fb9420afd63f73ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72bda4cbb07a43688506e01d06ba89c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129322) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:44:19.269734 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: INFO nova.api.openstack.requestlog [None req-1e1e988b-6e9e-473a-9d92-51eba038981d tempest-VolumesSnapshotTestJSON-1904508205 tempest-VolumesSnapshotTestJSON-1904508205-project] 10.222.0.75 "GET /compute/v2.1/servers/6a87df93-cf49-465a-80dd-102efb0f8b11" status: 200 len: 1513 microversion: 2.1 time: 0.370991 May 26 12:44:19.270329 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: [pid: 129322|app: 0|req: 374/728] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 26 12:44:18 2022] GET /compute/v2.1/servers/6a87df93-cf49-465a-80dd-102efb0f8b11 => generated 1513 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 12:44:19.588004 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi [None req-cb206f69-b614-41d3-8a77-9a7b219fec9d tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Calling method '>' {{(pid=129321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:44:19.588593 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.compute.api [None req-cb206f69-b614-41d3-8a77-9a7b219fec9d tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] [instance: bf2f6303-22b9-4cfa-8d4d-61d2503bc554] Fetching instance by UUID {{(pid=129321) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:44:19.595296 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-cb206f69-b614-41d3-8a77-9a7b219fec9d tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:44:19.595772 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-cb206f69-b614-41d3-8a77-9a7b219fec9d tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:44:19.596744 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-cb206f69-b614-41d3-8a77-9a7b219fec9d tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:44:19.597189 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-cb206f69-b614-41d3-8a77-9a7b219fec9d tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:44:19.756729 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.policy [None req-cb206f69-b614-41d3-8a77-9a7b219fec9d tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e811736979c44b02b14fecb74c6bd7ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675272fb40d4847819f83ec04afecef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129321) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:44:19.766353 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.policy [None req-cb206f69-b614-41d3-8a77-9a7b219fec9d tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e811736979c44b02b14fecb74c6bd7ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675272fb40d4847819f83ec04afecef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129321) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:44:19.768431 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.policy [None req-cb206f69-b614-41d3-8a77-9a7b219fec9d tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e811736979c44b02b14fecb74c6bd7ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675272fb40d4847819f83ec04afecef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129321) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:44:19.769308 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: INFO nova.api.openstack.requestlog [None req-cb206f69-b614-41d3-8a77-9a7b219fec9d tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] 10.222.0.75 "GET /compute/v2.1/servers/bf2f6303-22b9-4cfa-8d4d-61d2503bc554" status: 200 len: 1810 microversion: 2.20 time: 0.186701 May 26 12:44:19.769889 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: [pid: 129321|app: 0|req: 355/729] 10.222.0.75 () {60 vars in 1276 bytes} [Thu May 26 12:44:19 2022] GET /compute/v2.1/servers/bf2f6303-22b9-4cfa-8d4d-61d2503bc554 => generated 1810 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 12:44:20.288058 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi [None req-ee0e5e24-49ca-483e-99d8-8965e2d68910 tempest-VolumesSnapshotTestJSON-1904508205 tempest-VolumesSnapshotTestJSON-1904508205-project] Calling method '>' {{(pid=129322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:44:20.289403 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.compute.api [None req-ee0e5e24-49ca-483e-99d8-8965e2d68910 tempest-VolumesSnapshotTestJSON-1904508205 tempest-VolumesSnapshotTestJSON-1904508205-project] [instance: 6a87df93-cf49-465a-80dd-102efb0f8b11] Fetching instance by UUID {{(pid=129322) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:44:20.301010 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-ee0e5e24-49ca-483e-99d8-8965e2d68910 tempest-VolumesSnapshotTestJSON-1904508205 tempest-VolumesSnapshotTestJSON-1904508205-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:44:20.301525 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-ee0e5e24-49ca-483e-99d8-8965e2d68910 tempest-VolumesSnapshotTestJSON-1904508205 tempest-VolumesSnapshotTestJSON-1904508205-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:44:20.302405 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-ee0e5e24-49ca-483e-99d8-8965e2d68910 tempest-VolumesSnapshotTestJSON-1904508205 tempest-VolumesSnapshotTestJSON-1904508205-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:44:20.303000 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-ee0e5e24-49ca-483e-99d8-8965e2d68910 tempest-VolumesSnapshotTestJSON-1904508205 tempest-VolumesSnapshotTestJSON-1904508205-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:44:20.470555 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.policy [None req-ee0e5e24-49ca-483e-99d8-8965e2d68910 tempest-VolumesSnapshotTestJSON-1904508205 tempest-VolumesSnapshotTestJSON-1904508205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '805854e5ce2e412fb9420afd63f73ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72bda4cbb07a43688506e01d06ba89c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129322) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:44:20.481040 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: INFO nova.api.openstack.requestlog [None req-ee0e5e24-49ca-483e-99d8-8965e2d68910 tempest-VolumesSnapshotTestJSON-1904508205 tempest-VolumesSnapshotTestJSON-1904508205-project] 10.222.0.75 "GET /compute/v2.1/servers/6a87df93-cf49-465a-80dd-102efb0f8b11" status: 200 len: 1513 microversion: 2.1 time: 0.197296 May 26 12:44:20.481701 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: [pid: 129322|app: 0|req: 375/730] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 26 12:44:20 2022] GET /compute/v2.1/servers/6a87df93-cf49-465a-80dd-102efb0f8b11 => generated 1513 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:44:20.793436 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi [None req-06a91b07-c19b-4e65-9170-49b71363680a tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Calling method '>' {{(pid=129321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:44:20.794404 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.compute.api [None req-06a91b07-c19b-4e65-9170-49b71363680a tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] [instance: bf2f6303-22b9-4cfa-8d4d-61d2503bc554] Fetching instance by UUID {{(pid=129321) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:44:20.802106 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-06a91b07-c19b-4e65-9170-49b71363680a tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:44:20.803262 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-06a91b07-c19b-4e65-9170-49b71363680a tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:44:20.804136 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-06a91b07-c19b-4e65-9170-49b71363680a tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:44:20.805054 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-06a91b07-c19b-4e65-9170-49b71363680a tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:44:21.042932 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.policy [None req-06a91b07-c19b-4e65-9170-49b71363680a tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e811736979c44b02b14fecb74c6bd7ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675272fb40d4847819f83ec04afecef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129321) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:44:21.056390 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.policy [None req-06a91b07-c19b-4e65-9170-49b71363680a tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e811736979c44b02b14fecb74c6bd7ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675272fb40d4847819f83ec04afecef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129321) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:44:21.059066 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.policy [None req-06a91b07-c19b-4e65-9170-49b71363680a tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e811736979c44b02b14fecb74c6bd7ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675272fb40d4847819f83ec04afecef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129321) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:44:21.061304 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: INFO nova.api.openstack.requestlog [None req-06a91b07-c19b-4e65-9170-49b71363680a tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] 10.222.0.75 "GET /compute/v2.1/servers/bf2f6303-22b9-4cfa-8d4d-61d2503bc554" status: 200 len: 1810 microversion: 2.20 time: 0.274688 May 26 12:44:21.062299 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: [pid: 129321|app: 0|req: 356/731] 10.222.0.75 () {60 vars in 1276 bytes} [Thu May 26 12:44:20 2022] GET /compute/v2.1/servers/bf2f6303-22b9-4cfa-8d4d-61d2503bc554 => generated 1810 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 26 12:44:21.185686 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi [req-1b25a2f4-de44-439d-aafa-be01964582f9 req-d98bf76b-f69b-4ab8-813b-27b4e64300f0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6a87df93-cf49-465a-80dd-102efb0f8b11", "name": "network-vif-deleted", "tag": "dbacc009-79e8-4f19-b33f-318a83e21b17"}]} {{(pid=129322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 12:44:21.196157 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [req-1b25a2f4-de44-439d-aafa-be01964582f9 req-d98bf76b-f69b-4ab8-813b-27b4e64300f0 service nova] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:44:21.196595 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [req-1b25a2f4-de44-439d-aafa-be01964582f9 req-d98bf76b-f69b-4ab8-813b-27b4e64300f0 service nova] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:44:21.199399 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG dbcounter [-] [129322] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=129322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:44:21.216437 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: INFO nova.api.openstack.compute.server_external_events [req-1b25a2f4-de44-439d-aafa-be01964582f9 req-d98bf76b-f69b-4ab8-813b-27b4e64300f0 service nova] Creating event network-vif-deleted:dbacc009-79e8-4f19-b33f-318a83e21b17 for instance 6a87df93-cf49-465a-80dd-102efb0f8b11 on hv-cinder-81966 May 26 12:44:21.221926 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: INFO nova.api.openstack.requestlog [req-1b25a2f4-de44-439d-aafa-be01964582f9 req-d98bf76b-f69b-4ab8-813b-27b4e64300f0 service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041443 May 26 12:44:21.222740 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: [pid: 129322|app: 0|req: 376/732] 10.222.0.75 () {64 vars in 1317 bytes} [Thu May 26 12:44:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 12:44:21.499114 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi [None req-7789c7c5-17ca-4f38-8d02-e0621ddd602f tempest-VolumesSnapshotTestJSON-1904508205 tempest-VolumesSnapshotTestJSON-1904508205-project] Calling method '>' {{(pid=129321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:44:21.500084 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.compute.api [None req-7789c7c5-17ca-4f38-8d02-e0621ddd602f tempest-VolumesSnapshotTestJSON-1904508205 tempest-VolumesSnapshotTestJSON-1904508205-project] [instance: 6a87df93-cf49-465a-80dd-102efb0f8b11] Fetching instance by UUID {{(pid=129321) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:44:21.506559 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-7789c7c5-17ca-4f38-8d02-e0621ddd602f tempest-VolumesSnapshotTestJSON-1904508205 tempest-VolumesSnapshotTestJSON-1904508205-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:44:21.507020 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-7789c7c5-17ca-4f38-8d02-e0621ddd602f tempest-VolumesSnapshotTestJSON-1904508205 tempest-VolumesSnapshotTestJSON-1904508205-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:44:21.508222 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-7789c7c5-17ca-4f38-8d02-e0621ddd602f tempest-VolumesSnapshotTestJSON-1904508205 tempest-VolumesSnapshotTestJSON-1904508205-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:44:21.508768 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-7789c7c5-17ca-4f38-8d02-e0621ddd602f tempest-VolumesSnapshotTestJSON-1904508205 tempest-VolumesSnapshotTestJSON-1904508205-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:44:21.545080 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-7789c7c5-17ca-4f38-8d02-e0621ddd602f tempest-VolumesSnapshotTestJSON-1904508205 tempest-VolumesSnapshotTestJSON-1904508205-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:44:21.545429 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-7789c7c5-17ca-4f38-8d02-e0621ddd602f tempest-VolumesSnapshotTestJSON-1904508205 tempest-VolumesSnapshotTestJSON-1904508205-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:44:21.545907 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.objects.instance [None req-7789c7c5-17ca-4f38-8d02-e0621ddd602f tempest-VolumesSnapshotTestJSON-1904508205 tempest-VolumesSnapshotTestJSON-1904508205-project] Lazy-loading 'fault' on Instance uuid 6a87df93-cf49-465a-80dd-102efb0f8b11 {{(pid=129321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 26 12:44:21.600871 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.policy [None req-7789c7c5-17ca-4f38-8d02-e0621ddd602f tempest-VolumesSnapshotTestJSON-1904508205 tempest-VolumesSnapshotTestJSON-1904508205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '805854e5ce2e412fb9420afd63f73ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72bda4cbb07a43688506e01d06ba89c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129321) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:44:21.609751 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: INFO nova.api.openstack.requestlog [None req-7789c7c5-17ca-4f38-8d02-e0621ddd602f tempest-VolumesSnapshotTestJSON-1904508205 tempest-VolumesSnapshotTestJSON-1904508205-project] 10.222.0.75 "GET /compute/v2.1/servers/6a87df93-cf49-465a-80dd-102efb0f8b11" status: 200 len: 1309 microversion: 2.1 time: 0.114734 May 26 12:44:21.610416 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: [pid: 129321|app: 0|req: 357/733] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 26 12:44:21 2022] GET /compute/v2.1/servers/6a87df93-cf49-465a-80dd-102efb0f8b11 => generated 1309 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:44:22.083138 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi [None req-e83cdb45-341d-4092-9717-d3b87c3e5509 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Calling method '>' {{(pid=129322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:44:22.083942 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.compute.api [None req-e83cdb45-341d-4092-9717-d3b87c3e5509 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] [instance: bf2f6303-22b9-4cfa-8d4d-61d2503bc554] Fetching instance by UUID {{(pid=129322) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:44:22.092193 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-e83cdb45-341d-4092-9717-d3b87c3e5509 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:44:22.092595 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-e83cdb45-341d-4092-9717-d3b87c3e5509 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:44:22.093422 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-e83cdb45-341d-4092-9717-d3b87c3e5509 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:44:22.093866 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-e83cdb45-341d-4092-9717-d3b87c3e5509 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:44:22.251584 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.policy [None req-e83cdb45-341d-4092-9717-d3b87c3e5509 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e811736979c44b02b14fecb74c6bd7ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675272fb40d4847819f83ec04afecef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129322) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:44:22.261157 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.policy [None req-e83cdb45-341d-4092-9717-d3b87c3e5509 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e811736979c44b02b14fecb74c6bd7ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675272fb40d4847819f83ec04afecef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129322) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:44:22.262735 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.policy [None req-e83cdb45-341d-4092-9717-d3b87c3e5509 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e811736979c44b02b14fecb74c6bd7ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675272fb40d4847819f83ec04afecef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129322) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:44:22.264442 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: INFO nova.api.openstack.requestlog [None req-e83cdb45-341d-4092-9717-d3b87c3e5509 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] 10.222.0.75 "GET /compute/v2.1/servers/bf2f6303-22b9-4cfa-8d4d-61d2503bc554" status: 200 len: 1810 microversion: 2.20 time: 0.186376 May 26 12:44:22.264632 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: [pid: 129322|app: 0|req: 377/734] 10.222.0.75 () {60 vars in 1276 bytes} [Thu May 26 12:44:22 2022] GET /compute/v2.1/servers/bf2f6303-22b9-4cfa-8d4d-61d2503bc554 => generated 1810 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 12:44:22.628546 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi [None req-e9c29450-553d-498b-bdbb-04237a5e1814 tempest-VolumesSnapshotTestJSON-1904508205 tempest-VolumesSnapshotTestJSON-1904508205-project] Calling method '>' {{(pid=129321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:44:22.629158 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.compute.api [None req-e9c29450-553d-498b-bdbb-04237a5e1814 tempest-VolumesSnapshotTestJSON-1904508205 tempest-VolumesSnapshotTestJSON-1904508205-project] [instance: 6a87df93-cf49-465a-80dd-102efb0f8b11] Fetching instance by UUID {{(pid=129321) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:44:22.637019 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-e9c29450-553d-498b-bdbb-04237a5e1814 tempest-VolumesSnapshotTestJSON-1904508205 tempest-VolumesSnapshotTestJSON-1904508205-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:44:22.637454 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-e9c29450-553d-498b-bdbb-04237a5e1814 tempest-VolumesSnapshotTestJSON-1904508205 tempest-VolumesSnapshotTestJSON-1904508205-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:44:22.638247 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-e9c29450-553d-498b-bdbb-04237a5e1814 tempest-VolumesSnapshotTestJSON-1904508205 tempest-VolumesSnapshotTestJSON-1904508205-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:44:22.638660 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-e9c29450-553d-498b-bdbb-04237a5e1814 tempest-VolumesSnapshotTestJSON-1904508205 tempest-VolumesSnapshotTestJSON-1904508205-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:44:22.661415 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: INFO nova.api.openstack.wsgi [None req-e9c29450-553d-498b-bdbb-04237a5e1814 tempest-VolumesSnapshotTestJSON-1904508205 tempest-VolumesSnapshotTestJSON-1904508205-project] HTTP exception thrown: Instance 6a87df93-cf49-465a-80dd-102efb0f8b11 could not be found. May 26 12:44:22.664514 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi [None req-e9c29450-553d-498b-bdbb-04237a5e1814 tempest-VolumesSnapshotTestJSON-1904508205 tempest-VolumesSnapshotTestJSON-1904508205-project] Request method failure captured: May 26 12:44:22.664514 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: request: GET /compute/v2.1/servers/6a87df93-cf49-465a-80dd-102efb0f8b11 HTTP/1.1 May 26 12:44:22.664514 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: Accept: application/json May 26 12:44:22.664514 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: Accept-Encoding: identity May 26 12:44:22.664514 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: Connection: close May 26 12:44:22.664514 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: Content-Length: 0 May 26 12:44:22.664514 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: Content-Type: application/json May 26 12:44:22.664514 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: Host: 10.222.0.75 May 26 12:44:22.664514 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: Openstack-System-Scope: None May 26 12:44:22.664514 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: User-Agent: python-urllib3/1.26.9 May 26 12:44:22.664514 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: X-Auth-Token: gAAAAABij3UCpGl_3b01EqImWSm_Fgfw-fNLTcgm9GImZkxUHOXAF_LWSvGIksirXIlogDT_yiAwbxYfic8jEGGDJY-m_uoMLRMiyvh0NINeHQZ0T0dU_8WZE89MuqaoT2cMYBZtAAeFvWYagX4utJYJ0qPy8EtBvPxYQxZRpdLIpcZCAtwjHvQ May 26 12:44:22.664514 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: X-Domain-Id: None May 26 12:44:22.664514 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: X-Domain-Name: None May 26 12:44:22.664514 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: X-Identity-Status: Confirmed May 26 12:44:22.664514 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: X-Is-Admin-Project: True May 26 12:44:22.664514 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: X-Project-Domain-Id: default May 26 12:44:22.664514 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: X-Project-Domain-Name: Default May 26 12:44:22.664514 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: X-Project-Id: 72bda4cbb07a43688506e01d06ba89c2 May 26 12:44:22.664514 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1904508205 May 26 12:44:22.664514 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: X-Role: member,reader May 26 12:44:22.664514 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: X-Roles: member,reader May 26 12:44:22.666029 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/72bda4cbb07a43688506e01d06ba89c2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.75:8080", "publicURL": "http://10.222.0.75:8080/v1/AUTH_72bda4cbb07a43688506e01d06ba89c2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2/72bda4cbb07a43688506e01d06ba89c2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/72bda4cbb07a43688506e01d06ba89c2"}]}] May 26 12:44:22.666029 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: X-Tenant: tempest-VolumesSnapshotTestJSON-1904508205 May 26 12:44:22.666029 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: X-Tenant-Id: 72bda4cbb07a43688506e01d06ba89c2 May 26 12:44:22.666029 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1904508205 May 26 12:44:22.666029 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: X-User: tempest-VolumesSnapshotTestJSON-1904508205-project May 26 12:44:22.666029 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: X-User-Domain-Id: default May 26 12:44:22.666029 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: X-User-Domain-Name: Default May 26 12:44:22.666029 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: X-User-Id: 805854e5ce2e412fb9420afd63f73ee6 May 26 12:44:22.666029 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: X-User-Name: tempest-VolumesSnapshotTestJSON-1904508205-project May 26 12:44:22.666029 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: method: > May 26 12:44:22.666029 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: exception: Instance 6a87df93-cf49-465a-80dd-102efb0f8b11 could not be found. May 26 12:44:22.666029 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: action_args: {'id': '6a87df93-cf49-465a-80dd-102efb0f8b11'} May 26 12:44:22.666862 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: {{(pid=129321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 12:44:22.666862 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 12:44:22.666862 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 26 12:44:22.666862 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 26 12:44:22.666862 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 26 12:44:22.666862 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 26 12:44:22.666862 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 26 12:44:22.666862 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 26 12:44:22.666862 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 26 12:44:22.666862 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 26 12:44:22.666862 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6a87df93-cf49-465a-80dd-102efb0f8b11 could not be found. May 26 12:44:22.666862 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi May 26 12:44:22.666862 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 12:44:22.666862 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi May 26 12:44:22.666862 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 12:44:22.666862 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 12:44:22.666862 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 12:44:22.666862 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 12:44:22.666862 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 12:44:22.666862 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 12:44:22.668782 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 12:44:22.668782 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 26 12:44:22.668782 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 26 12:44:22.668782 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 26 12:44:22.668782 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 26 12:44:22.668782 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 26 12:44:22.668782 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 12:44:22.668782 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6a87df93-cf49-465a-80dd-102efb0f8b11 could not be found. May 26 12:44:22.668782 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi May 26 12:44:22.668782 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 12:44:22.668782 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi May 26 12:44:22.668782 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 12:44:22.668782 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 12:44:22.668782 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 12:44:22.668782 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 12:44:22.668782 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 12:44:22.668782 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6a87df93-cf49-465a-80dd-102efb0f8b11 could not be found. May 26 12:44:22.668782 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi May 26 12:44:22.670082 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi [None req-e9c29450-553d-498b-bdbb-04237a5e1814 tempest-VolumesSnapshotTestJSON-1904508205 tempest-VolumesSnapshotTestJSON-1904508205-project] Returning 404 to user: Instance 6a87df93-cf49-465a-80dd-102efb0f8b11 could not be found. {{(pid=129321) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 12:44:22.670082 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: INFO nova.api.openstack.requestlog [None req-e9c29450-553d-498b-bdbb-04237a5e1814 tempest-VolumesSnapshotTestJSON-1904508205 tempest-VolumesSnapshotTestJSON-1904508205-project] 10.222.0.75 "GET /compute/v2.1/servers/6a87df93-cf49-465a-80dd-102efb0f8b11" status: 404 len: 111 microversion: 2.1 time: 0.041994 May 26 12:44:22.670082 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: [pid: 129321|app: 0|req: 358/735] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 26 12:44:22 2022] GET /compute/v2.1/servers/6a87df93-cf49-465a-80dd-102efb0f8b11 => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 26 12:44:23.287722 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi [None req-daca8c34-e873-4bf8-a065-a1dde52418b8 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Calling method '>' {{(pid=129322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:44:23.289178 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.compute.api [None req-daca8c34-e873-4bf8-a065-a1dde52418b8 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] [instance: bf2f6303-22b9-4cfa-8d4d-61d2503bc554] Fetching instance by UUID {{(pid=129322) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:44:23.296523 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-daca8c34-e873-4bf8-a065-a1dde52418b8 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:44:23.296992 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-daca8c34-e873-4bf8-a065-a1dde52418b8 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:44:23.297806 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-daca8c34-e873-4bf8-a065-a1dde52418b8 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:44:23.298233 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-daca8c34-e873-4bf8-a065-a1dde52418b8 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:44:23.442921 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.policy [None req-daca8c34-e873-4bf8-a065-a1dde52418b8 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e811736979c44b02b14fecb74c6bd7ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675272fb40d4847819f83ec04afecef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129322) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:44:23.452126 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.policy [None req-daca8c34-e873-4bf8-a065-a1dde52418b8 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e811736979c44b02b14fecb74c6bd7ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675272fb40d4847819f83ec04afecef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129322) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:44:23.453623 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.policy [None req-daca8c34-e873-4bf8-a065-a1dde52418b8 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e811736979c44b02b14fecb74c6bd7ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675272fb40d4847819f83ec04afecef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129322) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:44:23.454805 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: INFO nova.api.openstack.requestlog [None req-daca8c34-e873-4bf8-a065-a1dde52418b8 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] 10.222.0.75 "GET /compute/v2.1/servers/bf2f6303-22b9-4cfa-8d4d-61d2503bc554" status: 200 len: 1810 microversion: 2.20 time: 0.173888 May 26 12:44:23.455363 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: [pid: 129322|app: 0|req: 378/736] 10.222.0.75 () {60 vars in 1276 bytes} [Thu May 26 12:44:23 2022] GET /compute/v2.1/servers/bf2f6303-22b9-4cfa-8d4d-61d2503bc554 => generated 1810 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 12:44:24.226772 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi [req-ff1e2a1e-5add-463c-ad44-e957ba01856b req-bef64e25-70a0-4d5e-8b1e-2744832a5003 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bf2f6303-22b9-4cfa-8d4d-61d2503bc554", "name": "network-vif-plugged", "status": "completed", "tag": "fe40ed8f-f450-48f7-876a-abe2fea7abe5"}]} {{(pid=129321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 12:44:24.236237 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [req-ff1e2a1e-5add-463c-ad44-e957ba01856b req-bef64e25-70a0-4d5e-8b1e-2744832a5003 service nova] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:44:24.236927 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [req-ff1e2a1e-5add-463c-ad44-e957ba01856b req-bef64e25-70a0-4d5e-8b1e-2744832a5003 service nova] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:44:24.250640 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: INFO nova.api.openstack.compute.server_external_events [req-ff1e2a1e-5add-463c-ad44-e957ba01856b req-bef64e25-70a0-4d5e-8b1e-2744832a5003 service nova] Creating event network-vif-plugged:fe40ed8f-f450-48f7-876a-abe2fea7abe5 for instance bf2f6303-22b9-4cfa-8d4d-61d2503bc554 on hv-cinder-81966 May 26 12:44:24.257223 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: INFO nova.api.openstack.requestlog [req-ff1e2a1e-5add-463c-ad44-e957ba01856b req-bef64e25-70a0-4d5e-8b1e-2744832a5003 service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.223121 May 26 12:44:24.257604 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: [pid: 129321|app: 0|req: 359/737] 10.222.0.75 () {64 vars in 1317 bytes} [Thu May 26 12:44:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 12:44:24.474289 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi [None req-14ccff06-91c9-4db2-b720-80a1598e8ac2 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Calling method '>' {{(pid=129322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:44:24.474896 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.compute.api [None req-14ccff06-91c9-4db2-b720-80a1598e8ac2 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] [instance: bf2f6303-22b9-4cfa-8d4d-61d2503bc554] Fetching instance by UUID {{(pid=129322) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:44:24.482623 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-14ccff06-91c9-4db2-b720-80a1598e8ac2 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:44:24.483121 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-14ccff06-91c9-4db2-b720-80a1598e8ac2 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:44:24.483921 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-14ccff06-91c9-4db2-b720-80a1598e8ac2 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:44:24.484352 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-14ccff06-91c9-4db2-b720-80a1598e8ac2 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:44:24.636817 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.policy [None req-14ccff06-91c9-4db2-b720-80a1598e8ac2 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e811736979c44b02b14fecb74c6bd7ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675272fb40d4847819f83ec04afecef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129322) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:44:24.646145 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.policy [None req-14ccff06-91c9-4db2-b720-80a1598e8ac2 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e811736979c44b02b14fecb74c6bd7ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675272fb40d4847819f83ec04afecef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129322) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:44:24.647686 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.policy [None req-14ccff06-91c9-4db2-b720-80a1598e8ac2 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e811736979c44b02b14fecb74c6bd7ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675272fb40d4847819f83ec04afecef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129322) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:44:24.649156 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: INFO nova.api.openstack.requestlog [None req-14ccff06-91c9-4db2-b720-80a1598e8ac2 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] 10.222.0.75 "GET /compute/v2.1/servers/bf2f6303-22b9-4cfa-8d4d-61d2503bc554" status: 200 len: 1810 microversion: 2.20 time: 0.178905 May 26 12:44:24.649707 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: [pid: 129322|app: 0|req: 379/738] 10.222.0.75 () {60 vars in 1276 bytes} [Thu May 26 12:44:24 2022] GET /compute/v2.1/servers/bf2f6303-22b9-4cfa-8d4d-61d2503bc554 => generated 1810 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 12:44:25.672925 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi [None req-50e0693a-cfa1-4207-9bfe-3fd8f8911e35 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Calling method '>' {{(pid=129321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:44:25.673746 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.compute.api [None req-50e0693a-cfa1-4207-9bfe-3fd8f8911e35 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] [instance: bf2f6303-22b9-4cfa-8d4d-61d2503bc554] Fetching instance by UUID {{(pid=129321) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:44:25.683561 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-50e0693a-cfa1-4207-9bfe-3fd8f8911e35 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:44:25.683938 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-50e0693a-cfa1-4207-9bfe-3fd8f8911e35 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:44:25.684773 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-50e0693a-cfa1-4207-9bfe-3fd8f8911e35 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:44:25.685206 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-50e0693a-cfa1-4207-9bfe-3fd8f8911e35 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:44:25.825018 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.policy [None req-50e0693a-cfa1-4207-9bfe-3fd8f8911e35 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e811736979c44b02b14fecb74c6bd7ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675272fb40d4847819f83ec04afecef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129321) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:44:25.837495 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.policy [None req-50e0693a-cfa1-4207-9bfe-3fd8f8911e35 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e811736979c44b02b14fecb74c6bd7ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675272fb40d4847819f83ec04afecef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129321) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:44:25.839204 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.policy [None req-50e0693a-cfa1-4207-9bfe-3fd8f8911e35 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e811736979c44b02b14fecb74c6bd7ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675272fb40d4847819f83ec04afecef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129321) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:44:25.840461 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: INFO nova.api.openstack.requestlog [None req-50e0693a-cfa1-4207-9bfe-3fd8f8911e35 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] 10.222.0.75 "GET /compute/v2.1/servers/bf2f6303-22b9-4cfa-8d4d-61d2503bc554" status: 200 len: 1810 microversion: 2.20 time: 0.174774 May 26 12:44:25.841019 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: [pid: 129321|app: 0|req: 360/739] 10.222.0.75 () {60 vars in 1276 bytes} [Thu May 26 12:44:25 2022] GET /compute/v2.1/servers/bf2f6303-22b9-4cfa-8d4d-61d2503bc554 => generated 1810 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 12:44:26.861702 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi [None req-b948500c-9176-4441-9659-74f026e7d653 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Calling method '>' {{(pid=129322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:44:26.862320 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.compute.api [None req-b948500c-9176-4441-9659-74f026e7d653 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] [instance: bf2f6303-22b9-4cfa-8d4d-61d2503bc554] Fetching instance by UUID {{(pid=129322) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:44:26.871598 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-b948500c-9176-4441-9659-74f026e7d653 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:44:26.872131 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-b948500c-9176-4441-9659-74f026e7d653 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:44:26.873002 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-b948500c-9176-4441-9659-74f026e7d653 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:44:26.873436 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-b948500c-9176-4441-9659-74f026e7d653 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:44:27.016761 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.policy [None req-b948500c-9176-4441-9659-74f026e7d653 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e811736979c44b02b14fecb74c6bd7ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675272fb40d4847819f83ec04afecef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129322) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:44:27.028335 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.policy [None req-b948500c-9176-4441-9659-74f026e7d653 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e811736979c44b02b14fecb74c6bd7ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675272fb40d4847819f83ec04afecef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129322) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:44:27.029826 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.policy [None req-b948500c-9176-4441-9659-74f026e7d653 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e811736979c44b02b14fecb74c6bd7ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675272fb40d4847819f83ec04afecef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129322) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:44:27.031025 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: INFO nova.api.openstack.requestlog [None req-b948500c-9176-4441-9659-74f026e7d653 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] 10.222.0.75 "GET /compute/v2.1/servers/bf2f6303-22b9-4cfa-8d4d-61d2503bc554" status: 200 len: 1810 microversion: 2.20 time: 0.174825 May 26 12:44:27.031649 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: [pid: 129322|app: 0|req: 380/740] 10.222.0.75 () {60 vars in 1276 bytes} [Thu May 26 12:44:26 2022] GET /compute/v2.1/servers/bf2f6303-22b9-4cfa-8d4d-61d2503bc554 => generated 1810 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 12:44:28.052697 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi [None req-d4ec4171-8b03-41e1-b6ef-ef4db67ff3bf tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Calling method '>' {{(pid=129321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:44:28.053334 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.compute.api [None req-d4ec4171-8b03-41e1-b6ef-ef4db67ff3bf tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] [instance: bf2f6303-22b9-4cfa-8d4d-61d2503bc554] Fetching instance by UUID {{(pid=129321) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:44:28.055714 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG dbcounter [-] [129321] Writing DB stats nova_api:SELECT=45,nova_api:UPDATE=1 {{(pid=129321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:44:28.061915 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-d4ec4171-8b03-41e1-b6ef-ef4db67ff3bf tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:44:28.062354 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-d4ec4171-8b03-41e1-b6ef-ef4db67ff3bf tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:44:28.063187 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-d4ec4171-8b03-41e1-b6ef-ef4db67ff3bf tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:44:28.063638 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-d4ec4171-8b03-41e1-b6ef-ef4db67ff3bf tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:44:28.205340 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.policy [None req-d4ec4171-8b03-41e1-b6ef-ef4db67ff3bf tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e811736979c44b02b14fecb74c6bd7ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675272fb40d4847819f83ec04afecef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129321) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:44:28.217964 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.policy [None req-d4ec4171-8b03-41e1-b6ef-ef4db67ff3bf tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e811736979c44b02b14fecb74c6bd7ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675272fb40d4847819f83ec04afecef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129321) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:44:28.220111 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.policy [None req-d4ec4171-8b03-41e1-b6ef-ef4db67ff3bf tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e811736979c44b02b14fecb74c6bd7ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675272fb40d4847819f83ec04afecef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129321) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:44:28.221974 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: INFO nova.api.openstack.requestlog [None req-d4ec4171-8b03-41e1-b6ef-ef4db67ff3bf tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] 10.222.0.75 "GET /compute/v2.1/servers/bf2f6303-22b9-4cfa-8d4d-61d2503bc554" status: 200 len: 1810 microversion: 2.20 time: 0.173360 May 26 12:44:28.222880 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: [pid: 129321|app: 0|req: 361/741] 10.222.0.75 () {60 vars in 1276 bytes} [Thu May 26 12:44:28 2022] GET /compute/v2.1/servers/bf2f6303-22b9-4cfa-8d4d-61d2503bc554 => generated 1810 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 12:44:29.246005 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi [None req-d5d704e7-5d09-43ff-b10e-7e04849b2d62 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Calling method '>' {{(pid=129322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:44:29.246920 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.compute.api [None req-d5d704e7-5d09-43ff-b10e-7e04849b2d62 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] [instance: bf2f6303-22b9-4cfa-8d4d-61d2503bc554] Fetching instance by UUID {{(pid=129322) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:44:29.254037 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-d5d704e7-5d09-43ff-b10e-7e04849b2d62 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:44:29.254486 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-d5d704e7-5d09-43ff-b10e-7e04849b2d62 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:44:29.255256 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-d5d704e7-5d09-43ff-b10e-7e04849b2d62 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:44:29.255728 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-d5d704e7-5d09-43ff-b10e-7e04849b2d62 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:44:29.392529 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.policy [None req-d5d704e7-5d09-43ff-b10e-7e04849b2d62 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e811736979c44b02b14fecb74c6bd7ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675272fb40d4847819f83ec04afecef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129322) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:44:29.401427 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.policy [None req-d5d704e7-5d09-43ff-b10e-7e04849b2d62 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e811736979c44b02b14fecb74c6bd7ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675272fb40d4847819f83ec04afecef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129322) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:44:29.404095 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.policy [None req-d5d704e7-5d09-43ff-b10e-7e04849b2d62 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e811736979c44b02b14fecb74c6bd7ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675272fb40d4847819f83ec04afecef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129322) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:44:29.405434 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: INFO nova.api.openstack.requestlog [None req-d5d704e7-5d09-43ff-b10e-7e04849b2d62 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] 10.222.0.75 "GET /compute/v2.1/servers/bf2f6303-22b9-4cfa-8d4d-61d2503bc554" status: 200 len: 1810 microversion: 2.20 time: 0.165710 May 26 12:44:29.405963 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: [pid: 129322|app: 0|req: 381/742] 10.222.0.75 () {60 vars in 1276 bytes} [Thu May 26 12:44:29 2022] GET /compute/v2.1/servers/bf2f6303-22b9-4cfa-8d4d-61d2503bc554 => generated 1810 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 12:44:30.424489 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi [None req-c01baec5-4078-42ad-b393-c706347cc3cc tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Calling method '>' {{(pid=129321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:44:30.425105 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.compute.api [None req-c01baec5-4078-42ad-b393-c706347cc3cc tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] [instance: bf2f6303-22b9-4cfa-8d4d-61d2503bc554] Fetching instance by UUID {{(pid=129321) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:44:30.432088 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-c01baec5-4078-42ad-b393-c706347cc3cc tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:44:30.432544 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-c01baec5-4078-42ad-b393-c706347cc3cc tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:44:30.433304 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-c01baec5-4078-42ad-b393-c706347cc3cc tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:44:30.433736 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-c01baec5-4078-42ad-b393-c706347cc3cc tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:44:30.436384 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG dbcounter [-] [129321] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:44:30.574504 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.policy [None req-c01baec5-4078-42ad-b393-c706347cc3cc tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e811736979c44b02b14fecb74c6bd7ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675272fb40d4847819f83ec04afecef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129321) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:44:30.583428 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.policy [None req-c01baec5-4078-42ad-b393-c706347cc3cc tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e811736979c44b02b14fecb74c6bd7ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675272fb40d4847819f83ec04afecef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129321) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:44:30.584946 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.policy [None req-c01baec5-4078-42ad-b393-c706347cc3cc tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e811736979c44b02b14fecb74c6bd7ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675272fb40d4847819f83ec04afecef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129321) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:44:30.586110 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: INFO nova.api.openstack.requestlog [None req-c01baec5-4078-42ad-b393-c706347cc3cc tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] 10.222.0.75 "GET /compute/v2.1/servers/bf2f6303-22b9-4cfa-8d4d-61d2503bc554" status: 200 len: 1810 microversion: 2.20 time: 0.165704 May 26 12:44:30.586642 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: [pid: 129321|app: 0|req: 362/743] 10.222.0.75 () {60 vars in 1276 bytes} [Thu May 26 12:44:30 2022] GET /compute/v2.1/servers/bf2f6303-22b9-4cfa-8d4d-61d2503bc554 => generated 1810 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 12:44:31.605145 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi [None req-d501eb45-ac23-4972-ae1f-dbbe5cf9d8ce tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Calling method '>' {{(pid=129322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:44:31.605822 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.compute.api [None req-d501eb45-ac23-4972-ae1f-dbbe5cf9d8ce tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] [instance: bf2f6303-22b9-4cfa-8d4d-61d2503bc554] Fetching instance by UUID {{(pid=129322) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:44:31.613345 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-d501eb45-ac23-4972-ae1f-dbbe5cf9d8ce tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:44:31.613897 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-d501eb45-ac23-4972-ae1f-dbbe5cf9d8ce tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:44:31.614730 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-d501eb45-ac23-4972-ae1f-dbbe5cf9d8ce tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:44:31.615303 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-d501eb45-ac23-4972-ae1f-dbbe5cf9d8ce tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:44:31.761345 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.policy [None req-d501eb45-ac23-4972-ae1f-dbbe5cf9d8ce tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e811736979c44b02b14fecb74c6bd7ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675272fb40d4847819f83ec04afecef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129322) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:44:31.770087 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.policy [None req-d501eb45-ac23-4972-ae1f-dbbe5cf9d8ce tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e811736979c44b02b14fecb74c6bd7ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675272fb40d4847819f83ec04afecef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129322) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:44:31.771632 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.policy [None req-d501eb45-ac23-4972-ae1f-dbbe5cf9d8ce tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e811736979c44b02b14fecb74c6bd7ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675272fb40d4847819f83ec04afecef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129322) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:44:31.772817 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: INFO nova.api.openstack.requestlog [None req-d501eb45-ac23-4972-ae1f-dbbe5cf9d8ce tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] 10.222.0.75 "GET /compute/v2.1/servers/bf2f6303-22b9-4cfa-8d4d-61d2503bc554" status: 200 len: 1810 microversion: 2.20 time: 0.171756 May 26 12:44:31.773383 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: [pid: 129322|app: 0|req: 382/744] 10.222.0.75 () {60 vars in 1276 bytes} [Thu May 26 12:44:31 2022] GET /compute/v2.1/servers/bf2f6303-22b9-4cfa-8d4d-61d2503bc554 => generated 1810 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 12:44:32.792231 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi [None req-c3743a4d-e89e-496a-a8f5-61f65f68d45b tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Calling method '>' {{(pid=129321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:44:32.792866 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.compute.api [None req-c3743a4d-e89e-496a-a8f5-61f65f68d45b tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] [instance: bf2f6303-22b9-4cfa-8d4d-61d2503bc554] Fetching instance by UUID {{(pid=129321) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:44:32.800154 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-c3743a4d-e89e-496a-a8f5-61f65f68d45b tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:44:32.800605 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-c3743a4d-e89e-496a-a8f5-61f65f68d45b tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:44:32.801365 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-c3743a4d-e89e-496a-a8f5-61f65f68d45b tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:44:32.801794 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-c3743a4d-e89e-496a-a8f5-61f65f68d45b tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:44:32.956950 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.policy [None req-c3743a4d-e89e-496a-a8f5-61f65f68d45b tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e811736979c44b02b14fecb74c6bd7ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675272fb40d4847819f83ec04afecef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129321) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:44:32.970086 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.policy [None req-c3743a4d-e89e-496a-a8f5-61f65f68d45b tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e811736979c44b02b14fecb74c6bd7ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675272fb40d4847819f83ec04afecef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129321) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:44:32.970086 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.policy [None req-c3743a4d-e89e-496a-a8f5-61f65f68d45b tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e811736979c44b02b14fecb74c6bd7ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675272fb40d4847819f83ec04afecef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129321) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:44:32.970086 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: INFO nova.api.openstack.requestlog [None req-c3743a4d-e89e-496a-a8f5-61f65f68d45b tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] 10.222.0.75 "GET /compute/v2.1/servers/bf2f6303-22b9-4cfa-8d4d-61d2503bc554" status: 200 len: 1810 microversion: 2.20 time: 0.180558 May 26 12:44:32.970437 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: [pid: 129321|app: 0|req: 363/745] 10.222.0.75 () {60 vars in 1276 bytes} [Thu May 26 12:44:32 2022] GET /compute/v2.1/servers/bf2f6303-22b9-4cfa-8d4d-61d2503bc554 => generated 1810 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 12:44:33.987976 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi [None req-65b309a6-86a7-40dc-8549-fa215beeca4a tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Calling method '>' {{(pid=129322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:44:33.988856 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.compute.api [None req-65b309a6-86a7-40dc-8549-fa215beeca4a tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] [instance: bf2f6303-22b9-4cfa-8d4d-61d2503bc554] Fetching instance by UUID {{(pid=129322) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:44:33.995374 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-65b309a6-86a7-40dc-8549-fa215beeca4a tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:44:33.995853 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-65b309a6-86a7-40dc-8549-fa215beeca4a tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:44:33.996617 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-65b309a6-86a7-40dc-8549-fa215beeca4a tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:44:33.997043 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-65b309a6-86a7-40dc-8549-fa215beeca4a tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:44:34.152667 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.policy [None req-65b309a6-86a7-40dc-8549-fa215beeca4a tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e811736979c44b02b14fecb74c6bd7ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675272fb40d4847819f83ec04afecef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129322) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:44:34.163550 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.policy [None req-65b309a6-86a7-40dc-8549-fa215beeca4a tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e811736979c44b02b14fecb74c6bd7ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675272fb40d4847819f83ec04afecef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129322) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:44:34.165340 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.policy [None req-65b309a6-86a7-40dc-8549-fa215beeca4a tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e811736979c44b02b14fecb74c6bd7ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675272fb40d4847819f83ec04afecef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129322) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:44:34.167416 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: INFO nova.api.openstack.requestlog [None req-65b309a6-86a7-40dc-8549-fa215beeca4a tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] 10.222.0.75 "GET /compute/v2.1/servers/bf2f6303-22b9-4cfa-8d4d-61d2503bc554" status: 200 len: 1810 microversion: 2.20 time: 0.182909 May 26 12:44:34.175250 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: [pid: 129322|app: 0|req: 383/746] 10.222.0.75 () {60 vars in 1276 bytes} [Thu May 26 12:44:33 2022] GET /compute/v2.1/servers/bf2f6303-22b9-4cfa-8d4d-61d2503bc554 => generated 1810 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 12:44:35.185863 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi [None req-19eba793-6b3d-460f-b0a8-6c020a13fb15 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Calling method '>' {{(pid=129321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:44:35.186465 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.compute.api [None req-19eba793-6b3d-460f-b0a8-6c020a13fb15 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] [instance: bf2f6303-22b9-4cfa-8d4d-61d2503bc554] Fetching instance by UUID {{(pid=129321) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:44:35.193437 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-19eba793-6b3d-460f-b0a8-6c020a13fb15 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:44:35.193882 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-19eba793-6b3d-460f-b0a8-6c020a13fb15 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:44:35.194685 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-19eba793-6b3d-460f-b0a8-6c020a13fb15 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:44:35.195114 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-19eba793-6b3d-460f-b0a8-6c020a13fb15 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:44:35.342393 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.policy [None req-19eba793-6b3d-460f-b0a8-6c020a13fb15 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e811736979c44b02b14fecb74c6bd7ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675272fb40d4847819f83ec04afecef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129321) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:44:35.352872 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.policy [None req-19eba793-6b3d-460f-b0a8-6c020a13fb15 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e811736979c44b02b14fecb74c6bd7ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675272fb40d4847819f83ec04afecef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129321) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:44:35.354756 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.policy [None req-19eba793-6b3d-460f-b0a8-6c020a13fb15 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e811736979c44b02b14fecb74c6bd7ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675272fb40d4847819f83ec04afecef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129321) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:44:35.355973 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: INFO nova.api.openstack.requestlog [None req-19eba793-6b3d-460f-b0a8-6c020a13fb15 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] 10.222.0.75 "GET /compute/v2.1/servers/bf2f6303-22b9-4cfa-8d4d-61d2503bc554" status: 200 len: 1797 microversion: 2.20 time: 0.174260 May 26 12:44:35.356530 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: [pid: 129321|app: 0|req: 364/747] 10.222.0.75 () {60 vars in 1276 bytes} [Thu May 26 12:44:35 2022] GET /compute/v2.1/servers/bf2f6303-22b9-4cfa-8d4d-61d2503bc554 => generated 1797 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 12:44:48.351226 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 26 12:44:48.351946 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: Thu May 26 12:44:48 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 26 12:44:50.769023 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 26 12:44:50.769821 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: Thu May 26 12:44:50 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 26 12:45:16.447989 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG dbcounter [-] [129322] Writing DB stats nova_api:SELECT=33 {{(pid=129322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:45:16.450565 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG dbcounter [-] [129322] Writing DB stats nova_cell1:SELECT=43 {{(pid=129322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:45:17.005315 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi [None req-7393337a-f127-477a-8441-6fe6a9696f3e tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "fa551505-a93f-430a-b293-ca5ec956d51f"}} {{(pid=129322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 12:45:17.008197 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.compute.api [None req-7393337a-f127-477a-8441-6fe6a9696f3e tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] [instance: e911acec-b583-42eb-b5de-dee9573bad6c] Fetching instance by UUID {{(pid=129322) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:45:17.029109 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-7393337a-f127-477a-8441-6fe6a9696f3e tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:45:17.035035 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-7393337a-f127-477a-8441-6fe6a9696f3e tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:45:17.036271 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-7393337a-f127-477a-8441-6fe6a9696f3e tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:45:17.036742 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-7393337a-f127-477a-8441-6fe6a9696f3e tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:45:17.534194 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: INFO nova.api.openstack.requestlog [None req-7393337a-f127-477a-8441-6fe6a9696f3e tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] 10.222.0.75 "POST /compute/v2.1/servers/e911acec-b583-42eb-b5de-dee9573bad6c/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.091346 May 26 12:45:17.536689 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: [pid: 129322|app: 0|req: 384/748] 10.222.0.75 () {60 vars in 1322 bytes} [Thu May 26 12:45:16 2022] POST /compute/v2.1/servers/e911acec-b583-42eb-b5de-dee9573bad6c/os-volume_attachments => generated 194 bytes in 1095 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 12:45:19.169738 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG dbcounter [-] [129321] Writing DB stats nova_api:SELECT=7 {{(pid=129321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:45:19.171226 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG dbcounter [-] [129321] Writing DB stats nova_cell1:SELECT=17 {{(pid=129321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:45:19.302707 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi [None req-17efe4a6-0562-4bca-930f-d7088ba19653 tempest-TestVolumeBootPattern-1304354335 tempest-TestVolumeBootPattern-1304354335-project] Action: 'create', calling method: .version_select at 0x7f82fbf655e0>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-172235393", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPkYDOdGOGL6HEf0PFjXFhEtHwZDg1axo9IlBuBojYX6CQL/EGSJabynEo7aAu+mV0u1IWjXMMcJLazhNJ5KnX/iIxhkqdThC+MQnG/KNiMi4NEduY1YjleTyymjgkQmNw=="}} {{(pid=129321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 12:45:19.321567 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.quota [None req-17efe4a6-0562-4bca-930f-d7088ba19653 tempest-TestVolumeBootPattern-1304354335 tempest-TestVolumeBootPattern-1304354335-project] Getting quotas for project d6fb41c547884511893b768b833f4e90. Resources: {'key_pairs'} {{(pid=129321) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 26 12:45:19.332736 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.quota [None req-17efe4a6-0562-4bca-930f-d7088ba19653 tempest-TestVolumeBootPattern-1304354335 tempest-TestVolumeBootPattern-1304354335-project] Getting quotas for user ab469b18ce0444d9884cdddc34ef7247 and project d6fb41c547884511893b768b833f4e90. Resources: {'key_pairs'} {{(pid=129321) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 26 12:45:19.368361 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: INFO nova.api.openstack.requestlog [None req-17efe4a6-0562-4bca-930f-d7088ba19653 tempest-TestVolumeBootPattern-1304354335 tempest-TestVolumeBootPattern-1304354335-project] 10.222.0.75 "POST /compute/v2.1/os-keypairs" status: 200 len: 399 microversion: 2.1 time: 0.203894 May 26 12:45:19.369487 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: [pid: 129321|app: 0|req: 365/749] 10.222.0.75 () {60 vars in 1158 bytes} [Thu May 26 12:45:19 2022] POST /compute/v2.1/os-keypairs => generated 399 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 12:45:25.259706 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi [None req-7e458728-e801-4047-86a2-bd9e10022f34 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=129322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 12:45:25.260739 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.compute.api [None req-7e458728-e801-4047-86a2-bd9e10022f34 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] [instance: e911acec-b583-42eb-b5de-dee9573bad6c] Fetching instance by UUID {{(pid=129322) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:45:25.267660 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-7e458728-e801-4047-86a2-bd9e10022f34 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:45:25.268302 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-7e458728-e801-4047-86a2-bd9e10022f34 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:45:25.269072 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-7e458728-e801-4047-86a2-bd9e10022f34 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:45:25.269503 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-7e458728-e801-4047-86a2-bd9e10022f34 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:45:25.294339 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.objects.instance [None req-7e458728-e801-4047-86a2-bd9e10022f34 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lazy-loading 'flavor' on Instance uuid e911acec-b583-42eb-b5de-dee9573bad6c {{(pid=129322) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 26 12:45:25.461830 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: INFO nova.api.openstack.requestlog [None req-7e458728-e801-4047-86a2-bd9e10022f34 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] 10.222.0.75 "POST /compute/v2.1/servers/e911acec-b583-42eb-b5de-dee9573bad6c/action" status: 200 len: 32 microversion: 2.1 time: 0.207116 May 26 12:45:25.462439 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: [pid: 129322|app: 0|req: 385/750] 10.222.0.75 () {60 vars in 1277 bytes} [Thu May 26 12:45:25 2022] POST /compute/v2.1/servers/e911acec-b583-42eb-b5de-dee9573bad6c/action => generated 32 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 26 12:45:25.473313 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi [None req-74fedd5e-2097-4566-825c-1a9834b93741 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Calling method '>' {{(pid=129321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:45:25.474809 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.compute.api [None req-74fedd5e-2097-4566-825c-1a9834b93741 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] [instance: e911acec-b583-42eb-b5de-dee9573bad6c] Fetching instance by UUID {{(pid=129321) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:45:25.482732 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-74fedd5e-2097-4566-825c-1a9834b93741 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:45:25.483524 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-74fedd5e-2097-4566-825c-1a9834b93741 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:45:25.484321 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-74fedd5e-2097-4566-825c-1a9834b93741 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:45:25.484740 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-74fedd5e-2097-4566-825c-1a9834b93741 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:45:25.707200 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.policy [None req-74fedd5e-2097-4566-825c-1a9834b93741 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0431b1f25497443ba483b3c440669080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e36ab03283d4ce6a2fed5e111e03d34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129321) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:45:25.715410 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: INFO nova.api.openstack.requestlog [None req-74fedd5e-2097-4566-825c-1a9834b93741 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] 10.222.0.75 "GET /compute/v2.1/servers/e911acec-b583-42eb-b5de-dee9573bad6c" status: 200 len: 1736 microversion: 2.1 time: 0.247668 May 26 12:45:25.716122 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: [pid: 129321|app: 0|req: 366/751] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 26 12:45:25 2022] GET /compute/v2.1/servers/e911acec-b583-42eb-b5de-dee9573bad6c => generated 1736 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:45:26.735584 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi [None req-2315547b-8186-4db3-be31-9d1a2e2945cb tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Calling method '>' {{(pid=129322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:45:26.737213 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.compute.api [None req-2315547b-8186-4db3-be31-9d1a2e2945cb tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] [instance: e911acec-b583-42eb-b5de-dee9573bad6c] Fetching instance by UUID {{(pid=129322) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:45:26.744708 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-2315547b-8186-4db3-be31-9d1a2e2945cb tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:45:26.745164 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-2315547b-8186-4db3-be31-9d1a2e2945cb tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:45:26.745918 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-2315547b-8186-4db3-be31-9d1a2e2945cb tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:45:26.746386 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-2315547b-8186-4db3-be31-9d1a2e2945cb tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:45:26.889292 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.policy [None req-2315547b-8186-4db3-be31-9d1a2e2945cb tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0431b1f25497443ba483b3c440669080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e36ab03283d4ce6a2fed5e111e03d34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129322) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:45:26.898587 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: INFO nova.api.openstack.requestlog [None req-2315547b-8186-4db3-be31-9d1a2e2945cb tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] 10.222.0.75 "GET /compute/v2.1/servers/e911acec-b583-42eb-b5de-dee9573bad6c" status: 200 len: 1736 microversion: 2.1 time: 0.168283 May 26 12:45:26.899178 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: [pid: 129322|app: 0|req: 386/752] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 26 12:45:26 2022] GET /compute/v2.1/servers/e911acec-b583-42eb-b5de-dee9573bad6c => generated 1736 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:45:27.916827 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi [None req-f9e2fd31-e1af-41e6-b622-9842753c4883 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Calling method '>' {{(pid=129321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:45:27.917412 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.compute.api [None req-f9e2fd31-e1af-41e6-b622-9842753c4883 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] [instance: e911acec-b583-42eb-b5de-dee9573bad6c] Fetching instance by UUID {{(pid=129321) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:45:27.924966 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-f9e2fd31-e1af-41e6-b622-9842753c4883 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:45:27.925344 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-f9e2fd31-e1af-41e6-b622-9842753c4883 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:45:27.926120 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-f9e2fd31-e1af-41e6-b622-9842753c4883 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:45:27.926552 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-f9e2fd31-e1af-41e6-b622-9842753c4883 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:45:28.067824 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.policy [None req-f9e2fd31-e1af-41e6-b622-9842753c4883 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0431b1f25497443ba483b3c440669080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e36ab03283d4ce6a2fed5e111e03d34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129321) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:45:28.076477 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: INFO nova.api.openstack.requestlog [None req-f9e2fd31-e1af-41e6-b622-9842753c4883 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] 10.222.0.75 "GET /compute/v2.1/servers/e911acec-b583-42eb-b5de-dee9573bad6c" status: 200 len: 1736 microversion: 2.1 time: 0.163622 May 26 12:45:28.077054 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: [pid: 129321|app: 0|req: 367/753] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 26 12:45:27 2022] GET /compute/v2.1/servers/e911acec-b583-42eb-b5de-dee9573bad6c => generated 1736 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:45:29.094734 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi [None req-22a4483f-dac9-4118-a935-38390cf00edc tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Calling method '>' {{(pid=129322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:45:29.095523 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.compute.api [None req-22a4483f-dac9-4118-a935-38390cf00edc tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] [instance: e911acec-b583-42eb-b5de-dee9573bad6c] Fetching instance by UUID {{(pid=129322) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:45:29.107681 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-22a4483f-dac9-4118-a935-38390cf00edc tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:45:29.108191 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-22a4483f-dac9-4118-a935-38390cf00edc tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:45:29.108955 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-22a4483f-dac9-4118-a935-38390cf00edc tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:45:29.109414 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-22a4483f-dac9-4118-a935-38390cf00edc tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:45:29.260902 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.policy [None req-22a4483f-dac9-4118-a935-38390cf00edc tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0431b1f25497443ba483b3c440669080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e36ab03283d4ce6a2fed5e111e03d34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129322) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:45:29.269892 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: INFO nova.api.openstack.requestlog [None req-22a4483f-dac9-4118-a935-38390cf00edc tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] 10.222.0.75 "GET /compute/v2.1/servers/e911acec-b583-42eb-b5de-dee9573bad6c" status: 200 len: 1736 microversion: 2.1 time: 0.179134 May 26 12:45:29.270469 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: [pid: 129322|app: 0|req: 387/754] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 26 12:45:29 2022] GET /compute/v2.1/servers/e911acec-b583-42eb-b5de-dee9573bad6c => generated 1736 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:45:30.288093 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi [None req-8990b9db-7980-482c-b193-7ade3f384978 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Calling method '>' {{(pid=129321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:45:30.289461 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.compute.api [None req-8990b9db-7980-482c-b193-7ade3f384978 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] [instance: e911acec-b583-42eb-b5de-dee9573bad6c] Fetching instance by UUID {{(pid=129321) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:45:30.292089 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG dbcounter [-] [129321] Writing DB stats nova_cell0:SELECT=4 {{(pid=129321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:45:30.297409 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-8990b9db-7980-482c-b193-7ade3f384978 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:45:30.297854 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-8990b9db-7980-482c-b193-7ade3f384978 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:45:30.298685 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-8990b9db-7980-482c-b193-7ade3f384978 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:45:30.299121 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-8990b9db-7980-482c-b193-7ade3f384978 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:45:30.447492 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.policy [None req-8990b9db-7980-482c-b193-7ade3f384978 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0431b1f25497443ba483b3c440669080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e36ab03283d4ce6a2fed5e111e03d34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129321) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:45:30.456761 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: INFO nova.api.openstack.requestlog [None req-8990b9db-7980-482c-b193-7ade3f384978 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] 10.222.0.75 "GET /compute/v2.1/servers/e911acec-b583-42eb-b5de-dee9573bad6c" status: 200 len: 1736 microversion: 2.1 time: 0.172200 May 26 12:45:30.457162 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: [pid: 129321|app: 0|req: 368/755] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 26 12:45:30 2022] GET /compute/v2.1/servers/e911acec-b583-42eb-b5de-dee9573bad6c => generated 1736 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:45:31.474525 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi [None req-e589a881-46ca-4f00-a096-f55c57156caa tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Calling method '>' {{(pid=129322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:45:31.475170 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.compute.api [None req-e589a881-46ca-4f00-a096-f55c57156caa tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] [instance: e911acec-b583-42eb-b5de-dee9573bad6c] Fetching instance by UUID {{(pid=129322) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:45:31.483163 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-e589a881-46ca-4f00-a096-f55c57156caa tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:45:31.483747 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-e589a881-46ca-4f00-a096-f55c57156caa tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:45:31.484705 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-e589a881-46ca-4f00-a096-f55c57156caa tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:45:31.485235 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-e589a881-46ca-4f00-a096-f55c57156caa tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:45:31.649235 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.policy [None req-e589a881-46ca-4f00-a096-f55c57156caa tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0431b1f25497443ba483b3c440669080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e36ab03283d4ce6a2fed5e111e03d34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129322) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:45:31.658818 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: INFO nova.api.openstack.requestlog [None req-e589a881-46ca-4f00-a096-f55c57156caa tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] 10.222.0.75 "GET /compute/v2.1/servers/e911acec-b583-42eb-b5de-dee9573bad6c" status: 200 len: 1736 microversion: 2.1 time: 0.189076 May 26 12:45:31.659474 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: [pid: 129322|app: 0|req: 388/756] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 26 12:45:31 2022] GET /compute/v2.1/servers/e911acec-b583-42eb-b5de-dee9573bad6c => generated 1736 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 12:45:32.678715 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi [None req-c1df0ab7-69fe-45c0-884c-a709193f0348 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Calling method '>' {{(pid=129321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:45:32.679409 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.compute.api [None req-c1df0ab7-69fe-45c0-884c-a709193f0348 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] [instance: e911acec-b583-42eb-b5de-dee9573bad6c] Fetching instance by UUID {{(pid=129321) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:45:32.686567 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-c1df0ab7-69fe-45c0-884c-a709193f0348 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:45:32.687268 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-c1df0ab7-69fe-45c0-884c-a709193f0348 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:45:32.688861 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-c1df0ab7-69fe-45c0-884c-a709193f0348 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:45:32.689032 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-c1df0ab7-69fe-45c0-884c-a709193f0348 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:45:32.879840 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.policy [None req-c1df0ab7-69fe-45c0-884c-a709193f0348 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0431b1f25497443ba483b3c440669080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e36ab03283d4ce6a2fed5e111e03d34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129321) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:45:32.890443 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: INFO nova.api.openstack.requestlog [None req-c1df0ab7-69fe-45c0-884c-a709193f0348 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] 10.222.0.75 "GET /compute/v2.1/servers/e911acec-b583-42eb-b5de-dee9573bad6c" status: 200 len: 1736 microversion: 2.1 time: 0.216562 May 26 12:45:32.891038 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: [pid: 129321|app: 0|req: 369/757] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 26 12:45:32 2022] GET /compute/v2.1/servers/e911acec-b583-42eb-b5de-dee9573bad6c => generated 1736 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:45:33.909205 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi [None req-3c02f2b0-1745-48aa-83de-d5758e8ac780 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Calling method '>' {{(pid=129322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:45:33.909844 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.compute.api [None req-3c02f2b0-1745-48aa-83de-d5758e8ac780 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] [instance: e911acec-b583-42eb-b5de-dee9573bad6c] Fetching instance by UUID {{(pid=129322) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:45:33.917048 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-3c02f2b0-1745-48aa-83de-d5758e8ac780 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:45:33.917472 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-3c02f2b0-1745-48aa-83de-d5758e8ac780 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:45:33.918307 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-3c02f2b0-1745-48aa-83de-d5758e8ac780 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:45:33.919064 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-3c02f2b0-1745-48aa-83de-d5758e8ac780 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:45:34.060004 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.policy [None req-3c02f2b0-1745-48aa-83de-d5758e8ac780 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0431b1f25497443ba483b3c440669080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e36ab03283d4ce6a2fed5e111e03d34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129322) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:45:34.070186 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: INFO nova.api.openstack.requestlog [None req-3c02f2b0-1745-48aa-83de-d5758e8ac780 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] 10.222.0.75 "GET /compute/v2.1/servers/e911acec-b583-42eb-b5de-dee9573bad6c" status: 200 len: 1736 microversion: 2.1 time: 0.165287 May 26 12:45:34.070788 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: [pid: 129322|app: 0|req: 389/758] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 26 12:45:33 2022] GET /compute/v2.1/servers/e911acec-b583-42eb-b5de-dee9573bad6c => generated 1736 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:45:35.087911 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi [None req-c6b06050-ce02-4168-aa5a-a9c5b1e8b127 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Calling method '>' {{(pid=129321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:45:35.088461 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.compute.api [None req-c6b06050-ce02-4168-aa5a-a9c5b1e8b127 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] [instance: e911acec-b583-42eb-b5de-dee9573bad6c] Fetching instance by UUID {{(pid=129321) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:45:35.095348 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-c6b06050-ce02-4168-aa5a-a9c5b1e8b127 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:45:35.096260 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-c6b06050-ce02-4168-aa5a-a9c5b1e8b127 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:45:35.096959 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-c6b06050-ce02-4168-aa5a-a9c5b1e8b127 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:45:35.097395 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-c6b06050-ce02-4168-aa5a-a9c5b1e8b127 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:45:35.243615 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.policy [None req-c6b06050-ce02-4168-aa5a-a9c5b1e8b127 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0431b1f25497443ba483b3c440669080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e36ab03283d4ce6a2fed5e111e03d34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129321) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:45:35.253817 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: INFO nova.api.openstack.requestlog [None req-c6b06050-ce02-4168-aa5a-a9c5b1e8b127 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] 10.222.0.75 "GET /compute/v2.1/servers/e911acec-b583-42eb-b5de-dee9573bad6c" status: 200 len: 1736 microversion: 2.1 time: 0.169827 May 26 12:45:35.254405 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: [pid: 129321|app: 0|req: 370/759] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 26 12:45:35 2022] GET /compute/v2.1/servers/e911acec-b583-42eb-b5de-dee9573bad6c => generated 1736 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:45:36.270659 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi [None req-2bcb25d4-bb0f-4bf4-bdae-76d80efb1170 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Calling method '>' {{(pid=129322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:45:36.271319 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.compute.api [None req-2bcb25d4-bb0f-4bf4-bdae-76d80efb1170 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] [instance: e911acec-b583-42eb-b5de-dee9573bad6c] Fetching instance by UUID {{(pid=129322) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:45:36.279366 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-2bcb25d4-bb0f-4bf4-bdae-76d80efb1170 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:45:36.279842 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-2bcb25d4-bb0f-4bf4-bdae-76d80efb1170 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:45:36.281473 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-2bcb25d4-bb0f-4bf4-bdae-76d80efb1170 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:45:36.281905 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-2bcb25d4-bb0f-4bf4-bdae-76d80efb1170 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:45:36.427568 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.policy [None req-2bcb25d4-bb0f-4bf4-bdae-76d80efb1170 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0431b1f25497443ba483b3c440669080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e36ab03283d4ce6a2fed5e111e03d34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129322) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:45:36.435980 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: INFO nova.api.openstack.requestlog [None req-2bcb25d4-bb0f-4bf4-bdae-76d80efb1170 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] 10.222.0.75 "GET /compute/v2.1/servers/e911acec-b583-42eb-b5de-dee9573bad6c" status: 200 len: 1736 microversion: 2.1 time: 0.169288 May 26 12:45:36.436528 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: [pid: 129322|app: 0|req: 390/760] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 26 12:45:36 2022] GET /compute/v2.1/servers/e911acec-b583-42eb-b5de-dee9573bad6c => generated 1736 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:45:37.454325 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi [None req-18ab7c8b-7338-464b-9809-e1ecd9648b66 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Calling method '>' {{(pid=129321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:45:37.455029 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.compute.api [None req-18ab7c8b-7338-464b-9809-e1ecd9648b66 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] [instance: e911acec-b583-42eb-b5de-dee9573bad6c] Fetching instance by UUID {{(pid=129321) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:45:37.461980 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-18ab7c8b-7338-464b-9809-e1ecd9648b66 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:45:37.462437 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-18ab7c8b-7338-464b-9809-e1ecd9648b66 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:45:37.463201 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-18ab7c8b-7338-464b-9809-e1ecd9648b66 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:45:37.463671 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-18ab7c8b-7338-464b-9809-e1ecd9648b66 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:45:37.601126 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.policy [None req-18ab7c8b-7338-464b-9809-e1ecd9648b66 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0431b1f25497443ba483b3c440669080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e36ab03283d4ce6a2fed5e111e03d34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129321) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:45:37.609857 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: INFO nova.api.openstack.requestlog [None req-18ab7c8b-7338-464b-9809-e1ecd9648b66 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] 10.222.0.75 "GET /compute/v2.1/servers/e911acec-b583-42eb-b5de-dee9573bad6c" status: 200 len: 1736 microversion: 2.1 time: 0.159548 May 26 12:45:37.610447 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: [pid: 129321|app: 0|req: 371/761] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 26 12:45:37 2022] GET /compute/v2.1/servers/e911acec-b583-42eb-b5de-dee9573bad6c => generated 1736 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:45:38.627551 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi [None req-a47ffd7c-b6d3-4988-bc20-588c2eab89e2 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Calling method '>' {{(pid=129322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:45:38.628223 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.compute.api [None req-a47ffd7c-b6d3-4988-bc20-588c2eab89e2 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] [instance: e911acec-b583-42eb-b5de-dee9573bad6c] Fetching instance by UUID {{(pid=129322) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:45:38.635283 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-a47ffd7c-b6d3-4988-bc20-588c2eab89e2 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:45:38.635755 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-a47ffd7c-b6d3-4988-bc20-588c2eab89e2 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:45:38.636511 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-a47ffd7c-b6d3-4988-bc20-588c2eab89e2 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:45:38.636941 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-a47ffd7c-b6d3-4988-bc20-588c2eab89e2 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:45:38.766431 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.policy [None req-a47ffd7c-b6d3-4988-bc20-588c2eab89e2 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0431b1f25497443ba483b3c440669080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e36ab03283d4ce6a2fed5e111e03d34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129322) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:45:38.775345 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: INFO nova.api.openstack.requestlog [None req-a47ffd7c-b6d3-4988-bc20-588c2eab89e2 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] 10.222.0.75 "GET /compute/v2.1/servers/e911acec-b583-42eb-b5de-dee9573bad6c" status: 200 len: 1736 microversion: 2.1 time: 0.151654 May 26 12:45:38.776173 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: [pid: 129322|app: 0|req: 391/762] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 26 12:45:38 2022] GET /compute/v2.1/servers/e911acec-b583-42eb-b5de-dee9573bad6c => generated 1736 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:45:39.793685 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi [None req-52a0b774-0743-4800-ba3f-69561f12823f tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Calling method '>' {{(pid=129321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:45:39.794304 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.compute.api [None req-52a0b774-0743-4800-ba3f-69561f12823f tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] [instance: e911acec-b583-42eb-b5de-dee9573bad6c] Fetching instance by UUID {{(pid=129321) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:45:39.801229 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-52a0b774-0743-4800-ba3f-69561f12823f tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:45:39.801676 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-52a0b774-0743-4800-ba3f-69561f12823f tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:45:39.802438 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-52a0b774-0743-4800-ba3f-69561f12823f tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:45:39.802865 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-52a0b774-0743-4800-ba3f-69561f12823f tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:45:39.941430 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.policy [None req-52a0b774-0743-4800-ba3f-69561f12823f tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0431b1f25497443ba483b3c440669080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e36ab03283d4ce6a2fed5e111e03d34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129321) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:45:39.949756 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: INFO nova.api.openstack.requestlog [None req-52a0b774-0743-4800-ba3f-69561f12823f tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] 10.222.0.75 "GET /compute/v2.1/servers/e911acec-b583-42eb-b5de-dee9573bad6c" status: 200 len: 1736 microversion: 2.1 time: 0.160052 May 26 12:45:39.950330 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: [pid: 129321|app: 0|req: 372/763] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 26 12:45:39 2022] GET /compute/v2.1/servers/e911acec-b583-42eb-b5de-dee9573bad6c => generated 1736 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:45:40.968573 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi [None req-4a555532-44fb-478e-9cec-bc8a2ff2e3ac tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Calling method '>' {{(pid=129322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:45:40.969218 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.compute.api [None req-4a555532-44fb-478e-9cec-bc8a2ff2e3ac tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] [instance: e911acec-b583-42eb-b5de-dee9573bad6c] Fetching instance by UUID {{(pid=129322) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:45:40.976382 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-4a555532-44fb-478e-9cec-bc8a2ff2e3ac tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:45:40.976821 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-4a555532-44fb-478e-9cec-bc8a2ff2e3ac tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:45:40.977593 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-4a555532-44fb-478e-9cec-bc8a2ff2e3ac tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:45:40.978009 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-4a555532-44fb-478e-9cec-bc8a2ff2e3ac tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:45:41.110633 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.policy [None req-4a555532-44fb-478e-9cec-bc8a2ff2e3ac tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0431b1f25497443ba483b3c440669080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e36ab03283d4ce6a2fed5e111e03d34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129322) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:45:41.119144 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: INFO nova.api.openstack.requestlog [None req-4a555532-44fb-478e-9cec-bc8a2ff2e3ac tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] 10.222.0.75 "GET /compute/v2.1/servers/e911acec-b583-42eb-b5de-dee9573bad6c" status: 200 len: 1736 microversion: 2.1 time: 0.154607 May 26 12:45:41.119748 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: [pid: 129322|app: 0|req: 392/764] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 26 12:45:40 2022] GET /compute/v2.1/servers/e911acec-b583-42eb-b5de-dee9573bad6c => generated 1736 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:45:42.137484 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi [None req-6a93d444-9fab-472f-9d4d-393caf08c69a tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Calling method '>' {{(pid=129321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:45:42.138073 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.compute.api [None req-6a93d444-9fab-472f-9d4d-393caf08c69a tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] [instance: e911acec-b583-42eb-b5de-dee9573bad6c] Fetching instance by UUID {{(pid=129321) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:45:42.144867 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-6a93d444-9fab-472f-9d4d-393caf08c69a tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:45:42.145317 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-6a93d444-9fab-472f-9d4d-393caf08c69a tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:45:42.146106 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-6a93d444-9fab-472f-9d4d-393caf08c69a tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:45:42.146574 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-6a93d444-9fab-472f-9d4d-393caf08c69a tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:45:42.290715 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.policy [None req-6a93d444-9fab-472f-9d4d-393caf08c69a tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0431b1f25497443ba483b3c440669080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e36ab03283d4ce6a2fed5e111e03d34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129321) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:45:42.299187 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: INFO nova.api.openstack.requestlog [None req-6a93d444-9fab-472f-9d4d-393caf08c69a tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] 10.222.0.75 "GET /compute/v2.1/servers/e911acec-b583-42eb-b5de-dee9573bad6c" status: 200 len: 1736 microversion: 2.1 time: 0.165697 May 26 12:45:42.299815 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: [pid: 129321|app: 0|req: 373/765] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 26 12:45:42 2022] GET /compute/v2.1/servers/e911acec-b583-42eb-b5de-dee9573bad6c => generated 1736 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 12:45:43.317006 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi [None req-1ffeaf5a-405c-4c17-a927-c8e9499969d1 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Calling method '>' {{(pid=129322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:45:43.317623 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.compute.api [None req-1ffeaf5a-405c-4c17-a927-c8e9499969d1 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] [instance: e911acec-b583-42eb-b5de-dee9573bad6c] Fetching instance by UUID {{(pid=129322) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:45:43.324795 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-1ffeaf5a-405c-4c17-a927-c8e9499969d1 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:45:43.325244 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-1ffeaf5a-405c-4c17-a927-c8e9499969d1 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:45:43.326008 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-1ffeaf5a-405c-4c17-a927-c8e9499969d1 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:45:43.326442 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-1ffeaf5a-405c-4c17-a927-c8e9499969d1 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:45:43.460175 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.policy [None req-1ffeaf5a-405c-4c17-a927-c8e9499969d1 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0431b1f25497443ba483b3c440669080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e36ab03283d4ce6a2fed5e111e03d34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129322) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:45:43.468569 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: INFO nova.api.openstack.requestlog [None req-1ffeaf5a-405c-4c17-a927-c8e9499969d1 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] 10.222.0.75 "GET /compute/v2.1/servers/e911acec-b583-42eb-b5de-dee9573bad6c" status: 200 len: 1736 microversion: 2.1 time: 0.155432 May 26 12:45:43.469449 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: [pid: 129322|app: 0|req: 393/766] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 26 12:45:43 2022] GET /compute/v2.1/servers/e911acec-b583-42eb-b5de-dee9573bad6c => generated 1736 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:45:43.788263 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi [None req-979bff5f-a227-4ab9-8641-59724b9d4c40 tempest-TestMinimumBasicScenario-102576986 tempest-TestMinimumBasicScenario-102576986-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=129321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 12:45:43.789223 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.compute.api [None req-979bff5f-a227-4ab9-8641-59724b9d4c40 tempest-TestMinimumBasicScenario-102576986 tempest-TestMinimumBasicScenario-102576986-project] [instance: 76661008-e6d3-4646-a9ba-d5d0e83a4b65] Fetching instance by UUID {{(pid=129321) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:45:43.796093 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-979bff5f-a227-4ab9-8641-59724b9d4c40 tempest-TestMinimumBasicScenario-102576986 tempest-TestMinimumBasicScenario-102576986-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:45:43.796547 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-979bff5f-a227-4ab9-8641-59724b9d4c40 tempest-TestMinimumBasicScenario-102576986 tempest-TestMinimumBasicScenario-102576986-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:45:43.797312 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-979bff5f-a227-4ab9-8641-59724b9d4c40 tempest-TestMinimumBasicScenario-102576986 tempest-TestMinimumBasicScenario-102576986-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:45:43.797766 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-979bff5f-a227-4ab9-8641-59724b9d4c40 tempest-TestMinimumBasicScenario-102576986 tempest-TestMinimumBasicScenario-102576986-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:45:43.875632 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: INFO nova.api.openstack.requestlog [None req-979bff5f-a227-4ab9-8641-59724b9d4c40 tempest-TestMinimumBasicScenario-102576986 tempest-TestMinimumBasicScenario-102576986-project] 10.222.0.75 "POST /compute/v2.1/servers/76661008-e6d3-4646-a9ba-d5d0e83a4b65/action" status: 202 len: 0 microversion: 2.1 time: 0.091702 May 26 12:45:43.876437 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: [pid: 129321|app: 0|req: 374/767] 10.222.0.75 () {60 vars in 1277 bytes} [Thu May 26 12:45:43 2022] POST /compute/v2.1/servers/76661008-e6d3-4646-a9ba-d5d0e83a4b65/action => generated 0 bytes in 93 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 26 12:45:43.884459 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi [None req-49328007-abed-41ee-b389-d74948cbd77e tempest-TestMinimumBasicScenario-102576986 tempest-TestMinimumBasicScenario-102576986-project] Calling method '>' {{(pid=129322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:45:43.885077 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.compute.api [None req-49328007-abed-41ee-b389-d74948cbd77e tempest-TestMinimumBasicScenario-102576986 tempest-TestMinimumBasicScenario-102576986-project] [instance: 76661008-e6d3-4646-a9ba-d5d0e83a4b65] Fetching instance by UUID {{(pid=129322) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:45:43.891340 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-49328007-abed-41ee-b389-d74948cbd77e tempest-TestMinimumBasicScenario-102576986 tempest-TestMinimumBasicScenario-102576986-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:45:43.891854 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-49328007-abed-41ee-b389-d74948cbd77e tempest-TestMinimumBasicScenario-102576986 tempest-TestMinimumBasicScenario-102576986-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:45:43.892699 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-49328007-abed-41ee-b389-d74948cbd77e tempest-TestMinimumBasicScenario-102576986 tempest-TestMinimumBasicScenario-102576986-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:45:43.893334 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-49328007-abed-41ee-b389-d74948cbd77e tempest-TestMinimumBasicScenario-102576986 tempest-TestMinimumBasicScenario-102576986-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:45:44.062765 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.policy [None req-49328007-abed-41ee-b389-d74948cbd77e tempest-TestMinimumBasicScenario-102576986 tempest-TestMinimumBasicScenario-102576986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0352a80bdc174b9a9df4eca60b81eba4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fa2c4d6423444e487d259062656129b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129322) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:45:44.071572 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: INFO nova.api.openstack.requestlog [None req-49328007-abed-41ee-b389-d74948cbd77e tempest-TestMinimumBasicScenario-102576986 tempest-TestMinimumBasicScenario-102576986-project] 10.222.0.75 "GET /compute/v2.1/servers/76661008-e6d3-4646-a9ba-d5d0e83a4b65" status: 200 len: 1750 microversion: 2.1 time: 0.190876 May 26 12:45:44.072160 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: [pid: 129322|app: 0|req: 394/768] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 26 12:45:43 2022] GET /compute/v2.1/servers/76661008-e6d3-4646-a9ba-d5d0e83a4b65 => generated 1750 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:45:44.469646 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi [None req-0dbd62b3-13c6-42ce-adeb-f4d7a7eca88b tempest-TestVolumeBootPattern-1304354335 tempest-TestVolumeBootPattern-1304354335-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1280709450", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-172235393", "security_groups": [{"name": "tempest-secgroup-smoke-1960816556"}], "block_device_mapping_v2": [{"uuid": "ddb8ef91-5192-4abd-a66e-45eb1481a8a0", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "7eee456a-a9f6-42d0-bed8-fc7419b250fe"}]}} {{(pid=129321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 12:45:44.487886 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi [None req-7e5a3ee2-bea7-42ad-b95e-14bdc35f05c6 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Calling method '>' {{(pid=129322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:45:44.489082 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.compute.api [None req-7e5a3ee2-bea7-42ad-b95e-14bdc35f05c6 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] [instance: e911acec-b583-42eb-b5de-dee9573bad6c] Fetching instance by UUID {{(pid=129322) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:45:44.499629 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-7e5a3ee2-bea7-42ad-b95e-14bdc35f05c6 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:45:44.500680 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-7e5a3ee2-bea7-42ad-b95e-14bdc35f05c6 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:45:44.503566 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-7e5a3ee2-bea7-42ad-b95e-14bdc35f05c6 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:45:44.504029 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-7e5a3ee2-bea7-42ad-b95e-14bdc35f05c6 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:45:44.647249 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.network.neutron [None req-0dbd62b3-13c6-42ce-adeb-f4d7a7eca88b tempest-TestVolumeBootPattern-1304354335 tempest-TestVolumeBootPattern-1304354335-project] validate_networks() for [('7eee456a-a9f6-42d0-bed8-fc7419b250fe', None, None, None, None, None)] {{(pid=129321) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 26 12:45:44.660213 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.policy [None req-7e5a3ee2-bea7-42ad-b95e-14bdc35f05c6 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0431b1f25497443ba483b3c440669080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e36ab03283d4ce6a2fed5e111e03d34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129322) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:45:44.668868 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: INFO nova.api.openstack.requestlog [None req-7e5a3ee2-bea7-42ad-b95e-14bdc35f05c6 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] 10.222.0.75 "GET /compute/v2.1/servers/e911acec-b583-42eb-b5de-dee9573bad6c" status: 200 len: 1736 microversion: 2.1 time: 0.185318 May 26 12:45:44.669739 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: [pid: 129322|app: 0|req: 395/769] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 26 12:45:44 2022] GET /compute/v2.1/servers/e911acec-b583-42eb-b5de-dee9573bad6c => generated 1736 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:45:45.059221 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.virt.hardware [None req-0dbd62b3-13c6-42ce-adeb-f4d7a7eca88b tempest-TestVolumeBootPattern-1304354335 tempest-TestVolumeBootPattern-1304354335-project] Flavor limits 0:0:0 {{(pid=129321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 26 12:45:45.059750 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.virt.hardware [None req-0dbd62b3-13c6-42ce-adeb-f4d7a7eca88b tempest-TestVolumeBootPattern-1304354335 tempest-TestVolumeBootPattern-1304354335-project] Image limits 0:0:0 {{(pid=129321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 26 12:45:45.060171 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.virt.hardware [None req-0dbd62b3-13c6-42ce-adeb-f4d7a7eca88b tempest-TestVolumeBootPattern-1304354335 tempest-TestVolumeBootPattern-1304354335-project] Flavor pref 0:0:0 {{(pid=129321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 26 12:45:45.060620 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.virt.hardware [None req-0dbd62b3-13c6-42ce-adeb-f4d7a7eca88b tempest-TestVolumeBootPattern-1304354335 tempest-TestVolumeBootPattern-1304354335-project] Image pref 0:0:0 {{(pid=129321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 26 12:45:45.061031 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.virt.hardware [None req-0dbd62b3-13c6-42ce-adeb-f4d7a7eca88b tempest-TestVolumeBootPattern-1304354335 tempest-TestVolumeBootPattern-1304354335-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 26 12:45:45.071497 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-0dbd62b3-13c6-42ce-adeb-f4d7a7eca88b tempest-TestVolumeBootPattern-1304354335 tempest-TestVolumeBootPattern-1304354335-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:45:45.071974 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-0dbd62b3-13c6-42ce-adeb-f4d7a7eca88b tempest-TestVolumeBootPattern-1304354335 tempest-TestVolumeBootPattern-1304354335-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:45:45.072791 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-0dbd62b3-13c6-42ce-adeb-f4d7a7eca88b tempest-TestVolumeBootPattern-1304354335 tempest-TestVolumeBootPattern-1304354335-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:45:45.073231 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-0dbd62b3-13c6-42ce-adeb-f4d7a7eca88b tempest-TestVolumeBootPattern-1304354335 tempest-TestVolumeBootPattern-1304354335-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:45:45.091500 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi [None req-f4edbcf4-f0ff-41e1-93c4-a39df60a7c48 tempest-TestMinimumBasicScenario-102576986 tempest-TestMinimumBasicScenario-102576986-project] Calling method '>' {{(pid=129322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:45:45.092024 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.quota [None req-0dbd62b3-13c6-42ce-adeb-f4d7a7eca88b tempest-TestVolumeBootPattern-1304354335 tempest-TestVolumeBootPattern-1304354335-project] Getting quotas for project d6fb41c547884511893b768b833f4e90. Resources: {'instances', 'cores', 'ram'} {{(pid=129321) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 26 12:45:45.092740 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.compute.api [None req-f4edbcf4-f0ff-41e1-93c4-a39df60a7c48 tempest-TestMinimumBasicScenario-102576986 tempest-TestMinimumBasicScenario-102576986-project] [instance: 76661008-e6d3-4646-a9ba-d5d0e83a4b65] Fetching instance by UUID {{(pid=129322) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:45:45.097730 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.quota [None req-0dbd62b3-13c6-42ce-adeb-f4d7a7eca88b tempest-TestVolumeBootPattern-1304354335 tempest-TestVolumeBootPattern-1304354335-project] Getting quotas for user ab469b18ce0444d9884cdddc34ef7247 and project d6fb41c547884511893b768b833f4e90. Resources: {'instances', 'cores', 'ram'} {{(pid=129321) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 26 12:45:45.103444 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-f4edbcf4-f0ff-41e1-93c4-a39df60a7c48 tempest-TestMinimumBasicScenario-102576986 tempest-TestMinimumBasicScenario-102576986-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:45:45.105354 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-f4edbcf4-f0ff-41e1-93c4-a39df60a7c48 tempest-TestMinimumBasicScenario-102576986 tempest-TestMinimumBasicScenario-102576986-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:45:45.106004 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-f4edbcf4-f0ff-41e1-93c4-a39df60a7c48 tempest-TestMinimumBasicScenario-102576986 tempest-TestMinimumBasicScenario-102576986-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:45:45.106617 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-f4edbcf4-f0ff-41e1-93c4-a39df60a7c48 tempest-TestMinimumBasicScenario-102576986 tempest-TestMinimumBasicScenario-102576986-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:45:45.182037 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.compute.api [None req-0dbd62b3-13c6-42ce-adeb-f4d7a7eca88b tempest-TestVolumeBootPattern-1304354335 tempest-TestVolumeBootPattern-1304354335-project] Going to run 1 instances... {{(pid=129321) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 26 12:45:45.184451 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.compute.api [None req-0dbd62b3-13c6-42ce-adeb-f4d7a7eca88b tempest-TestVolumeBootPattern-1304354335 tempest-TestVolumeBootPattern-1304354335-project] [instance: 475179d2-21d7-4ace-90eb-e6525cb14928] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='ddb8ef91-5192-4abd-a66e-45eb1481a8a0',volume_size=None,volume_type=None)] {{(pid=129321) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 26 12:45:45.285382 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.policy [None req-f4edbcf4-f0ff-41e1-93c4-a39df60a7c48 tempest-TestMinimumBasicScenario-102576986 tempest-TestMinimumBasicScenario-102576986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0352a80bdc174b9a9df4eca60b81eba4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fa2c4d6423444e487d259062656129b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129322) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:45:45.306358 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: INFO nova.api.openstack.requestlog [None req-f4edbcf4-f0ff-41e1-93c4-a39df60a7c48 tempest-TestMinimumBasicScenario-102576986 tempest-TestMinimumBasicScenario-102576986-project] 10.222.0.75 "GET /compute/v2.1/servers/76661008-e6d3-4646-a9ba-d5d0e83a4b65" status: 200 len: 1750 microversion: 2.1 time: 0.220307 May 26 12:45:45.307105 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: [pid: 129322|app: 0|req: 396/770] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 26 12:45:45 2022] GET /compute/v2.1/servers/76661008-e6d3-4646-a9ba-d5d0e83a4b65 => generated 1750 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 12:45:45.354606 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: INFO nova.api.openstack.requestlog [None req-0dbd62b3-13c6-42ce-adeb-f4d7a7eca88b tempest-TestVolumeBootPattern-1304354335 tempest-TestVolumeBootPattern-1304354335-project] 10.222.0.75 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.891929 May 26 12:45:45.355522 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: [pid: 129321|app: 0|req: 375/771] 10.222.0.75 () {60 vars in 1146 bytes} [Thu May 26 12:45:44 2022] POST /compute/v2.1/servers => generated 406 bytes in 894 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 26 12:45:45.367384 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi [None req-06e89e4b-eb69-46da-ab62-530d95bd1a1c tempest-TestVolumeBootPattern-1304354335 tempest-TestVolumeBootPattern-1304354335-project] Calling method '>' {{(pid=129322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:45:45.368248 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.compute.api [None req-06e89e4b-eb69-46da-ab62-530d95bd1a1c tempest-TestVolumeBootPattern-1304354335 tempest-TestVolumeBootPattern-1304354335-project] [instance: 475179d2-21d7-4ace-90eb-e6525cb14928] Fetching instance by UUID {{(pid=129322) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:45:45.427756 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.policy [None req-06e89e4b-eb69-46da-ab62-530d95bd1a1c tempest-TestVolumeBootPattern-1304354335 tempest-TestVolumeBootPattern-1304354335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab469b18ce0444d9884cdddc34ef7247', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fb41c547884511893b768b833f4e90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129322) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:45:45.436256 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: INFO nova.api.openstack.requestlog [None req-06e89e4b-eb69-46da-ab62-530d95bd1a1c tempest-TestVolumeBootPattern-1304354335 tempest-TestVolumeBootPattern-1304354335-project] 10.222.0.75 "GET /compute/v2.1/servers/475179d2-21d7-4ace-90eb-e6525cb14928" status: 200 len: 1094 microversion: 2.1 time: 0.073582 May 26 12:45:45.437167 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: [pid: 129322|app: 0|req: 397/772] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 26 12:45:45 2022] GET /compute/v2.1/servers/475179d2-21d7-4ace-90eb-e6525cb14928 => generated 1094 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:45:45.686942 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi [None req-d18d6cc8-b0eb-49de-afbb-747332f08702 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Calling method '>' {{(pid=129321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:45:45.687716 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.compute.api [None req-d18d6cc8-b0eb-49de-afbb-747332f08702 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] [instance: e911acec-b583-42eb-b5de-dee9573bad6c] Fetching instance by UUID {{(pid=129321) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:45:45.695353 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-d18d6cc8-b0eb-49de-afbb-747332f08702 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:45:45.695913 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-d18d6cc8-b0eb-49de-afbb-747332f08702 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:45:45.696769 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-d18d6cc8-b0eb-49de-afbb-747332f08702 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:45:45.697309 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-d18d6cc8-b0eb-49de-afbb-747332f08702 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:45:45.857511 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.policy [None req-d18d6cc8-b0eb-49de-afbb-747332f08702 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0431b1f25497443ba483b3c440669080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e36ab03283d4ce6a2fed5e111e03d34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129321) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:45:45.866506 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: INFO nova.api.openstack.requestlog [None req-d18d6cc8-b0eb-49de-afbb-747332f08702 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] 10.222.0.75 "GET /compute/v2.1/servers/e911acec-b583-42eb-b5de-dee9573bad6c" status: 200 len: 1716 microversion: 2.1 time: 0.183740 May 26 12:45:45.867103 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: [pid: 129321|app: 0|req: 376/773] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 26 12:45:45 2022] GET /compute/v2.1/servers/e911acec-b583-42eb-b5de-dee9573bad6c => generated 1716 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:45:45.932494 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi [None req-abe83417-e1c0-48e1-b36b-5c0c2fbca307 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Calling method '>' {{(pid=129322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:45:45.933108 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.compute.api [None req-abe83417-e1c0-48e1-b36b-5c0c2fbca307 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] [instance: e911acec-b583-42eb-b5de-dee9573bad6c] Fetching instance by UUID {{(pid=129322) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:45:45.941270 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-abe83417-e1c0-48e1-b36b-5c0c2fbca307 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:45:45.941693 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-abe83417-e1c0-48e1-b36b-5c0c2fbca307 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:45:45.942475 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-abe83417-e1c0-48e1-b36b-5c0c2fbca307 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:45:45.942907 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-abe83417-e1c0-48e1-b36b-5c0c2fbca307 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:45:45.947524 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG dbcounter [-] [129322] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=129322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:45:46.033033 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: INFO nova.api.openstack.wsgi [None req-abe83417-e1c0-48e1-b36b-5c0c2fbca307 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] HTTP exception thrown: Cannot 'detach_volume' instance e911acec-b583-42eb-b5de-dee9573bad6c while it is in vm_state rescued May 26 12:45:46.035593 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi [None req-abe83417-e1c0-48e1-b36b-5c0c2fbca307 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Request method failure captured: May 26 12:45:46.035593 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: request: DELETE /compute/v2.1/servers/e911acec-b583-42eb-b5de-dee9573bad6c/os-volume_attachments/fa551505-a93f-430a-b293-ca5ec956d51f HTTP/1.1 May 26 12:45:46.035593 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: Accept: application/json May 26 12:45:46.035593 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: Accept-Encoding: identity May 26 12:45:46.035593 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: Connection: close May 26 12:45:46.035593 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: Content-Length: 0 May 26 12:45:46.035593 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: Content-Type: application/json May 26 12:45:46.035593 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: Host: 10.222.0.75 May 26 12:45:46.035593 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: Openstack-System-Scope: None May 26 12:45:46.035593 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: User-Agent: python-urllib3/1.26.9 May 26 12:45:46.035593 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: X-Auth-Token: gAAAAABij3S0WbtMcFtLpl5UW4FUUirUww6kWxRFtP_FyC7fCIkKgIa10qp1d64SXO8XGZoWAnH5qdlCU3B3TdVumzT0bkV7P07uLiWhB_0UPHRg81du51UJgft-JAW7F3hpRjJiDiRCUUj2q5hZ29CV8Ux0gDDTwJGidVvj6aJ5fGBZ3S5YWD8 May 26 12:45:46.035593 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: X-Domain-Id: None May 26 12:45:46.035593 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: X-Domain-Name: None May 26 12:45:46.035593 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: X-Identity-Status: Confirmed May 26 12:45:46.035593 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: X-Is-Admin-Project: True May 26 12:45:46.035593 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: X-Project-Domain-Id: default May 26 12:45:46.035593 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: X-Project-Domain-Name: Default May 26 12:45:46.035593 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: X-Project-Id: 9e36ab03283d4ce6a2fed5e111e03d34 May 26 12:45:46.035593 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-547315860 May 26 12:45:46.035593 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: X-Role: member,reader May 26 12:45:46.035593 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: X-Roles: member,reader May 26 12:45:46.037222 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/9e36ab03283d4ce6a2fed5e111e03d34"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.75:8080", "publicURL": "http://10.222.0.75:8080/v1/AUTH_9e36ab03283d4ce6a2fed5e111e03d34"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2/9e36ab03283d4ce6a2fed5e111e03d34"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/9e36ab03283d4ce6a2fed5e111e03d34"}]}] May 26 12:45:46.037222 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: X-Tenant: tempest-ServerRescueNegativeTestJSON-547315860 May 26 12:45:46.037222 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: X-Tenant-Id: 9e36ab03283d4ce6a2fed5e111e03d34 May 26 12:45:46.037222 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-547315860 May 26 12:45:46.037222 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: X-User: tempest-ServerRescueNegativeTestJSON-547315860-project May 26 12:45:46.037222 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: X-User-Domain-Id: default May 26 12:45:46.037222 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: X-User-Domain-Name: Default May 26 12:45:46.037222 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: X-User-Id: 0431b1f25497443ba483b3c440669080 May 26 12:45:46.037222 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: X-User-Name: tempest-ServerRescueNegativeTestJSON-547315860-project May 26 12:45:46.037222 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: method: > May 26 12:45:46.037222 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: exception: Cannot 'detach_volume' instance e911acec-b583-42eb-b5de-dee9573bad6c while it is in vm_state rescued May 26 12:45:46.038008 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: action_args: {'server_id': 'e911acec-b583-42eb-b5de-dee9573bad6c', 'id': 'fa551505-a93f-430a-b293-ca5ec956d51f'} May 26 12:45:46.038008 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: {{(pid=129322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 12:45:46.038008 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 12:45:46.038008 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete May 26 12:45:46.038008 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) May 26 12:45:46.038008 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner May 26 12:45:46.038008 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 26 12:45:46.038008 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner May 26 12:45:46.038008 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( May 26 12:45:46.038008 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance e911acec-b583-42eb-b5de-dee9573bad6c in vm_state rescued. Cannot detach_volume while the instance is in this state. May 26 12:45:46.038008 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi May 26 12:45:46.038008 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 12:45:46.038008 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi May 26 12:45:46.038008 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 12:45:46.038008 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 12:45:46.038008 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 12:45:46.038008 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 12:45:46.038008 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 12:45:46.038008 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 12:45:46.038008 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 12:45:46.039475 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete May 26 12:45:46.039475 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, May 26 12:45:46.039475 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state May 26 12:45:46.039475 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) May 26 12:45:46.039475 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance e911acec-b583-42eb-b5de-dee9573bad6c while it is in vm_state rescued May 26 12:45:46.039475 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi May 26 12:45:46.039475 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 12:45:46.039475 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi May 26 12:45:46.039475 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 12:45:46.039475 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 12:45:46.039475 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 12:45:46.039475 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 12:45:46.039475 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 12:45:46.039475 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance e911acec-b583-42eb-b5de-dee9573bad6c while it is in vm_state rescued May 26 12:45:46.039475 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi May 26 12:45:46.039475 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi [None req-abe83417-e1c0-48e1-b36b-5c0c2fbca307 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Returning 409 to user: Cannot 'detach_volume' instance e911acec-b583-42eb-b5de-dee9573bad6c while it is in vm_state rescued {{(pid=129322) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 12:45:46.040692 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: INFO nova.api.openstack.requestlog [None req-abe83417-e1c0-48e1-b36b-5c0c2fbca307 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] 10.222.0.75 "DELETE /compute/v2.1/servers/e911acec-b583-42eb-b5de-dee9573bad6c/os-volume_attachments/fa551505-a93f-430a-b293-ca5ec956d51f" status: 409 len: 152 microversion: 2.1 time: 0.108841 May 26 12:45:46.040692 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: [pid: 129322|app: 0|req: 398/774] 10.222.0.75 () {58 vars in 1415 bytes} [Thu May 26 12:45:45 2022] DELETE /compute/v2.1/servers/e911acec-b583-42eb-b5de-dee9573bad6c/os-volume_attachments/fa551505-a93f-430a-b293-ca5ec956d51f => generated 152 bytes in 110 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) May 26 12:45:46.046855 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi [None req-92f82d8b-efd4-46b0-8477-be471c33f484 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=129321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 12:45:46.047397 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.compute.api [None req-92f82d8b-efd4-46b0-8477-be471c33f484 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] [instance: e911acec-b583-42eb-b5de-dee9573bad6c] Fetching instance by UUID {{(pid=129321) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:45:46.054830 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-92f82d8b-efd4-46b0-8477-be471c33f484 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:45:46.055279 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-92f82d8b-efd4-46b0-8477-be471c33f484 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:45:46.056101 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-92f82d8b-efd4-46b0-8477-be471c33f484 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:45:46.056540 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-92f82d8b-efd4-46b0-8477-be471c33f484 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:45:46.130990 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: INFO nova.api.openstack.requestlog [None req-92f82d8b-efd4-46b0-8477-be471c33f484 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] 10.222.0.75 "POST /compute/v2.1/servers/e911acec-b583-42eb-b5de-dee9573bad6c/action" status: 202 len: 0 microversion: 2.1 time: 0.087769 May 26 12:45:46.132137 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: [pid: 129321|app: 0|req: 377/775] 10.222.0.75 () {60 vars in 1277 bytes} [Thu May 26 12:45:46 2022] POST /compute/v2.1/servers/e911acec-b583-42eb-b5de-dee9573bad6c/action => generated 0 bytes in 90 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 26 12:45:46.141275 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi [None req-01f3c4e2-0bca-4f8b-88fc-fb13dc1634f5 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Calling method '>' {{(pid=129322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:45:46.142214 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.compute.api [None req-01f3c4e2-0bca-4f8b-88fc-fb13dc1634f5 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] [instance: e911acec-b583-42eb-b5de-dee9573bad6c] Fetching instance by UUID {{(pid=129322) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:45:46.150924 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-01f3c4e2-0bca-4f8b-88fc-fb13dc1634f5 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:45:46.151374 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-01f3c4e2-0bca-4f8b-88fc-fb13dc1634f5 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:45:46.152201 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-01f3c4e2-0bca-4f8b-88fc-fb13dc1634f5 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:45:46.152777 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-01f3c4e2-0bca-4f8b-88fc-fb13dc1634f5 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:45:46.330116 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi [None req-63b22ec9-3970-49b2-9a0d-c81116ffc14d tempest-TestMinimumBasicScenario-102576986 tempest-TestMinimumBasicScenario-102576986-project] Calling method '>' {{(pid=129321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:45:46.331439 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.compute.api [None req-63b22ec9-3970-49b2-9a0d-c81116ffc14d tempest-TestMinimumBasicScenario-102576986 tempest-TestMinimumBasicScenario-102576986-project] [instance: 76661008-e6d3-4646-a9ba-d5d0e83a4b65] Fetching instance by UUID {{(pid=129321) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:45:46.343298 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-63b22ec9-3970-49b2-9a0d-c81116ffc14d tempest-TestMinimumBasicScenario-102576986 tempest-TestMinimumBasicScenario-102576986-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:45:46.344122 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-63b22ec9-3970-49b2-9a0d-c81116ffc14d tempest-TestMinimumBasicScenario-102576986 tempest-TestMinimumBasicScenario-102576986-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:45:46.345584 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-63b22ec9-3970-49b2-9a0d-c81116ffc14d tempest-TestMinimumBasicScenario-102576986 tempest-TestMinimumBasicScenario-102576986-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:45:46.346314 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-63b22ec9-3970-49b2-9a0d-c81116ffc14d tempest-TestMinimumBasicScenario-102576986 tempest-TestMinimumBasicScenario-102576986-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:45:46.352849 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.policy [None req-01f3c4e2-0bca-4f8b-88fc-fb13dc1634f5 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0431b1f25497443ba483b3c440669080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e36ab03283d4ce6a2fed5e111e03d34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129322) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:45:46.369935 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: INFO nova.api.openstack.requestlog [None req-01f3c4e2-0bca-4f8b-88fc-fb13dc1634f5 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] 10.222.0.75 "GET /compute/v2.1/servers/e911acec-b583-42eb-b5de-dee9573bad6c" status: 200 len: 1724 microversion: 2.1 time: 0.233013 May 26 12:45:46.370647 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: [pid: 129322|app: 0|req: 399/776] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 26 12:45:46 2022] GET /compute/v2.1/servers/e911acec-b583-42eb-b5de-dee9573bad6c => generated 1724 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 12:45:46.459170 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi [None req-c9e6099c-360f-4d50-b807-0b934202db22 tempest-TestVolumeBootPattern-1304354335 tempest-TestVolumeBootPattern-1304354335-project] Calling method '>' {{(pid=129322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:45:46.460413 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.compute.api [None req-c9e6099c-360f-4d50-b807-0b934202db22 tempest-TestVolumeBootPattern-1304354335 tempest-TestVolumeBootPattern-1304354335-project] [instance: 475179d2-21d7-4ace-90eb-e6525cb14928] Fetching instance by UUID {{(pid=129322) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:45:46.463924 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG dbcounter [-] [129322] Writing DB stats nova_api:SELECT=35 {{(pid=129322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:45:46.473141 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-c9e6099c-360f-4d50-b807-0b934202db22 tempest-TestVolumeBootPattern-1304354335 tempest-TestVolumeBootPattern-1304354335-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:45:46.473594 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-c9e6099c-360f-4d50-b807-0b934202db22 tempest-TestVolumeBootPattern-1304354335 tempest-TestVolumeBootPattern-1304354335-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:45:46.474620 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-c9e6099c-360f-4d50-b807-0b934202db22 tempest-TestVolumeBootPattern-1304354335 tempest-TestVolumeBootPattern-1304354335-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:45:46.474879 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-c9e6099c-360f-4d50-b807-0b934202db22 tempest-TestVolumeBootPattern-1304354335 tempest-TestVolumeBootPattern-1304354335-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:45:46.552926 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.policy [None req-c9e6099c-360f-4d50-b807-0b934202db22 tempest-TestVolumeBootPattern-1304354335 tempest-TestVolumeBootPattern-1304354335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab469b18ce0444d9884cdddc34ef7247', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fb41c547884511893b768b833f4e90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129322) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:45:46.561441 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: INFO nova.api.openstack.requestlog [None req-c9e6099c-360f-4d50-b807-0b934202db22 tempest-TestVolumeBootPattern-1304354335 tempest-TestVolumeBootPattern-1304354335-project] 10.222.0.75 "GET /compute/v2.1/servers/475179d2-21d7-4ace-90eb-e6525cb14928" status: 200 len: 1136 microversion: 2.1 time: 0.109462 May 26 12:45:46.563724 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: [pid: 129322|app: 0|req: 400/777] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 26 12:45:46 2022] GET /compute/v2.1/servers/475179d2-21d7-4ace-90eb-e6525cb14928 => generated 1136 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:45:46.654104 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.policy [None req-63b22ec9-3970-49b2-9a0d-c81116ffc14d tempest-TestMinimumBasicScenario-102576986 tempest-TestMinimumBasicScenario-102576986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0352a80bdc174b9a9df4eca60b81eba4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fa2c4d6423444e487d259062656129b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129321) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:45:46.664298 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: INFO nova.api.openstack.requestlog [None req-63b22ec9-3970-49b2-9a0d-c81116ffc14d tempest-TestMinimumBasicScenario-102576986 tempest-TestMinimumBasicScenario-102576986-project] 10.222.0.75 "GET /compute/v2.1/servers/76661008-e6d3-4646-a9ba-d5d0e83a4b65" status: 200 len: 1755 microversion: 2.1 time: 0.341738 May 26 12:45:46.664691 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: [pid: 129321|app: 0|req: 378/778] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 26 12:45:46 2022] GET /compute/v2.1/servers/76661008-e6d3-4646-a9ba-d5d0e83a4b65 => generated 1755 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 12:45:47.393012 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi [None req-3b392252-767e-4aa8-b323-5db5130bc00c tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Calling method '>' {{(pid=129322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:45:47.394224 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.compute.api [None req-3b392252-767e-4aa8-b323-5db5130bc00c tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] [instance: e911acec-b583-42eb-b5de-dee9573bad6c] Fetching instance by UUID {{(pid=129322) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:45:47.405077 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-3b392252-767e-4aa8-b323-5db5130bc00c tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:45:47.405968 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-3b392252-767e-4aa8-b323-5db5130bc00c tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:45:47.406818 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-3b392252-767e-4aa8-b323-5db5130bc00c tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:45:47.407341 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-3b392252-767e-4aa8-b323-5db5130bc00c tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:45:47.569274 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.policy [None req-3b392252-767e-4aa8-b323-5db5130bc00c tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0431b1f25497443ba483b3c440669080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e36ab03283d4ce6a2fed5e111e03d34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129322) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:45:47.579918 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi [None req-4b47c03d-5555-405d-bddd-2c6309189620 tempest-TestVolumeBootPattern-1304354335 tempest-TestVolumeBootPattern-1304354335-project] Calling method '>' {{(pid=129321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:45:47.581352 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.compute.api [None req-4b47c03d-5555-405d-bddd-2c6309189620 tempest-TestVolumeBootPattern-1304354335 tempest-TestVolumeBootPattern-1304354335-project] [instance: 475179d2-21d7-4ace-90eb-e6525cb14928] Fetching instance by UUID {{(pid=129321) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:45:47.583027 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: INFO nova.api.openstack.requestlog [None req-3b392252-767e-4aa8-b323-5db5130bc00c tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] 10.222.0.75 "GET /compute/v2.1/servers/e911acec-b583-42eb-b5de-dee9573bad6c" status: 200 len: 1724 microversion: 2.1 time: 0.197097 May 26 12:45:47.593902 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: [pid: 129322|app: 0|req: 401/779] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 26 12:45:47 2022] GET /compute/v2.1/servers/e911acec-b583-42eb-b5de-dee9573bad6c => generated 1724 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:45:47.601761 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-4b47c03d-5555-405d-bddd-2c6309189620 tempest-TestVolumeBootPattern-1304354335 tempest-TestVolumeBootPattern-1304354335-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:45:47.602194 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-4b47c03d-5555-405d-bddd-2c6309189620 tempest-TestVolumeBootPattern-1304354335 tempest-TestVolumeBootPattern-1304354335-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:45:47.602981 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-4b47c03d-5555-405d-bddd-2c6309189620 tempest-TestVolumeBootPattern-1304354335 tempest-TestVolumeBootPattern-1304354335-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:45:47.603427 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-4b47c03d-5555-405d-bddd-2c6309189620 tempest-TestVolumeBootPattern-1304354335 tempest-TestVolumeBootPattern-1304354335-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:45:47.683289 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi [None req-86fe9623-1866-4401-bf89-2f605ca1c8fd tempest-TestMinimumBasicScenario-102576986 tempest-TestMinimumBasicScenario-102576986-project] Calling method '>' {{(pid=129322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:45:47.683928 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.compute.api [None req-86fe9623-1866-4401-bf89-2f605ca1c8fd tempest-TestMinimumBasicScenario-102576986 tempest-TestMinimumBasicScenario-102576986-project] [instance: 76661008-e6d3-4646-a9ba-d5d0e83a4b65] Fetching instance by UUID {{(pid=129322) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:45:47.690737 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-86fe9623-1866-4401-bf89-2f605ca1c8fd tempest-TestMinimumBasicScenario-102576986 tempest-TestMinimumBasicScenario-102576986-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:45:47.691194 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-86fe9623-1866-4401-bf89-2f605ca1c8fd tempest-TestMinimumBasicScenario-102576986 tempest-TestMinimumBasicScenario-102576986-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:45:47.692128 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-86fe9623-1866-4401-bf89-2f605ca1c8fd tempest-TestMinimumBasicScenario-102576986 tempest-TestMinimumBasicScenario-102576986-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:45:47.692569 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-86fe9623-1866-4401-bf89-2f605ca1c8fd tempest-TestMinimumBasicScenario-102576986 tempest-TestMinimumBasicScenario-102576986-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:45:47.700434 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.policy [None req-4b47c03d-5555-405d-bddd-2c6309189620 tempest-TestVolumeBootPattern-1304354335 tempest-TestVolumeBootPattern-1304354335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab469b18ce0444d9884cdddc34ef7247', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fb41c547884511893b768b833f4e90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129321) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:45:47.713550 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: INFO nova.api.openstack.requestlog [None req-4b47c03d-5555-405d-bddd-2c6309189620 tempest-TestVolumeBootPattern-1304354335 tempest-TestVolumeBootPattern-1304354335-project] 10.222.0.75 "GET /compute/v2.1/servers/475179d2-21d7-4ace-90eb-e6525cb14928" status: 200 len: 1210 microversion: 2.1 time: 0.137285 May 26 12:45:47.714451 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: [pid: 129321|app: 0|req: 379/780] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 26 12:45:47 2022] GET /compute/v2.1/servers/475179d2-21d7-4ace-90eb-e6525cb14928 => generated 1210 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 12:45:47.888572 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.policy [None req-86fe9623-1866-4401-bf89-2f605ca1c8fd tempest-TestMinimumBasicScenario-102576986 tempest-TestMinimumBasicScenario-102576986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0352a80bdc174b9a9df4eca60b81eba4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fa2c4d6423444e487d259062656129b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129322) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:45:47.903897 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: INFO nova.api.openstack.requestlog [None req-86fe9623-1866-4401-bf89-2f605ca1c8fd tempest-TestMinimumBasicScenario-102576986 tempest-TestMinimumBasicScenario-102576986-project] 10.222.0.75 "GET /compute/v2.1/servers/76661008-e6d3-4646-a9ba-d5d0e83a4b65" status: 200 len: 1755 microversion: 2.1 time: 0.224440 May 26 12:45:47.905079 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: [pid: 129322|app: 0|req: 402/781] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 26 12:45:47 2022] GET /compute/v2.1/servers/76661008-e6d3-4646-a9ba-d5d0e83a4b65 => generated 1755 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:45:48.604527 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi [None req-852ae445-7eb5-40fd-b229-4992dd2e8cc6 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Calling method '>' {{(pid=129321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:45:48.605137 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.compute.api [None req-852ae445-7eb5-40fd-b229-4992dd2e8cc6 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] [instance: e911acec-b583-42eb-b5de-dee9573bad6c] Fetching instance by UUID {{(pid=129321) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:45:48.612988 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-852ae445-7eb5-40fd-b229-4992dd2e8cc6 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:45:48.613450 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-852ae445-7eb5-40fd-b229-4992dd2e8cc6 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:45:48.614251 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-852ae445-7eb5-40fd-b229-4992dd2e8cc6 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:45:48.614699 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-852ae445-7eb5-40fd-b229-4992dd2e8cc6 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:45:48.732171 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi [None req-00e415c4-7576-43e4-a764-f930e1bb0524 tempest-TestVolumeBootPattern-1304354335 tempest-TestVolumeBootPattern-1304354335-project] Calling method '>' {{(pid=129322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:45:48.732765 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.compute.api [None req-00e415c4-7576-43e4-a764-f930e1bb0524 tempest-TestVolumeBootPattern-1304354335 tempest-TestVolumeBootPattern-1304354335-project] [instance: 475179d2-21d7-4ace-90eb-e6525cb14928] Fetching instance by UUID {{(pid=129322) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:45:48.740859 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-00e415c4-7576-43e4-a764-f930e1bb0524 tempest-TestVolumeBootPattern-1304354335 tempest-TestVolumeBootPattern-1304354335-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:45:48.741313 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-00e415c4-7576-43e4-a764-f930e1bb0524 tempest-TestVolumeBootPattern-1304354335 tempest-TestVolumeBootPattern-1304354335-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:45:48.742107 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-00e415c4-7576-43e4-a764-f930e1bb0524 tempest-TestVolumeBootPattern-1304354335 tempest-TestVolumeBootPattern-1304354335-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:45:48.742539 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-00e415c4-7576-43e4-a764-f930e1bb0524 tempest-TestVolumeBootPattern-1304354335 tempest-TestVolumeBootPattern-1304354335-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:45:48.757224 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.policy [None req-852ae445-7eb5-40fd-b229-4992dd2e8cc6 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0431b1f25497443ba483b3c440669080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e36ab03283d4ce6a2fed5e111e03d34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129321) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:45:48.765638 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: INFO nova.api.openstack.requestlog [None req-852ae445-7eb5-40fd-b229-4992dd2e8cc6 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] 10.222.0.75 "GET /compute/v2.1/servers/e911acec-b583-42eb-b5de-dee9573bad6c" status: 200 len: 1724 microversion: 2.1 time: 0.165219 May 26 12:45:48.766220 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: [pid: 129321|app: 0|req: 380/782] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 26 12:45:48 2022] GET /compute/v2.1/servers/e911acec-b583-42eb-b5de-dee9573bad6c => generated 1724 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:45:48.892825 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.policy [None req-00e415c4-7576-43e4-a764-f930e1bb0524 tempest-TestVolumeBootPattern-1304354335 tempest-TestVolumeBootPattern-1304354335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab469b18ce0444d9884cdddc34ef7247', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fb41c547884511893b768b833f4e90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129322) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:45:48.902771 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: INFO nova.api.openstack.requestlog [None req-00e415c4-7576-43e4-a764-f930e1bb0524 tempest-TestVolumeBootPattern-1304354335 tempest-TestVolumeBootPattern-1304354335-project] 10.222.0.75 "GET /compute/v2.1/servers/475179d2-21d7-4ace-90eb-e6525cb14928" status: 200 len: 1278 microversion: 2.1 time: 0.174567 May 26 12:45:48.903369 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: [pid: 129322|app: 0|req: 403/783] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 26 12:45:48 2022] GET /compute/v2.1/servers/475179d2-21d7-4ace-90eb-e6525cb14928 => generated 1278 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:45:48.923339 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi [None req-f8307c8a-ece1-4f4f-b612-a6b7e6b58ad7 tempest-TestMinimumBasicScenario-102576986 tempest-TestMinimumBasicScenario-102576986-project] Calling method '>' {{(pid=129321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:45:48.924093 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.compute.api [None req-f8307c8a-ece1-4f4f-b612-a6b7e6b58ad7 tempest-TestMinimumBasicScenario-102576986 tempest-TestMinimumBasicScenario-102576986-project] [instance: 76661008-e6d3-4646-a9ba-d5d0e83a4b65] Fetching instance by UUID {{(pid=129321) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:45:48.931156 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-f8307c8a-ece1-4f4f-b612-a6b7e6b58ad7 tempest-TestMinimumBasicScenario-102576986 tempest-TestMinimumBasicScenario-102576986-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:45:48.931641 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-f8307c8a-ece1-4f4f-b612-a6b7e6b58ad7 tempest-TestMinimumBasicScenario-102576986 tempest-TestMinimumBasicScenario-102576986-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:45:48.932429 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-f8307c8a-ece1-4f4f-b612-a6b7e6b58ad7 tempest-TestMinimumBasicScenario-102576986 tempest-TestMinimumBasicScenario-102576986-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:45:48.932872 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-f8307c8a-ece1-4f4f-b612-a6b7e6b58ad7 tempest-TestMinimumBasicScenario-102576986 tempest-TestMinimumBasicScenario-102576986-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:45:48.937359 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG dbcounter [-] [129321] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=129321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:45:49.094187 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.policy [None req-f8307c8a-ece1-4f4f-b612-a6b7e6b58ad7 tempest-TestMinimumBasicScenario-102576986 tempest-TestMinimumBasicScenario-102576986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0352a80bdc174b9a9df4eca60b81eba4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fa2c4d6423444e487d259062656129b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129321) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:45:49.103845 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: INFO nova.api.openstack.requestlog [None req-f8307c8a-ece1-4f4f-b612-a6b7e6b58ad7 tempest-TestMinimumBasicScenario-102576986 tempest-TestMinimumBasicScenario-102576986-project] 10.222.0.75 "GET /compute/v2.1/servers/76661008-e6d3-4646-a9ba-d5d0e83a4b65" status: 200 len: 1755 microversion: 2.1 time: 0.184274 May 26 12:45:49.104448 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: [pid: 129321|app: 0|req: 381/784] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 26 12:45:48 2022] GET /compute/v2.1/servers/76661008-e6d3-4646-a9ba-d5d0e83a4b65 => generated 1755 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:45:49.788628 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi [None req-55f7d700-4234-4fb9-9fb3-d4e0ff3a7334 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Calling method '>' {{(pid=129322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:45:49.789267 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.compute.api [None req-55f7d700-4234-4fb9-9fb3-d4e0ff3a7334 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] [instance: e911acec-b583-42eb-b5de-dee9573bad6c] Fetching instance by UUID {{(pid=129322) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:45:49.796646 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-55f7d700-4234-4fb9-9fb3-d4e0ff3a7334 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:45:49.797132 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-55f7d700-4234-4fb9-9fb3-d4e0ff3a7334 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:45:49.797980 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-55f7d700-4234-4fb9-9fb3-d4e0ff3a7334 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:45:49.798420 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-55f7d700-4234-4fb9-9fb3-d4e0ff3a7334 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:45:49.923286 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi [None req-783b93b9-a95b-4aaa-b1fe-e47ec640c20a tempest-TestVolumeBootPattern-1304354335 tempest-TestVolumeBootPattern-1304354335-project] Calling method '>' {{(pid=129321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:45:49.924832 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.compute.api [None req-783b93b9-a95b-4aaa-b1fe-e47ec640c20a tempest-TestVolumeBootPattern-1304354335 tempest-TestVolumeBootPattern-1304354335-project] [instance: 475179d2-21d7-4ace-90eb-e6525cb14928] Fetching instance by UUID {{(pid=129321) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:45:49.929009 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG dbcounter [-] [129321] Writing DB stats nova_api:SELECT=57,nova_api:INSERT=4 {{(pid=129321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:45:49.934014 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-783b93b9-a95b-4aaa-b1fe-e47ec640c20a tempest-TestVolumeBootPattern-1304354335 tempest-TestVolumeBootPattern-1304354335-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:45:49.934898 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-783b93b9-a95b-4aaa-b1fe-e47ec640c20a tempest-TestVolumeBootPattern-1304354335 tempest-TestVolumeBootPattern-1304354335-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:45:49.935885 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-783b93b9-a95b-4aaa-b1fe-e47ec640c20a tempest-TestVolumeBootPattern-1304354335 tempest-TestVolumeBootPattern-1304354335-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:45:49.948513 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-783b93b9-a95b-4aaa-b1fe-e47ec640c20a tempest-TestVolumeBootPattern-1304354335 tempest-TestVolumeBootPattern-1304354335-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:45:49.970776 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.policy [None req-55f7d700-4234-4fb9-9fb3-d4e0ff3a7334 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0431b1f25497443ba483b3c440669080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e36ab03283d4ce6a2fed5e111e03d34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129322) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:45:49.979845 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: INFO nova.api.openstack.requestlog [None req-55f7d700-4234-4fb9-9fb3-d4e0ff3a7334 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] 10.222.0.75 "GET /compute/v2.1/servers/e911acec-b583-42eb-b5de-dee9573bad6c" status: 200 len: 1724 microversion: 2.1 time: 0.199680 May 26 12:45:49.980757 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: [pid: 129322|app: 0|req: 404/785] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 26 12:45:49 2022] GET /compute/v2.1/servers/e911acec-b583-42eb-b5de-dee9573bad6c => generated 1724 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:45:50.122100 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi [None req-3c1af752-c779-4fb9-9da2-7a8b3977885c tempest-TestMinimumBasicScenario-102576986 tempest-TestMinimumBasicScenario-102576986-project] Calling method '>' {{(pid=129322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:45:50.122798 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.compute.api [None req-3c1af752-c779-4fb9-9da2-7a8b3977885c tempest-TestMinimumBasicScenario-102576986 tempest-TestMinimumBasicScenario-102576986-project] [instance: 76661008-e6d3-4646-a9ba-d5d0e83a4b65] Fetching instance by UUID {{(pid=129322) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:45:50.135227 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-3c1af752-c779-4fb9-9da2-7a8b3977885c tempest-TestMinimumBasicScenario-102576986 tempest-TestMinimumBasicScenario-102576986-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:45:50.136027 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-3c1af752-c779-4fb9-9da2-7a8b3977885c tempest-TestMinimumBasicScenario-102576986 tempest-TestMinimumBasicScenario-102576986-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:45:50.136815 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-3c1af752-c779-4fb9-9da2-7a8b3977885c tempest-TestMinimumBasicScenario-102576986 tempest-TestMinimumBasicScenario-102576986-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:45:50.137252 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-3c1af752-c779-4fb9-9da2-7a8b3977885c tempest-TestMinimumBasicScenario-102576986 tempest-TestMinimumBasicScenario-102576986-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:45:50.234069 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.policy [None req-783b93b9-a95b-4aaa-b1fe-e47ec640c20a tempest-TestVolumeBootPattern-1304354335 tempest-TestVolumeBootPattern-1304354335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab469b18ce0444d9884cdddc34ef7247', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fb41c547884511893b768b833f4e90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129321) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:45:50.242339 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: INFO nova.api.openstack.requestlog [None req-783b93b9-a95b-4aaa-b1fe-e47ec640c20a tempest-TestVolumeBootPattern-1304354335 tempest-TestVolumeBootPattern-1304354335-project] 10.222.0.75 "GET /compute/v2.1/servers/475179d2-21d7-4ace-90eb-e6525cb14928" status: 200 len: 1278 microversion: 2.1 time: 0.324117 May 26 12:45:50.243090 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: [pid: 129321|app: 0|req: 382/786] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 26 12:45:49 2022] GET /compute/v2.1/servers/475179d2-21d7-4ace-90eb-e6525cb14928 => generated 1278 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:45:50.292868 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.policy [None req-3c1af752-c779-4fb9-9da2-7a8b3977885c tempest-TestMinimumBasicScenario-102576986 tempest-TestMinimumBasicScenario-102576986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0352a80bdc174b9a9df4eca60b81eba4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fa2c4d6423444e487d259062656129b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129322) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:45:50.301567 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: INFO nova.api.openstack.requestlog [None req-3c1af752-c779-4fb9-9da2-7a8b3977885c tempest-TestMinimumBasicScenario-102576986 tempest-TestMinimumBasicScenario-102576986-project] 10.222.0.75 "GET /compute/v2.1/servers/76661008-e6d3-4646-a9ba-d5d0e83a4b65" status: 200 len: 1755 microversion: 2.1 time: 0.183456 May 26 12:45:50.302155 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: [pid: 129322|app: 0|req: 405/787] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 26 12:45:50 2022] GET /compute/v2.1/servers/76661008-e6d3-4646-a9ba-d5d0e83a4b65 => generated 1755 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 12:45:50.642530 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi [req-f2b115d6-0a53-44fc-a1ad-3a774306ea59 req-8eb11011-236d-4044-8628-50fb9c4a07ce service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "475179d2-21d7-4ace-90eb-e6525cb14928", "tag": "ee0c6b40-1d57-4fbb-97a8-db624e2f3d50"}]} {{(pid=129321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 12:45:50.673865 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [req-f2b115d6-0a53-44fc-a1ad-3a774306ea59 req-8eb11011-236d-4044-8628-50fb9c4a07ce service nova] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:45:50.675837 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [req-f2b115d6-0a53-44fc-a1ad-3a774306ea59 req-8eb11011-236d-4044-8628-50fb9c4a07ce service nova] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:45:50.699121 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: INFO nova.api.openstack.compute.server_external_events [req-f2b115d6-0a53-44fc-a1ad-3a774306ea59 req-8eb11011-236d-4044-8628-50fb9c4a07ce service nova] Creating event network-changed:ee0c6b40-1d57-4fbb-97a8-db624e2f3d50 for instance 475179d2-21d7-4ace-90eb-e6525cb14928 on hv-cinder-81966 May 26 12:45:50.708800 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: INFO nova.api.openstack.requestlog [req-f2b115d6-0a53-44fc-a1ad-3a774306ea59 req-8eb11011-236d-4044-8628-50fb9c4a07ce service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.076202 May 26 12:45:50.710065 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: [pid: 129321|app: 0|req: 383/788] 10.222.0.75 () {64 vars in 1317 bytes} [Thu May 26 12:45:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 12:45:51.001124 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi [None req-9a0356bf-9498-485f-8427-0c578b31149f tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Calling method '>' {{(pid=129322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:45:51.002229 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.compute.api [None req-9a0356bf-9498-485f-8427-0c578b31149f tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] [instance: e911acec-b583-42eb-b5de-dee9573bad6c] Fetching instance by UUID {{(pid=129322) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:45:51.012685 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-9a0356bf-9498-485f-8427-0c578b31149f tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:45:51.013138 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-9a0356bf-9498-485f-8427-0c578b31149f tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:45:51.013924 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-9a0356bf-9498-485f-8427-0c578b31149f tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:45:51.014356 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-9a0356bf-9498-485f-8427-0c578b31149f tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:45:51.172119 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.policy [None req-9a0356bf-9498-485f-8427-0c578b31149f tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0431b1f25497443ba483b3c440669080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e36ab03283d4ce6a2fed5e111e03d34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129322) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:45:51.181465 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: INFO nova.api.openstack.requestlog [None req-9a0356bf-9498-485f-8427-0c578b31149f tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] 10.222.0.75 "GET /compute/v2.1/servers/e911acec-b583-42eb-b5de-dee9573bad6c" status: 200 len: 1730 microversion: 2.1 time: 0.187202 May 26 12:45:51.182082 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: [pid: 129322|app: 0|req: 406/789] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 26 12:45:50 2022] GET /compute/v2.1/servers/e911acec-b583-42eb-b5de-dee9573bad6c => generated 1730 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:45:51.199696 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi [None req-6fe11df8-d382-48c7-b359-1c6a3fc2362b tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Calling method '>' {{(pid=129321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:45:51.200270 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.compute.api [None req-6fe11df8-d382-48c7-b359-1c6a3fc2362b tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] [instance: e911acec-b583-42eb-b5de-dee9573bad6c] Fetching instance by UUID {{(pid=129321) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:45:51.207148 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-6fe11df8-d382-48c7-b359-1c6a3fc2362b tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:45:51.207606 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-6fe11df8-d382-48c7-b359-1c6a3fc2362b tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:45:51.208398 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-6fe11df8-d382-48c7-b359-1c6a3fc2362b tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:45:51.208824 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-6fe11df8-d382-48c7-b359-1c6a3fc2362b tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:45:51.265290 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi [None req-b48987b9-aa10-4f74-9503-01f135d9e951 tempest-TestVolumeBootPattern-1304354335 tempest-TestVolumeBootPattern-1304354335-project] Calling method '>' {{(pid=129322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:45:51.266054 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.compute.api [None req-b48987b9-aa10-4f74-9503-01f135d9e951 tempest-TestVolumeBootPattern-1304354335 tempest-TestVolumeBootPattern-1304354335-project] [instance: 475179d2-21d7-4ace-90eb-e6525cb14928] Fetching instance by UUID {{(pid=129322) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:45:51.273357 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-b48987b9-aa10-4f74-9503-01f135d9e951 tempest-TestVolumeBootPattern-1304354335 tempest-TestVolumeBootPattern-1304354335-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:45:51.273882 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-b48987b9-aa10-4f74-9503-01f135d9e951 tempest-TestVolumeBootPattern-1304354335 tempest-TestVolumeBootPattern-1304354335-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:45:51.274613 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-b48987b9-aa10-4f74-9503-01f135d9e951 tempest-TestVolumeBootPattern-1304354335 tempest-TestVolumeBootPattern-1304354335-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:45:51.275036 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-b48987b9-aa10-4f74-9503-01f135d9e951 tempest-TestVolumeBootPattern-1304354335 tempest-TestVolumeBootPattern-1304354335-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:45:51.334261 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: INFO nova.api.openstack.requestlog [None req-6fe11df8-d382-48c7-b359-1c6a3fc2362b tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] 10.222.0.75 "GET /compute/v2.1/servers/e911acec-b583-42eb-b5de-dee9573bad6c/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.139414 May 26 12:45:51.335830 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: [pid: 129321|app: 0|req: 384/790] 10.222.0.75 () {58 vars in 1274 bytes} [Thu May 26 12:45:51 2022] GET /compute/v2.1/servers/e911acec-b583-42eb-b5de-dee9573bad6c/os-interface => generated 284 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 12:45:51.343563 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi [None req-086af973-c340-4676-915f-8ebe0ace2d31 tempest-TestMinimumBasicScenario-102576986 tempest-TestMinimumBasicScenario-102576986-project] Calling method '>' {{(pid=129321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:45:51.344598 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.compute.api [None req-086af973-c340-4676-915f-8ebe0ace2d31 tempest-TestMinimumBasicScenario-102576986 tempest-TestMinimumBasicScenario-102576986-project] [instance: 76661008-e6d3-4646-a9ba-d5d0e83a4b65] Fetching instance by UUID {{(pid=129321) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:45:51.354831 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-086af973-c340-4676-915f-8ebe0ace2d31 tempest-TestMinimumBasicScenario-102576986 tempest-TestMinimumBasicScenario-102576986-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:45:51.355384 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-086af973-c340-4676-915f-8ebe0ace2d31 tempest-TestMinimumBasicScenario-102576986 tempest-TestMinimumBasicScenario-102576986-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:45:51.356412 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-086af973-c340-4676-915f-8ebe0ace2d31 tempest-TestMinimumBasicScenario-102576986 tempest-TestMinimumBasicScenario-102576986-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:45:51.356844 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-086af973-c340-4676-915f-8ebe0ace2d31 tempest-TestMinimumBasicScenario-102576986 tempest-TestMinimumBasicScenario-102576986-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:45:51.521163 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.policy [None req-b48987b9-aa10-4f74-9503-01f135d9e951 tempest-TestVolumeBootPattern-1304354335 tempest-TestVolumeBootPattern-1304354335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab469b18ce0444d9884cdddc34ef7247', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fb41c547884511893b768b833f4e90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129322) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:45:51.535611 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: INFO nova.api.openstack.requestlog [None req-b48987b9-aa10-4f74-9503-01f135d9e951 tempest-TestVolumeBootPattern-1304354335 tempest-TestVolumeBootPattern-1304354335-project] 10.222.0.75 "GET /compute/v2.1/servers/475179d2-21d7-4ace-90eb-e6525cb14928" status: 200 len: 1266 microversion: 2.1 time: 0.274276 May 26 12:45:51.537246 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: [pid: 129322|app: 0|req: 407/791] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 26 12:45:51 2022] GET /compute/v2.1/servers/475179d2-21d7-4ace-90eb-e6525cb14928 => generated 1266 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 12:45:51.558385 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.policy [None req-086af973-c340-4676-915f-8ebe0ace2d31 tempest-TestMinimumBasicScenario-102576986 tempest-TestMinimumBasicScenario-102576986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0352a80bdc174b9a9df4eca60b81eba4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fa2c4d6423444e487d259062656129b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129321) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:45:51.567249 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: INFO nova.api.openstack.requestlog [None req-086af973-c340-4676-915f-8ebe0ace2d31 tempest-TestMinimumBasicScenario-102576986 tempest-TestMinimumBasicScenario-102576986-project] 10.222.0.75 "GET /compute/v2.1/servers/76661008-e6d3-4646-a9ba-d5d0e83a4b65" status: 200 len: 1755 microversion: 2.1 time: 0.230154 May 26 12:45:51.567872 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: [pid: 129321|app: 0|req: 385/792] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 26 12:45:51 2022] GET /compute/v2.1/servers/76661008-e6d3-4646-a9ba-d5d0e83a4b65 => generated 1755 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:45:52.556565 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi [None req-1108e0b6-3910-42d1-8a8b-2577eea35019 tempest-TestVolumeBootPattern-1304354335 tempest-TestVolumeBootPattern-1304354335-project] Calling method '>' {{(pid=129322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:45:52.558141 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.compute.api [None req-1108e0b6-3910-42d1-8a8b-2577eea35019 tempest-TestVolumeBootPattern-1304354335 tempest-TestVolumeBootPattern-1304354335-project] [instance: 475179d2-21d7-4ace-90eb-e6525cb14928] Fetching instance by UUID {{(pid=129322) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:45:52.567661 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-1108e0b6-3910-42d1-8a8b-2577eea35019 tempest-TestVolumeBootPattern-1304354335 tempest-TestVolumeBootPattern-1304354335-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:45:52.568650 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-1108e0b6-3910-42d1-8a8b-2577eea35019 tempest-TestVolumeBootPattern-1304354335 tempest-TestVolumeBootPattern-1304354335-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:45:52.570246 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-1108e0b6-3910-42d1-8a8b-2577eea35019 tempest-TestVolumeBootPattern-1304354335 tempest-TestVolumeBootPattern-1304354335-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:45:52.571378 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-1108e0b6-3910-42d1-8a8b-2577eea35019 tempest-TestVolumeBootPattern-1304354335 tempest-TestVolumeBootPattern-1304354335-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:45:52.688351 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi [req-0d185d9a-3caa-4220-98ed-8861b622771f req-ec9507ef-26bd-411c-b3b1-b99994d75b30 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e911acec-b583-42eb-b5de-dee9573bad6c", "tag": "fc5a0b73-9cdf-4e1b-8b93-f12bfc2ac6a4"}]} {{(pid=129321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 12:45:52.696987 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [req-0d185d9a-3caa-4220-98ed-8861b622771f req-ec9507ef-26bd-411c-b3b1-b99994d75b30 service nova] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:45:52.697432 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [req-0d185d9a-3caa-4220-98ed-8861b622771f req-ec9507ef-26bd-411c-b3b1-b99994d75b30 service nova] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:45:52.710532 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: INFO nova.api.openstack.compute.server_external_events [req-0d185d9a-3caa-4220-98ed-8861b622771f req-ec9507ef-26bd-411c-b3b1-b99994d75b30 service nova] Creating event network-changed:fc5a0b73-9cdf-4e1b-8b93-f12bfc2ac6a4 for instance e911acec-b583-42eb-b5de-dee9573bad6c on hv-cinder-81966 May 26 12:45:52.716205 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: INFO nova.api.openstack.requestlog [req-0d185d9a-3caa-4220-98ed-8861b622771f req-ec9507ef-26bd-411c-b3b1-b99994d75b30 service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.142608 May 26 12:45:52.717063 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: [pid: 129321|app: 0|req: 386/793] 10.222.0.75 () {64 vars in 1317 bytes} [Thu May 26 12:45:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 12:45:52.722470 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi [None req-dc64c85e-a7d3-4942-83e1-9b4efe126886 tempest-TestMinimumBasicScenario-102576986 tempest-TestMinimumBasicScenario-102576986-project] Calling method '>' {{(pid=129321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:45:52.723149 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.compute.api [None req-dc64c85e-a7d3-4942-83e1-9b4efe126886 tempest-TestMinimumBasicScenario-102576986 tempest-TestMinimumBasicScenario-102576986-project] [instance: 76661008-e6d3-4646-a9ba-d5d0e83a4b65] Fetching instance by UUID {{(pid=129321) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:45:52.729879 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-dc64c85e-a7d3-4942-83e1-9b4efe126886 tempest-TestMinimumBasicScenario-102576986 tempest-TestMinimumBasicScenario-102576986-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:45:52.730326 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-dc64c85e-a7d3-4942-83e1-9b4efe126886 tempest-TestMinimumBasicScenario-102576986 tempest-TestMinimumBasicScenario-102576986-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:45:52.731192 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-dc64c85e-a7d3-4942-83e1-9b4efe126886 tempest-TestMinimumBasicScenario-102576986 tempest-TestMinimumBasicScenario-102576986-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:45:52.731763 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-dc64c85e-a7d3-4942-83e1-9b4efe126886 tempest-TestMinimumBasicScenario-102576986 tempest-TestMinimumBasicScenario-102576986-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:45:52.767107 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.policy [None req-1108e0b6-3910-42d1-8a8b-2577eea35019 tempest-TestVolumeBootPattern-1304354335 tempest-TestVolumeBootPattern-1304354335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab469b18ce0444d9884cdddc34ef7247', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fb41c547884511893b768b833f4e90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129322) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:45:52.778366 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: INFO nova.api.openstack.requestlog [None req-1108e0b6-3910-42d1-8a8b-2577eea35019 tempest-TestVolumeBootPattern-1304354335 tempest-TestVolumeBootPattern-1304354335-project] 10.222.0.75 "GET /compute/v2.1/servers/475179d2-21d7-4ace-90eb-e6525cb14928" status: 200 len: 1266 microversion: 2.1 time: 0.225387 May 26 12:45:52.779022 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: [pid: 129322|app: 0|req: 408/794] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 26 12:45:52 2022] GET /compute/v2.1/servers/475179d2-21d7-4ace-90eb-e6525cb14928 => generated 1266 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:45:52.892531 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.policy [None req-dc64c85e-a7d3-4942-83e1-9b4efe126886 tempest-TestMinimumBasicScenario-102576986 tempest-TestMinimumBasicScenario-102576986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0352a80bdc174b9a9df4eca60b81eba4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fa2c4d6423444e487d259062656129b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129321) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:45:52.902858 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: INFO nova.api.openstack.requestlog [None req-dc64c85e-a7d3-4942-83e1-9b4efe126886 tempest-TestMinimumBasicScenario-102576986 tempest-TestMinimumBasicScenario-102576986-project] 10.222.0.75 "GET /compute/v2.1/servers/76661008-e6d3-4646-a9ba-d5d0e83a4b65" status: 200 len: 1755 microversion: 2.1 time: 0.184228 May 26 12:45:52.903929 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: [pid: 129321|app: 0|req: 387/795] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 26 12:45:52 2022] GET /compute/v2.1/servers/76661008-e6d3-4646-a9ba-d5d0e83a4b65 => generated 1755 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:45:52.961568 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi [None req-2cd925ba-ec90-456d-b5e4-7702f0b22bd0 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Calling method '>' {{(pid=129322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:45:52.962102 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.compute.api [None req-2cd925ba-ec90-456d-b5e4-7702f0b22bd0 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] [instance: bf2f6303-22b9-4cfa-8d4d-61d2503bc554] Fetching instance by UUID {{(pid=129322) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:45:52.969016 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-2cd925ba-ec90-456d-b5e4-7702f0b22bd0 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:45:52.969761 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-2cd925ba-ec90-456d-b5e4-7702f0b22bd0 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:45:52.970541 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-2cd925ba-ec90-456d-b5e4-7702f0b22bd0 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:45:52.971246 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-2cd925ba-ec90-456d-b5e4-7702f0b22bd0 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:45:53.007847 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: INFO nova.api.openstack.requestlog [None req-2cd925ba-ec90-456d-b5e4-7702f0b22bd0 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] 10.222.0.75 "GET /compute/v2.1/servers/bf2f6303-22b9-4cfa-8d4d-61d2503bc554/os-volume_attachments/f7a8830d-4a07-494b-b732-c6b0d0879d8e" status: 200 len: 194 microversion: 2.20 time: 0.050392 May 26 12:45:53.013786 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: [pid: 129322|app: 0|req: 409/796] 10.222.0.75 () {60 vars in 1453 bytes} [Thu May 26 12:45:52 2022] GET /compute/v2.1/servers/bf2f6303-22b9-4cfa-8d4d-61d2503bc554/os-volume_attachments/f7a8830d-4a07-494b-b732-c6b0d0879d8e => generated 194 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 26 12:45:53.088361 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi [None req-e0cded4a-a2e1-44b3-9d20-3db2543a8b25 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Calling method '>' {{(pid=129321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:45:53.088851 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.compute.api [None req-e0cded4a-a2e1-44b3-9d20-3db2543a8b25 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] [instance: bf2f6303-22b9-4cfa-8d4d-61d2503bc554] Fetching instance by UUID {{(pid=129321) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:45:53.095305 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-e0cded4a-a2e1-44b3-9d20-3db2543a8b25 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:45:53.095992 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-e0cded4a-a2e1-44b3-9d20-3db2543a8b25 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:45:53.097052 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-e0cded4a-a2e1-44b3-9d20-3db2543a8b25 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:45:53.097560 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-e0cded4a-a2e1-44b3-9d20-3db2543a8b25 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:45:53.210063 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.objects.instance [None req-e0cded4a-a2e1-44b3-9d20-3db2543a8b25 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lazy-loading 'services' on Instance uuid bf2f6303-22b9-4cfa-8d4d-61d2503bc554 {{(pid=129321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 26 12:45:53.300719 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: INFO nova.api.openstack.requestlog [None req-e0cded4a-a2e1-44b3-9d20-3db2543a8b25 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] 10.222.0.75 "DELETE /compute/v2.1/servers/bf2f6303-22b9-4cfa-8d4d-61d2503bc554/os-volume_attachments/f7a8830d-4a07-494b-b732-c6b0d0879d8e" status: 202 len: 0 microversion: 2.20 time: 0.215212 May 26 12:45:53.301591 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: [pid: 129321|app: 0|req: 388/797] 10.222.0.75 () {60 vars in 1456 bytes} [Thu May 26 12:45:53 2022] DELETE /compute/v2.1/servers/bf2f6303-22b9-4cfa-8d4d-61d2503bc554/os-volume_attachments/f7a8830d-4a07-494b-b732-c6b0d0879d8e => generated 0 bytes in 218 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) May 26 12:45:53.311160 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi [None req-9f52b9a2-55be-42b4-91a3-af81a473498d tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Calling method '>' {{(pid=129322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:45:53.312627 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.compute.api [None req-9f52b9a2-55be-42b4-91a3-af81a473498d tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] [instance: bf2f6303-22b9-4cfa-8d4d-61d2503bc554] Fetching instance by UUID {{(pid=129322) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:45:53.320890 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-9f52b9a2-55be-42b4-91a3-af81a473498d tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:45:53.321685 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-9f52b9a2-55be-42b4-91a3-af81a473498d tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:45:53.322678 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-9f52b9a2-55be-42b4-91a3-af81a473498d tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:45:53.323112 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-9f52b9a2-55be-42b4-91a3-af81a473498d tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:45:53.364781 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: INFO nova.api.openstack.requestlog [None req-9f52b9a2-55be-42b4-91a3-af81a473498d tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] 10.222.0.75 "GET /compute/v2.1/servers/bf2f6303-22b9-4cfa-8d4d-61d2503bc554/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.058490 May 26 12:45:53.369086 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: [pid: 129322|app: 0|req: 410/798] 10.222.0.75 () {60 vars in 1342 bytes} [Thu May 26 12:45:53 2022] GET /compute/v2.1/servers/bf2f6303-22b9-4cfa-8d4d-61d2503bc554/os-volume_attachments => generated 197 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 26 12:45:53.797638 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi [None req-75ad425c-e814-445f-9465-a716517e96dc tempest-TestVolumeBootPattern-1304354335 tempest-TestVolumeBootPattern-1304354335-project] Calling method '>' {{(pid=129321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:45:53.798338 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.compute.api [None req-75ad425c-e814-445f-9465-a716517e96dc tempest-TestVolumeBootPattern-1304354335 tempest-TestVolumeBootPattern-1304354335-project] [instance: 475179d2-21d7-4ace-90eb-e6525cb14928] Fetching instance by UUID {{(pid=129321) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:45:53.805541 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-75ad425c-e814-445f-9465-a716517e96dc tempest-TestVolumeBootPattern-1304354335 tempest-TestVolumeBootPattern-1304354335-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:45:53.805994 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-75ad425c-e814-445f-9465-a716517e96dc tempest-TestVolumeBootPattern-1304354335 tempest-TestVolumeBootPattern-1304354335-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:45:53.806742 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-75ad425c-e814-445f-9465-a716517e96dc tempest-TestVolumeBootPattern-1304354335 tempest-TestVolumeBootPattern-1304354335-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:45:53.807190 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-75ad425c-e814-445f-9465-a716517e96dc tempest-TestVolumeBootPattern-1304354335 tempest-TestVolumeBootPattern-1304354335-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:45:53.921537 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi [None req-71994af1-6f0b-4699-a28d-aa158dce239f tempest-TestMinimumBasicScenario-102576986 tempest-TestMinimumBasicScenario-102576986-project] Calling method '>' {{(pid=129322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:45:53.922166 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.compute.api [None req-71994af1-6f0b-4699-a28d-aa158dce239f tempest-TestMinimumBasicScenario-102576986 tempest-TestMinimumBasicScenario-102576986-project] [instance: 76661008-e6d3-4646-a9ba-d5d0e83a4b65] Fetching instance by UUID {{(pid=129322) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:45:53.929451 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-71994af1-6f0b-4699-a28d-aa158dce239f tempest-TestMinimumBasicScenario-102576986 tempest-TestMinimumBasicScenario-102576986-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:45:53.929895 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-71994af1-6f0b-4699-a28d-aa158dce239f tempest-TestMinimumBasicScenario-102576986 tempest-TestMinimumBasicScenario-102576986-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:45:53.930662 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-71994af1-6f0b-4699-a28d-aa158dce239f tempest-TestMinimumBasicScenario-102576986 tempest-TestMinimumBasicScenario-102576986-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:45:53.931090 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-71994af1-6f0b-4699-a28d-aa158dce239f tempest-TestMinimumBasicScenario-102576986 tempest-TestMinimumBasicScenario-102576986-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:45:53.951965 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.policy [None req-75ad425c-e814-445f-9465-a716517e96dc tempest-TestVolumeBootPattern-1304354335 tempest-TestVolumeBootPattern-1304354335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab469b18ce0444d9884cdddc34ef7247', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fb41c547884511893b768b833f4e90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129321) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:45:53.960111 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: INFO nova.api.openstack.requestlog [None req-75ad425c-e814-445f-9465-a716517e96dc tempest-TestVolumeBootPattern-1304354335 tempest-TestVolumeBootPattern-1304354335-project] 10.222.0.75 "GET /compute/v2.1/servers/475179d2-21d7-4ace-90eb-e6525cb14928" status: 200 len: 1266 microversion: 2.1 time: 0.167221 May 26 12:45:53.961363 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: [pid: 129321|app: 0|req: 389/799] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 26 12:45:53 2022] GET /compute/v2.1/servers/475179d2-21d7-4ace-90eb-e6525cb14928 => generated 1266 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:45:54.089673 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.policy [None req-71994af1-6f0b-4699-a28d-aa158dce239f tempest-TestMinimumBasicScenario-102576986 tempest-TestMinimumBasicScenario-102576986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0352a80bdc174b9a9df4eca60b81eba4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fa2c4d6423444e487d259062656129b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129322) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:45:54.098094 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: INFO nova.api.openstack.requestlog [None req-71994af1-6f0b-4699-a28d-aa158dce239f tempest-TestMinimumBasicScenario-102576986 tempest-TestMinimumBasicScenario-102576986-project] 10.222.0.75 "GET /compute/v2.1/servers/76661008-e6d3-4646-a9ba-d5d0e83a4b65" status: 200 len: 1755 microversion: 2.1 time: 0.180551 May 26 12:45:54.098665 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: [pid: 129322|app: 0|req: 411/800] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 26 12:45:53 2022] GET /compute/v2.1/servers/76661008-e6d3-4646-a9ba-d5d0e83a4b65 => generated 1755 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:45:54.378678 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi [None req-8b4ba308-70b7-478b-b8bf-8f1396e9577f tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Calling method '>' {{(pid=129321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:45:54.379801 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.compute.api [None req-8b4ba308-70b7-478b-b8bf-8f1396e9577f tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] [instance: bf2f6303-22b9-4cfa-8d4d-61d2503bc554] Fetching instance by UUID {{(pid=129321) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:45:54.390539 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-8b4ba308-70b7-478b-b8bf-8f1396e9577f tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:45:54.391258 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-8b4ba308-70b7-478b-b8bf-8f1396e9577f tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:45:54.392536 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-8b4ba308-70b7-478b-b8bf-8f1396e9577f tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:45:54.393419 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-8b4ba308-70b7-478b-b8bf-8f1396e9577f tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:45:54.452962 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: INFO nova.api.openstack.requestlog [None req-8b4ba308-70b7-478b-b8bf-8f1396e9577f tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] 10.222.0.75 "GET /compute/v2.1/servers/bf2f6303-22b9-4cfa-8d4d-61d2503bc554/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.080221 May 26 12:45:54.453909 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: [pid: 129321|app: 0|req: 390/801] 10.222.0.75 () {60 vars in 1342 bytes} [Thu May 26 12:45:54 2022] GET /compute/v2.1/servers/bf2f6303-22b9-4cfa-8d4d-61d2503bc554/os-volume_attachments => generated 25 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:45:54.516979 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi [None req-cdc814aa-7b18-4bdf-a685-61339660d52e tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Calling method '>' {{(pid=129322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:45:54.517477 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.compute.api [None req-cdc814aa-7b18-4bdf-a685-61339660d52e tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] [instance: bf2f6303-22b9-4cfa-8d4d-61d2503bc554] Fetching instance by UUID {{(pid=129322) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:45:54.523795 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-cdc814aa-7b18-4bdf-a685-61339660d52e tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:45:54.524243 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-cdc814aa-7b18-4bdf-a685-61339660d52e tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:45:54.525007 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-cdc814aa-7b18-4bdf-a685-61339660d52e tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:45:54.525439 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-cdc814aa-7b18-4bdf-a685-61339660d52e tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:45:54.553041 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.compute.api [None req-cdc814aa-7b18-4bdf-a685-61339660d52e tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] [instance: bf2f6303-22b9-4cfa-8d4d-61d2503bc554] Going to try to terminate instance {{(pid=129322) delete /opt/stack/nova/nova/compute/api.py:2664}} May 26 12:45:54.653488 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: INFO nova.api.openstack.requestlog [None req-cdc814aa-7b18-4bdf-a685-61339660d52e tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] 10.222.0.75 "DELETE /compute/v2.1/servers/bf2f6303-22b9-4cfa-8d4d-61d2503bc554" status: 204 len: 0 microversion: 2.20 time: 0.140032 May 26 12:45:54.654408 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: [pid: 129322|app: 0|req: 412/802] 10.222.0.75 () {60 vars in 1279 bytes} [Thu May 26 12:45:54 2022] DELETE /compute/v2.1/servers/bf2f6303-22b9-4cfa-8d4d-61d2503bc554 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) May 26 12:45:54.665273 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi [None req-b3c8d0b9-7d7c-4cfa-a4d3-b33f394a08fa tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Calling method '>' {{(pid=129321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:45:54.665903 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.compute.api [None req-b3c8d0b9-7d7c-4cfa-a4d3-b33f394a08fa tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] [instance: bf2f6303-22b9-4cfa-8d4d-61d2503bc554] Fetching instance by UUID {{(pid=129321) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:45:54.672821 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-b3c8d0b9-7d7c-4cfa-a4d3-b33f394a08fa tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:45:54.673232 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-b3c8d0b9-7d7c-4cfa-a4d3-b33f394a08fa tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:45:54.674008 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-b3c8d0b9-7d7c-4cfa-a4d3-b33f394a08fa tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:45:54.674550 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-b3c8d0b9-7d7c-4cfa-a4d3-b33f394a08fa tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:45:54.733259 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi [req-07f80c14-a8d6-47d2-b169-79f6f107adac req-381ad62c-9e5b-4c2e-ab78-87a82449c873 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e911acec-b583-42eb-b5de-dee9573bad6c", "tag": "fc5a0b73-9cdf-4e1b-8b93-f12bfc2ac6a4"}]} {{(pid=129322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 12:45:54.748144 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [req-07f80c14-a8d6-47d2-b169-79f6f107adac req-381ad62c-9e5b-4c2e-ab78-87a82449c873 service nova] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:45:54.748905 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [req-07f80c14-a8d6-47d2-b169-79f6f107adac req-381ad62c-9e5b-4c2e-ab78-87a82449c873 service nova] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:45:54.756411 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG dbcounter [-] [129322] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:45:54.765898 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: INFO nova.api.openstack.compute.server_external_events [req-07f80c14-a8d6-47d2-b169-79f6f107adac req-381ad62c-9e5b-4c2e-ab78-87a82449c873 service nova] Creating event network-changed:fc5a0b73-9cdf-4e1b-8b93-f12bfc2ac6a4 for instance e911acec-b583-42eb-b5de-dee9573bad6c on hv-cinder-81966 May 26 12:45:54.772803 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: INFO nova.api.openstack.requestlog [req-07f80c14-a8d6-47d2-b169-79f6f107adac req-381ad62c-9e5b-4c2e-ab78-87a82449c873 service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042429 May 26 12:45:54.772803 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: [pid: 129322|app: 0|req: 413/803] 10.222.0.75 () {64 vars in 1317 bytes} [Thu May 26 12:45:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 12:45:54.826883 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.policy [None req-b3c8d0b9-7d7c-4cfa-a4d3-b33f394a08fa tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e811736979c44b02b14fecb74c6bd7ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675272fb40d4847819f83ec04afecef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129321) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:45:54.835706 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.policy [None req-b3c8d0b9-7d7c-4cfa-a4d3-b33f394a08fa tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e811736979c44b02b14fecb74c6bd7ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675272fb40d4847819f83ec04afecef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129321) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:45:54.837225 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.policy [None req-b3c8d0b9-7d7c-4cfa-a4d3-b33f394a08fa tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e811736979c44b02b14fecb74c6bd7ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675272fb40d4847819f83ec04afecef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129321) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:45:54.838443 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: INFO nova.api.openstack.requestlog [None req-b3c8d0b9-7d7c-4cfa-a4d3-b33f394a08fa tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] 10.222.0.75 "GET /compute/v2.1/servers/bf2f6303-22b9-4cfa-8d4d-61d2503bc554" status: 200 len: 1725 microversion: 2.20 time: 0.177319 May 26 12:45:54.838999 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: [pid: 129321|app: 0|req: 391/804] 10.222.0.75 () {60 vars in 1276 bytes} [Thu May 26 12:45:54 2022] GET /compute/v2.1/servers/bf2f6303-22b9-4cfa-8d4d-61d2503bc554 => generated 1725 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 12:45:54.978989 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi [None req-dbb5c774-3090-4b89-87b9-ee37a9182402 tempest-TestVolumeBootPattern-1304354335 tempest-TestVolumeBootPattern-1304354335-project] Calling method '>' {{(pid=129322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:45:54.979695 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.compute.api [None req-dbb5c774-3090-4b89-87b9-ee37a9182402 tempest-TestVolumeBootPattern-1304354335 tempest-TestVolumeBootPattern-1304354335-project] [instance: 475179d2-21d7-4ace-90eb-e6525cb14928] Fetching instance by UUID {{(pid=129322) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:45:54.988077 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-dbb5c774-3090-4b89-87b9-ee37a9182402 tempest-TestVolumeBootPattern-1304354335 tempest-TestVolumeBootPattern-1304354335-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:45:54.988619 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-dbb5c774-3090-4b89-87b9-ee37a9182402 tempest-TestVolumeBootPattern-1304354335 tempest-TestVolumeBootPattern-1304354335-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:45:54.989405 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-dbb5c774-3090-4b89-87b9-ee37a9182402 tempest-TestVolumeBootPattern-1304354335 tempest-TestVolumeBootPattern-1304354335-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:45:54.989883 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-dbb5c774-3090-4b89-87b9-ee37a9182402 tempest-TestVolumeBootPattern-1304354335 tempest-TestVolumeBootPattern-1304354335-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:45:55.114668 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi [None req-38d49e29-d342-4ca4-94a9-3d91bfd0859b tempest-TestMinimumBasicScenario-102576986 tempest-TestMinimumBasicScenario-102576986-project] Calling method '>' {{(pid=129321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:45:55.115281 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.compute.api [None req-38d49e29-d342-4ca4-94a9-3d91bfd0859b tempest-TestMinimumBasicScenario-102576986 tempest-TestMinimumBasicScenario-102576986-project] [instance: 76661008-e6d3-4646-a9ba-d5d0e83a4b65] Fetching instance by UUID {{(pid=129321) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:45:55.118382 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG dbcounter [-] [129321] Writing DB stats nova_cell0:SELECT=2 {{(pid=129321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:45:55.119279 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG dbcounter [-] [129321] Writing DB stats nova_cell0:SELECT=6 {{(pid=129321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:45:55.125017 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-38d49e29-d342-4ca4-94a9-3d91bfd0859b tempest-TestMinimumBasicScenario-102576986 tempest-TestMinimumBasicScenario-102576986-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:45:55.125017 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-38d49e29-d342-4ca4-94a9-3d91bfd0859b tempest-TestMinimumBasicScenario-102576986 tempest-TestMinimumBasicScenario-102576986-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:45:55.125304 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-38d49e29-d342-4ca4-94a9-3d91bfd0859b tempest-TestMinimumBasicScenario-102576986 tempest-TestMinimumBasicScenario-102576986-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:45:55.125568 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-38d49e29-d342-4ca4-94a9-3d91bfd0859b tempest-TestMinimumBasicScenario-102576986 tempest-TestMinimumBasicScenario-102576986-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:45:55.128808 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.policy [None req-dbb5c774-3090-4b89-87b9-ee37a9182402 tempest-TestVolumeBootPattern-1304354335 tempest-TestVolumeBootPattern-1304354335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab469b18ce0444d9884cdddc34ef7247', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fb41c547884511893b768b833f4e90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129322) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:45:55.136484 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: INFO nova.api.openstack.requestlog [None req-dbb5c774-3090-4b89-87b9-ee37a9182402 tempest-TestVolumeBootPattern-1304354335 tempest-TestVolumeBootPattern-1304354335-project] 10.222.0.75 "GET /compute/v2.1/servers/475179d2-21d7-4ace-90eb-e6525cb14928" status: 200 len: 1266 microversion: 2.1 time: 0.162832 May 26 12:45:55.137031 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: [pid: 129322|app: 0|req: 414/805] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 26 12:45:54 2022] GET /compute/v2.1/servers/475179d2-21d7-4ace-90eb-e6525cb14928 => generated 1266 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:45:55.275879 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.policy [None req-38d49e29-d342-4ca4-94a9-3d91bfd0859b tempest-TestMinimumBasicScenario-102576986 tempest-TestMinimumBasicScenario-102576986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0352a80bdc174b9a9df4eca60b81eba4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fa2c4d6423444e487d259062656129b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129321) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:45:55.284601 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: INFO nova.api.openstack.requestlog [None req-38d49e29-d342-4ca4-94a9-3d91bfd0859b tempest-TestMinimumBasicScenario-102576986 tempest-TestMinimumBasicScenario-102576986-project] 10.222.0.75 "GET /compute/v2.1/servers/76661008-e6d3-4646-a9ba-d5d0e83a4b65" status: 200 len: 1755 microversion: 2.1 time: 0.173907 May 26 12:45:55.285175 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: [pid: 129321|app: 0|req: 392/806] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 26 12:45:55 2022] GET /compute/v2.1/servers/76661008-e6d3-4646-a9ba-d5d0e83a4b65 => generated 1755 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 12:45:55.859523 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi [None req-f1bc2dc3-0015-4e2c-9dbf-c4041a09a819 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Calling method '>' {{(pid=129322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:45:55.860071 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.compute.api [None req-f1bc2dc3-0015-4e2c-9dbf-c4041a09a819 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] [instance: bf2f6303-22b9-4cfa-8d4d-61d2503bc554] Fetching instance by UUID {{(pid=129322) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:45:55.862387 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG dbcounter [-] [129322] Writing DB stats nova_cell0:SELECT=2 {{(pid=129322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:45:55.868268 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-f1bc2dc3-0015-4e2c-9dbf-c4041a09a819 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:45:55.868747 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-f1bc2dc3-0015-4e2c-9dbf-c4041a09a819 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:45:55.869519 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-f1bc2dc3-0015-4e2c-9dbf-c4041a09a819 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:45:55.869946 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-f1bc2dc3-0015-4e2c-9dbf-c4041a09a819 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:45:56.026366 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.policy [None req-f1bc2dc3-0015-4e2c-9dbf-c4041a09a819 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e811736979c44b02b14fecb74c6bd7ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675272fb40d4847819f83ec04afecef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129322) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:45:56.036286 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.policy [None req-f1bc2dc3-0015-4e2c-9dbf-c4041a09a819 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e811736979c44b02b14fecb74c6bd7ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675272fb40d4847819f83ec04afecef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129322) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:45:56.037849 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.policy [None req-f1bc2dc3-0015-4e2c-9dbf-c4041a09a819 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e811736979c44b02b14fecb74c6bd7ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675272fb40d4847819f83ec04afecef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129322) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:45:56.039116 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: INFO nova.api.openstack.requestlog [None req-f1bc2dc3-0015-4e2c-9dbf-c4041a09a819 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] 10.222.0.75 "GET /compute/v2.1/servers/bf2f6303-22b9-4cfa-8d4d-61d2503bc554" status: 200 len: 1725 microversion: 2.20 time: 0.183782 May 26 12:45:56.039830 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: [pid: 129322|app: 0|req: 415/807] 10.222.0.75 () {60 vars in 1276 bytes} [Thu May 26 12:45:55 2022] GET /compute/v2.1/servers/bf2f6303-22b9-4cfa-8d4d-61d2503bc554 => generated 1725 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 12:45:56.154723 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi [None req-5843fe53-323b-4a30-951e-5a483283c728 tempest-TestVolumeBootPattern-1304354335 tempest-TestVolumeBootPattern-1304354335-project] Calling method '>' {{(pid=129321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:45:56.155313 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.compute.api [None req-5843fe53-323b-4a30-951e-5a483283c728 tempest-TestVolumeBootPattern-1304354335 tempest-TestVolumeBootPattern-1304354335-project] [instance: 475179d2-21d7-4ace-90eb-e6525cb14928] Fetching instance by UUID {{(pid=129321) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:45:56.163690 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-5843fe53-323b-4a30-951e-5a483283c728 tempest-TestVolumeBootPattern-1304354335 tempest-TestVolumeBootPattern-1304354335-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:45:56.163973 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-5843fe53-323b-4a30-951e-5a483283c728 tempest-TestVolumeBootPattern-1304354335 tempest-TestVolumeBootPattern-1304354335-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:45:56.171055 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-5843fe53-323b-4a30-951e-5a483283c728 tempest-TestVolumeBootPattern-1304354335 tempest-TestVolumeBootPattern-1304354335-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:45:56.171055 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-5843fe53-323b-4a30-951e-5a483283c728 tempest-TestVolumeBootPattern-1304354335 tempest-TestVolumeBootPattern-1304354335-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:45:56.308347 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi [None req-cd1b08d6-1f03-42e6-a6dd-30870caf9af5 tempest-TestMinimumBasicScenario-102576986 tempest-TestMinimumBasicScenario-102576986-project] Calling method '>' {{(pid=129322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:45:56.310222 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.compute.api [None req-cd1b08d6-1f03-42e6-a6dd-30870caf9af5 tempest-TestMinimumBasicScenario-102576986 tempest-TestMinimumBasicScenario-102576986-project] [instance: 76661008-e6d3-4646-a9ba-d5d0e83a4b65] Fetching instance by UUID {{(pid=129322) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:45:56.319970 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-cd1b08d6-1f03-42e6-a6dd-30870caf9af5 tempest-TestMinimumBasicScenario-102576986 tempest-TestMinimumBasicScenario-102576986-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:45:56.320448 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-cd1b08d6-1f03-42e6-a6dd-30870caf9af5 tempest-TestMinimumBasicScenario-102576986 tempest-TestMinimumBasicScenario-102576986-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:45:56.321216 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-cd1b08d6-1f03-42e6-a6dd-30870caf9af5 tempest-TestMinimumBasicScenario-102576986 tempest-TestMinimumBasicScenario-102576986-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:45:56.321644 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-cd1b08d6-1f03-42e6-a6dd-30870caf9af5 tempest-TestMinimumBasicScenario-102576986 tempest-TestMinimumBasicScenario-102576986-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:45:56.407360 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.policy [None req-5843fe53-323b-4a30-951e-5a483283c728 tempest-TestVolumeBootPattern-1304354335 tempest-TestVolumeBootPattern-1304354335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab469b18ce0444d9884cdddc34ef7247', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fb41c547884511893b768b833f4e90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129321) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:45:56.416993 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: INFO nova.api.openstack.requestlog [None req-5843fe53-323b-4a30-951e-5a483283c728 tempest-TestVolumeBootPattern-1304354335 tempest-TestVolumeBootPattern-1304354335-project] 10.222.0.75 "GET /compute/v2.1/servers/475179d2-21d7-4ace-90eb-e6525cb14928" status: 200 len: 1266 microversion: 2.1 time: 0.266375 May 26 12:45:56.417796 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: [pid: 129321|app: 0|req: 393/808] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 26 12:45:56 2022] GET /compute/v2.1/servers/475179d2-21d7-4ace-90eb-e6525cb14928 => generated 1266 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:45:56.489070 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.policy [None req-cd1b08d6-1f03-42e6-a6dd-30870caf9af5 tempest-TestMinimumBasicScenario-102576986 tempest-TestMinimumBasicScenario-102576986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0352a80bdc174b9a9df4eca60b81eba4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fa2c4d6423444e487d259062656129b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129322) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:45:56.497507 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: INFO nova.api.openstack.requestlog [None req-cd1b08d6-1f03-42e6-a6dd-30870caf9af5 tempest-TestMinimumBasicScenario-102576986 tempest-TestMinimumBasicScenario-102576986-project] 10.222.0.75 "GET /compute/v2.1/servers/76661008-e6d3-4646-a9ba-d5d0e83a4b65" status: 200 len: 1755 microversion: 2.1 time: 0.198926 May 26 12:45:56.498123 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: [pid: 129322|app: 0|req: 416/809] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 26 12:45:56 2022] GET /compute/v2.1/servers/76661008-e6d3-4646-a9ba-d5d0e83a4b65 => generated 1755 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 12:45:57.058200 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi [None req-eed85d6c-750e-4ca2-b844-0f4e6e1f1a27 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Calling method '>' {{(pid=129321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:45:57.058820 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.compute.api [None req-eed85d6c-750e-4ca2-b844-0f4e6e1f1a27 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] [instance: bf2f6303-22b9-4cfa-8d4d-61d2503bc554] Fetching instance by UUID {{(pid=129321) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:45:57.067645 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-eed85d6c-750e-4ca2-b844-0f4e6e1f1a27 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:45:57.068092 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-eed85d6c-750e-4ca2-b844-0f4e6e1f1a27 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:45:57.068869 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-eed85d6c-750e-4ca2-b844-0f4e6e1f1a27 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:45:57.069304 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-eed85d6c-750e-4ca2-b844-0f4e6e1f1a27 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:45:57.366517 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.policy [None req-eed85d6c-750e-4ca2-b844-0f4e6e1f1a27 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e811736979c44b02b14fecb74c6bd7ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675272fb40d4847819f83ec04afecef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129321) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:45:57.375468 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.policy [None req-eed85d6c-750e-4ca2-b844-0f4e6e1f1a27 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e811736979c44b02b14fecb74c6bd7ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675272fb40d4847819f83ec04afecef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129321) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:45:57.377415 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.policy [None req-eed85d6c-750e-4ca2-b844-0f4e6e1f1a27 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e811736979c44b02b14fecb74c6bd7ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675272fb40d4847819f83ec04afecef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129321) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:45:57.378834 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: INFO nova.api.openstack.requestlog [None req-eed85d6c-750e-4ca2-b844-0f4e6e1f1a27 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] 10.222.0.75 "GET /compute/v2.1/servers/bf2f6303-22b9-4cfa-8d4d-61d2503bc554" status: 200 len: 1725 microversion: 2.20 time: 0.324665 May 26 12:45:57.379852 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: [pid: 129321|app: 0|req: 394/810] 10.222.0.75 () {60 vars in 1276 bytes} [Thu May 26 12:45:57 2022] GET /compute/v2.1/servers/bf2f6303-22b9-4cfa-8d4d-61d2503bc554 => generated 1725 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 12:45:57.434679 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi [None req-441daf5b-54e8-46c6-a083-aaecf61fe39f tempest-TestVolumeBootPattern-1304354335 tempest-TestVolumeBootPattern-1304354335-project] Calling method '>' {{(pid=129322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:45:57.435294 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.compute.api [None req-441daf5b-54e8-46c6-a083-aaecf61fe39f tempest-TestVolumeBootPattern-1304354335 tempest-TestVolumeBootPattern-1304354335-project] [instance: 475179d2-21d7-4ace-90eb-e6525cb14928] Fetching instance by UUID {{(pid=129322) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:45:57.442500 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-441daf5b-54e8-46c6-a083-aaecf61fe39f tempest-TestVolumeBootPattern-1304354335 tempest-TestVolumeBootPattern-1304354335-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:45:57.442953 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-441daf5b-54e8-46c6-a083-aaecf61fe39f tempest-TestVolumeBootPattern-1304354335 tempest-TestVolumeBootPattern-1304354335-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:45:57.443762 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-441daf5b-54e8-46c6-a083-aaecf61fe39f tempest-TestVolumeBootPattern-1304354335 tempest-TestVolumeBootPattern-1304354335-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:45:57.444199 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-441daf5b-54e8-46c6-a083-aaecf61fe39f tempest-TestVolumeBootPattern-1304354335 tempest-TestVolumeBootPattern-1304354335-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:45:57.516053 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi [None req-1ad2c53b-3451-46f5-9cf6-ce70190e664e tempest-TestMinimumBasicScenario-102576986 tempest-TestMinimumBasicScenario-102576986-project] Calling method '>' {{(pid=129321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:45:57.517070 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.compute.api [None req-1ad2c53b-3451-46f5-9cf6-ce70190e664e tempest-TestMinimumBasicScenario-102576986 tempest-TestMinimumBasicScenario-102576986-project] [instance: 76661008-e6d3-4646-a9ba-d5d0e83a4b65] Fetching instance by UUID {{(pid=129321) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:45:57.524398 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-1ad2c53b-3451-46f5-9cf6-ce70190e664e tempest-TestMinimumBasicScenario-102576986 tempest-TestMinimumBasicScenario-102576986-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:45:57.524858 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-1ad2c53b-3451-46f5-9cf6-ce70190e664e tempest-TestMinimumBasicScenario-102576986 tempest-TestMinimumBasicScenario-102576986-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:45:57.525673 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-1ad2c53b-3451-46f5-9cf6-ce70190e664e tempest-TestMinimumBasicScenario-102576986 tempest-TestMinimumBasicScenario-102576986-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:45:57.527475 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-1ad2c53b-3451-46f5-9cf6-ce70190e664e tempest-TestMinimumBasicScenario-102576986 tempest-TestMinimumBasicScenario-102576986-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:45:57.603065 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.policy [None req-441daf5b-54e8-46c6-a083-aaecf61fe39f tempest-TestVolumeBootPattern-1304354335 tempest-TestVolumeBootPattern-1304354335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab469b18ce0444d9884cdddc34ef7247', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fb41c547884511893b768b833f4e90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129322) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:45:57.610970 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: INFO nova.api.openstack.requestlog [None req-441daf5b-54e8-46c6-a083-aaecf61fe39f tempest-TestVolumeBootPattern-1304354335 tempest-TestVolumeBootPattern-1304354335-project] 10.222.0.75 "GET /compute/v2.1/servers/475179d2-21d7-4ace-90eb-e6525cb14928" status: 200 len: 1266 microversion: 2.1 time: 0.180287 May 26 12:45:57.611574 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: [pid: 129322|app: 0|req: 417/811] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 26 12:45:57 2022] GET /compute/v2.1/servers/475179d2-21d7-4ace-90eb-e6525cb14928 => generated 1266 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:45:57.860395 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.policy [None req-1ad2c53b-3451-46f5-9cf6-ce70190e664e tempest-TestMinimumBasicScenario-102576986 tempest-TestMinimumBasicScenario-102576986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0352a80bdc174b9a9df4eca60b81eba4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fa2c4d6423444e487d259062656129b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129321) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:45:57.869366 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: INFO nova.api.openstack.requestlog [None req-1ad2c53b-3451-46f5-9cf6-ce70190e664e tempest-TestMinimumBasicScenario-102576986 tempest-TestMinimumBasicScenario-102576986-project] 10.222.0.75 "GET /compute/v2.1/servers/76661008-e6d3-4646-a9ba-d5d0e83a4b65" status: 200 len: 1755 microversion: 2.1 time: 0.357882 May 26 12:45:57.870023 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: [pid: 129321|app: 0|req: 395/812] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 26 12:45:57 2022] GET /compute/v2.1/servers/76661008-e6d3-4646-a9ba-d5d0e83a4b65 => generated 1755 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:45:58.399674 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi [None req-2a7cd301-7857-4ec6-a9a2-5a6f9e2b205f tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Calling method '>' {{(pid=129322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:45:58.400973 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.compute.api [None req-2a7cd301-7857-4ec6-a9a2-5a6f9e2b205f tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] [instance: bf2f6303-22b9-4cfa-8d4d-61d2503bc554] Fetching instance by UUID {{(pid=129322) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:45:58.409714 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-2a7cd301-7857-4ec6-a9a2-5a6f9e2b205f tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:45:58.409910 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-2a7cd301-7857-4ec6-a9a2-5a6f9e2b205f tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:45:58.410841 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-2a7cd301-7857-4ec6-a9a2-5a6f9e2b205f tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:45:58.411342 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-2a7cd301-7857-4ec6-a9a2-5a6f9e2b205f tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:45:58.485710 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.policy [None req-2a7cd301-7857-4ec6-a9a2-5a6f9e2b205f tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e811736979c44b02b14fecb74c6bd7ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675272fb40d4847819f83ec04afecef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129322) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:45:58.495088 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.policy [None req-2a7cd301-7857-4ec6-a9a2-5a6f9e2b205f tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e811736979c44b02b14fecb74c6bd7ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675272fb40d4847819f83ec04afecef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129322) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:45:58.496639 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.policy [None req-2a7cd301-7857-4ec6-a9a2-5a6f9e2b205f tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e811736979c44b02b14fecb74c6bd7ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675272fb40d4847819f83ec04afecef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129322) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:45:58.497829 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: INFO nova.api.openstack.requestlog [None req-2a7cd301-7857-4ec6-a9a2-5a6f9e2b205f tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] 10.222.0.75 "GET /compute/v2.1/servers/bf2f6303-22b9-4cfa-8d4d-61d2503bc554" status: 200 len: 1658 microversion: 2.20 time: 0.104107 May 26 12:45:58.498389 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: [pid: 129322|app: 0|req: 418/813] 10.222.0.75 () {60 vars in 1276 bytes} [Thu May 26 12:45:58 2022] GET /compute/v2.1/servers/bf2f6303-22b9-4cfa-8d4d-61d2503bc554 => generated 1658 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 12:45:58.529278 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi [req-0120f960-4f16-4745-bf1d-0a8b66b9c94f req-7bc78011-7f91-48b4-b15a-8e0e113efb1f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bf2f6303-22b9-4cfa-8d4d-61d2503bc554", "name": "network-vif-deleted", "tag": "fe40ed8f-f450-48f7-876a-abe2fea7abe5"}]} {{(pid=129321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 12:45:58.538635 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [req-0120f960-4f16-4745-bf1d-0a8b66b9c94f req-7bc78011-7f91-48b4-b15a-8e0e113efb1f service nova] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:45:58.539070 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [req-0120f960-4f16-4745-bf1d-0a8b66b9c94f req-7bc78011-7f91-48b4-b15a-8e0e113efb1f service nova] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:45:58.551182 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: INFO nova.api.openstack.compute.server_external_events [req-0120f960-4f16-4745-bf1d-0a8b66b9c94f req-7bc78011-7f91-48b4-b15a-8e0e113efb1f service nova] Creating event network-vif-deleted:fe40ed8f-f450-48f7-876a-abe2fea7abe5 for instance bf2f6303-22b9-4cfa-8d4d-61d2503bc554 on hv-cinder-81966 May 26 12:45:58.556475 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: INFO nova.api.openstack.requestlog [req-0120f960-4f16-4745-bf1d-0a8b66b9c94f req-7bc78011-7f91-48b4-b15a-8e0e113efb1f service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031018 May 26 12:45:58.557088 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: [pid: 129321|app: 0|req: 396/814] 10.222.0.75 () {64 vars in 1317 bytes} [Thu May 26 12:45:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 12:45:58.629119 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi [None req-14fa910c-d6e4-43fb-b652-7cbf8bb02e10 tempest-TestVolumeBootPattern-1304354335 tempest-TestVolumeBootPattern-1304354335-project] Calling method '>' {{(pid=129322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:45:58.629720 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.compute.api [None req-14fa910c-d6e4-43fb-b652-7cbf8bb02e10 tempest-TestVolumeBootPattern-1304354335 tempest-TestVolumeBootPattern-1304354335-project] [instance: 475179d2-21d7-4ace-90eb-e6525cb14928] Fetching instance by UUID {{(pid=129322) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:45:58.637269 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-14fa910c-d6e4-43fb-b652-7cbf8bb02e10 tempest-TestVolumeBootPattern-1304354335 tempest-TestVolumeBootPattern-1304354335-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:45:58.637690 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-14fa910c-d6e4-43fb-b652-7cbf8bb02e10 tempest-TestVolumeBootPattern-1304354335 tempest-TestVolumeBootPattern-1304354335-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:45:58.638528 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-14fa910c-d6e4-43fb-b652-7cbf8bb02e10 tempest-TestVolumeBootPattern-1304354335 tempest-TestVolumeBootPattern-1304354335-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:45:58.639051 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-14fa910c-d6e4-43fb-b652-7cbf8bb02e10 tempest-TestVolumeBootPattern-1304354335 tempest-TestVolumeBootPattern-1304354335-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:45:58.787959 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.policy [None req-14fa910c-d6e4-43fb-b652-7cbf8bb02e10 tempest-TestVolumeBootPattern-1304354335 tempest-TestVolumeBootPattern-1304354335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab469b18ce0444d9884cdddc34ef7247', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fb41c547884511893b768b833f4e90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129322) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:45:58.796498 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: INFO nova.api.openstack.requestlog [None req-14fa910c-d6e4-43fb-b652-7cbf8bb02e10 tempest-TestVolumeBootPattern-1304354335 tempest-TestVolumeBootPattern-1304354335-project] 10.222.0.75 "GET /compute/v2.1/servers/475179d2-21d7-4ace-90eb-e6525cb14928" status: 200 len: 1266 microversion: 2.1 time: 0.171475 May 26 12:45:58.797165 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: [pid: 129322|app: 0|req: 419/815] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 26 12:45:58 2022] GET /compute/v2.1/servers/475179d2-21d7-4ace-90eb-e6525cb14928 => generated 1266 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:45:58.887587 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi [None req-17d44ab6-7173-4681-8d81-5a05af637ea6 tempest-TestMinimumBasicScenario-102576986 tempest-TestMinimumBasicScenario-102576986-project] Calling method '>' {{(pid=129321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:45:58.888980 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.compute.api [None req-17d44ab6-7173-4681-8d81-5a05af637ea6 tempest-TestMinimumBasicScenario-102576986 tempest-TestMinimumBasicScenario-102576986-project] [instance: 76661008-e6d3-4646-a9ba-d5d0e83a4b65] Fetching instance by UUID {{(pid=129321) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:45:58.896265 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-17d44ab6-7173-4681-8d81-5a05af637ea6 tempest-TestMinimumBasicScenario-102576986 tempest-TestMinimumBasicScenario-102576986-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:45:58.896716 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-17d44ab6-7173-4681-8d81-5a05af637ea6 tempest-TestMinimumBasicScenario-102576986 tempest-TestMinimumBasicScenario-102576986-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:45:58.897497 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-17d44ab6-7173-4681-8d81-5a05af637ea6 tempest-TestMinimumBasicScenario-102576986 tempest-TestMinimumBasicScenario-102576986-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:45:58.897925 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-17d44ab6-7173-4681-8d81-5a05af637ea6 tempest-TestMinimumBasicScenario-102576986 tempest-TestMinimumBasicScenario-102576986-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:45:59.089641 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.policy [None req-17d44ab6-7173-4681-8d81-5a05af637ea6 tempest-TestMinimumBasicScenario-102576986 tempest-TestMinimumBasicScenario-102576986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0352a80bdc174b9a9df4eca60b81eba4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fa2c4d6423444e487d259062656129b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129321) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:45:59.099272 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: INFO nova.api.openstack.requestlog [None req-17d44ab6-7173-4681-8d81-5a05af637ea6 tempest-TestMinimumBasicScenario-102576986 tempest-TestMinimumBasicScenario-102576986-project] 10.222.0.75 "GET /compute/v2.1/servers/76661008-e6d3-4646-a9ba-d5d0e83a4b65" status: 200 len: 1755 microversion: 2.1 time: 0.216419 May 26 12:45:59.100387 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: [pid: 129321|app: 0|req: 397/816] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 26 12:45:58 2022] GET /compute/v2.1/servers/76661008-e6d3-4646-a9ba-d5d0e83a4b65 => generated 1755 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:45:59.517093 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi [None req-752a365e-7588-4004-b3d9-a43bbc7cd4bd tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Calling method '>' {{(pid=129322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:45:59.517858 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.compute.api [None req-752a365e-7588-4004-b3d9-a43bbc7cd4bd tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] [instance: bf2f6303-22b9-4cfa-8d4d-61d2503bc554] Fetching instance by UUID {{(pid=129322) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:45:59.525041 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-752a365e-7588-4004-b3d9-a43bbc7cd4bd tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:45:59.525761 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-752a365e-7588-4004-b3d9-a43bbc7cd4bd tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:45:59.526546 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-752a365e-7588-4004-b3d9-a43bbc7cd4bd tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:45:59.526982 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-752a365e-7588-4004-b3d9-a43bbc7cd4bd tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:45:59.564950 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-752a365e-7588-4004-b3d9-a43bbc7cd4bd tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:45:59.565372 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-752a365e-7588-4004-b3d9-a43bbc7cd4bd tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:45:59.565936 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.objects.instance [None req-752a365e-7588-4004-b3d9-a43bbc7cd4bd tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lazy-loading 'fault' on Instance uuid bf2f6303-22b9-4cfa-8d4d-61d2503bc554 {{(pid=129322) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 26 12:45:59.620886 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.policy [None req-752a365e-7588-4004-b3d9-a43bbc7cd4bd tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e811736979c44b02b14fecb74c6bd7ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675272fb40d4847819f83ec04afecef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129322) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:45:59.630884 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.policy [None req-752a365e-7588-4004-b3d9-a43bbc7cd4bd tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e811736979c44b02b14fecb74c6bd7ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675272fb40d4847819f83ec04afecef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129322) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:45:59.632881 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.policy [None req-752a365e-7588-4004-b3d9-a43bbc7cd4bd tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e811736979c44b02b14fecb74c6bd7ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675272fb40d4847819f83ec04afecef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129322) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:45:59.634219 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: INFO nova.api.openstack.requestlog [None req-752a365e-7588-4004-b3d9-a43bbc7cd4bd tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] 10.222.0.75 "GET /compute/v2.1/servers/bf2f6303-22b9-4cfa-8d4d-61d2503bc554" status: 200 len: 1372 microversion: 2.20 time: 0.121268 May 26 12:45:59.635213 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: [pid: 129322|app: 0|req: 420/817] 10.222.0.75 () {60 vars in 1276 bytes} [Thu May 26 12:45:59 2022] GET /compute/v2.1/servers/bf2f6303-22b9-4cfa-8d4d-61d2503bc554 => generated 1372 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 12:45:59.815986 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi [None req-58492603-ddd9-47b5-a078-166e5c85a3fe tempest-TestVolumeBootPattern-1304354335 tempest-TestVolumeBootPattern-1304354335-project] Calling method '>' {{(pid=129321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:45:59.816803 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.compute.api [None req-58492603-ddd9-47b5-a078-166e5c85a3fe tempest-TestVolumeBootPattern-1304354335 tempest-TestVolumeBootPattern-1304354335-project] [instance: 475179d2-21d7-4ace-90eb-e6525cb14928] Fetching instance by UUID {{(pid=129321) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:45:59.824449 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-58492603-ddd9-47b5-a078-166e5c85a3fe tempest-TestVolumeBootPattern-1304354335 tempest-TestVolumeBootPattern-1304354335-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:45:59.824978 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-58492603-ddd9-47b5-a078-166e5c85a3fe tempest-TestVolumeBootPattern-1304354335 tempest-TestVolumeBootPattern-1304354335-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:45:59.825946 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-58492603-ddd9-47b5-a078-166e5c85a3fe tempest-TestVolumeBootPattern-1304354335 tempest-TestVolumeBootPattern-1304354335-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:45:59.826449 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-58492603-ddd9-47b5-a078-166e5c85a3fe tempest-TestVolumeBootPattern-1304354335 tempest-TestVolumeBootPattern-1304354335-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:45:59.986052 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.policy [None req-58492603-ddd9-47b5-a078-166e5c85a3fe tempest-TestVolumeBootPattern-1304354335 tempest-TestVolumeBootPattern-1304354335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab469b18ce0444d9884cdddc34ef7247', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fb41c547884511893b768b833f4e90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129321) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:45:59.994145 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: INFO nova.api.openstack.requestlog [None req-58492603-ddd9-47b5-a078-166e5c85a3fe tempest-TestVolumeBootPattern-1304354335 tempest-TestVolumeBootPattern-1304354335-project] 10.222.0.75 "GET /compute/v2.1/servers/475179d2-21d7-4ace-90eb-e6525cb14928" status: 200 len: 1266 microversion: 2.1 time: 0.183594 May 26 12:45:59.994721 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: [pid: 129321|app: 0|req: 398/818] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 26 12:45:59 2022] GET /compute/v2.1/servers/475179d2-21d7-4ace-90eb-e6525cb14928 => generated 1266 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 12:46:00.119821 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi [None req-6d29c436-1107-44d5-9530-79b9ab24dd97 tempest-TestMinimumBasicScenario-102576986 tempest-TestMinimumBasicScenario-102576986-project] Calling method '>' {{(pid=129322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:46:00.120352 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.compute.api [None req-6d29c436-1107-44d5-9530-79b9ab24dd97 tempest-TestMinimumBasicScenario-102576986 tempest-TestMinimumBasicScenario-102576986-project] [instance: 76661008-e6d3-4646-a9ba-d5d0e83a4b65] Fetching instance by UUID {{(pid=129322) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:46:00.127331 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-6d29c436-1107-44d5-9530-79b9ab24dd97 tempest-TestMinimumBasicScenario-102576986 tempest-TestMinimumBasicScenario-102576986-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:46:00.127846 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-6d29c436-1107-44d5-9530-79b9ab24dd97 tempest-TestMinimumBasicScenario-102576986 tempest-TestMinimumBasicScenario-102576986-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:46:00.128887 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-6d29c436-1107-44d5-9530-79b9ab24dd97 tempest-TestMinimumBasicScenario-102576986 tempest-TestMinimumBasicScenario-102576986-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:46:00.129359 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-6d29c436-1107-44d5-9530-79b9ab24dd97 tempest-TestMinimumBasicScenario-102576986 tempest-TestMinimumBasicScenario-102576986-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:46:00.306785 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.policy [None req-6d29c436-1107-44d5-9530-79b9ab24dd97 tempest-TestMinimumBasicScenario-102576986 tempest-TestMinimumBasicScenario-102576986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0352a80bdc174b9a9df4eca60b81eba4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fa2c4d6423444e487d259062656129b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129322) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:46:00.313900 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: INFO nova.api.openstack.requestlog [None req-6d29c436-1107-44d5-9530-79b9ab24dd97 tempest-TestMinimumBasicScenario-102576986 tempest-TestMinimumBasicScenario-102576986-project] 10.222.0.75 "GET /compute/v2.1/servers/76661008-e6d3-4646-a9ba-d5d0e83a4b65" status: 200 len: 1755 microversion: 2.1 time: 0.199394 May 26 12:46:00.314722 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: [pid: 129322|app: 0|req: 421/819] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 26 12:46:00 2022] GET /compute/v2.1/servers/76661008-e6d3-4646-a9ba-d5d0e83a4b65 => generated 1755 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:46:00.653736 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi [None req-aa486021-f770-4319-881f-31d5878f42ea tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Calling method '>' {{(pid=129321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:46:00.654363 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.compute.api [None req-aa486021-f770-4319-881f-31d5878f42ea tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] [instance: bf2f6303-22b9-4cfa-8d4d-61d2503bc554] Fetching instance by UUID {{(pid=129321) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:46:00.662489 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-aa486021-f770-4319-881f-31d5878f42ea tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:46:00.662969 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-aa486021-f770-4319-881f-31d5878f42ea tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:46:00.663807 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-aa486021-f770-4319-881f-31d5878f42ea tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:46:00.664441 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-aa486021-f770-4319-881f-31d5878f42ea tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:46:00.681678 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: INFO nova.api.openstack.wsgi [None req-aa486021-f770-4319-881f-31d5878f42ea tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] HTTP exception thrown: Instance bf2f6303-22b9-4cfa-8d4d-61d2503bc554 could not be found. May 26 12:46:00.683998 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi [None req-aa486021-f770-4319-881f-31d5878f42ea tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Request method failure captured: May 26 12:46:00.683998 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: request: GET /compute/v2.1/servers/bf2f6303-22b9-4cfa-8d4d-61d2503bc554 HTTP/1.1 May 26 12:46:00.683998 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: Accept: application/json May 26 12:46:00.683998 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: Accept-Encoding: identity May 26 12:46:00.683998 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: Connection: close May 26 12:46:00.683998 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: Content-Length: 0 May 26 12:46:00.683998 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: Content-Type: application/json May 26 12:46:00.683998 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: Host: 10.222.0.75 May 26 12:46:00.683998 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: Openstack-System-Scope: None May 26 12:46:00.683998 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: User-Agent: python-urllib3/1.26.9 May 26 12:46:00.683998 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: X-Auth-Token: gAAAAABij3Sy8x7VV7VbECm0oEshoygvVRqWfKgNcFRrHFj9mPSXKcXMQg8tIDkBA2P8iWFUbZBbkZzGIVXR8vvKmlK1yee67frqgDXV0AqNB-hRFdphj0XmjeijkCFuTITZvKDXJc1QXfRaH7-s7Z1FsQJ8w5ORPhObMUWuv1bJTbuUJB-nFHE May 26 12:46:00.683998 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: X-Domain-Id: None May 26 12:46:00.683998 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: X-Domain-Name: None May 26 12:46:00.683998 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: X-Identity-Status: Confirmed May 26 12:46:00.683998 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: X-Is-Admin-Project: True May 26 12:46:00.683998 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: X-Openstack-Nova-Api-Version: 2.20 May 26 12:46:00.683998 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: X-Project-Domain-Id: default May 26 12:46:00.683998 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: X-Project-Domain-Name: Default May 26 12:46:00.683998 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: X-Project-Id: 2675272fb40d4847819f83ec04afecef May 26 12:46:00.683998 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-777401856 May 26 12:46:00.683998 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: X-Role: member,reader May 26 12:46:00.683998 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: X-Roles: member,reader May 26 12:46:00.685575 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/2675272fb40d4847819f83ec04afecef"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.75:8080", "publicURL": "http://10.222.0.75:8080/v1/AUTH_2675272fb40d4847819f83ec04afecef"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2/2675272fb40d4847819f83ec04afecef"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/2675272fb40d4847819f83ec04afecef"}]}] May 26 12:46:00.685575 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: X-Tenant: tempest-AttachVolumeShelveTestJSON-777401856 May 26 12:46:00.685575 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: X-Tenant-Id: 2675272fb40d4847819f83ec04afecef May 26 12:46:00.685575 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-777401856 May 26 12:46:00.685575 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: X-User: tempest-AttachVolumeShelveTestJSON-777401856-project May 26 12:46:00.685575 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: X-User-Domain-Id: default May 26 12:46:00.685575 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: X-User-Domain-Name: Default May 26 12:46:00.685575 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: X-User-Id: e811736979c44b02b14fecb74c6bd7ab May 26 12:46:00.685575 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: X-User-Name: tempest-AttachVolumeShelveTestJSON-777401856-project May 26 12:46:00.685575 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: method: > May 26 12:46:00.685575 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: exception: Instance bf2f6303-22b9-4cfa-8d4d-61d2503bc554 could not be found. May 26 12:46:00.685575 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: action_args: {'id': 'bf2f6303-22b9-4cfa-8d4d-61d2503bc554'} May 26 12:46:00.686375 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: {{(pid=129321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 12:46:00.686375 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 12:46:00.686375 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 26 12:46:00.686375 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 26 12:46:00.686375 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 26 12:46:00.686375 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 26 12:46:00.686375 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 26 12:46:00.686375 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 26 12:46:00.686375 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 26 12:46:00.686375 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 26 12:46:00.686375 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bf2f6303-22b9-4cfa-8d4d-61d2503bc554 could not be found. May 26 12:46:00.686375 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi May 26 12:46:00.686375 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 12:46:00.686375 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi May 26 12:46:00.686375 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 12:46:00.686375 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 12:46:00.686375 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 12:46:00.686375 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 12:46:00.686375 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 12:46:00.686375 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 12:46:00.688021 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 12:46:00.688021 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 26 12:46:00.688021 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 26 12:46:00.688021 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 26 12:46:00.688021 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 26 12:46:00.688021 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 26 12:46:00.688021 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 12:46:00.688021 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bf2f6303-22b9-4cfa-8d4d-61d2503bc554 could not be found. May 26 12:46:00.688021 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi May 26 12:46:00.688021 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 12:46:00.688021 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi May 26 12:46:00.688021 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 12:46:00.688021 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 12:46:00.688021 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 12:46:00.688021 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 12:46:00.688021 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 12:46:00.688021 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bf2f6303-22b9-4cfa-8d4d-61d2503bc554 could not be found. May 26 12:46:00.688021 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi May 26 12:46:00.689274 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi [None req-aa486021-f770-4319-881f-31d5878f42ea tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Returning 404 to user: Instance bf2f6303-22b9-4cfa-8d4d-61d2503bc554 could not be found. {{(pid=129321) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 12:46:00.689274 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: INFO nova.api.openstack.requestlog [None req-aa486021-f770-4319-881f-31d5878f42ea tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] 10.222.0.75 "GET /compute/v2.1/servers/bf2f6303-22b9-4cfa-8d4d-61d2503bc554" status: 404 len: 111 microversion: 2.20 time: 0.036967 May 26 12:46:00.689274 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: [pid: 129321|app: 0|req: 399/820] 10.222.0.75 () {60 vars in 1276 bytes} [Thu May 26 12:46:00 2022] GET /compute/v2.1/servers/bf2f6303-22b9-4cfa-8d4d-61d2503bc554 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 26 12:46:00.695986 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi [None req-4701b6bf-2958-49ce-83b0-5714d917df15 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Calling method '.version_select at 0x7f8308146e50>' {{(pid=129322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:46:00.723941 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: INFO nova.api.openstack.requestlog [None req-4701b6bf-2958-49ce-83b0-5714d917df15 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] 10.222.0.75 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1183200903" status: 204 len: 0 microversion: 2.20 time: 0.031790 May 26 12:46:00.724541 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: [pid: 129322|app: 0|req: 422/821] 10.222.0.75 () {60 vars in 1261 bytes} [Thu May 26 12:46:00 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1183200903 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) May 26 12:46:01.012203 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi [None req-f681348e-662a-491f-a969-f2f80ba72d69 tempest-TestVolumeBootPattern-1304354335 tempest-TestVolumeBootPattern-1304354335-project] Calling method '>' {{(pid=129321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:46:01.012907 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.compute.api [None req-f681348e-662a-491f-a969-f2f80ba72d69 tempest-TestVolumeBootPattern-1304354335 tempest-TestVolumeBootPattern-1304354335-project] [instance: 475179d2-21d7-4ace-90eb-e6525cb14928] Fetching instance by UUID {{(pid=129321) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:46:01.020013 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-f681348e-662a-491f-a969-f2f80ba72d69 tempest-TestVolumeBootPattern-1304354335 tempest-TestVolumeBootPattern-1304354335-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:46:01.020544 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-f681348e-662a-491f-a969-f2f80ba72d69 tempest-TestVolumeBootPattern-1304354335 tempest-TestVolumeBootPattern-1304354335-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:46:01.021400 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-f681348e-662a-491f-a969-f2f80ba72d69 tempest-TestVolumeBootPattern-1304354335 tempest-TestVolumeBootPattern-1304354335-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:46:01.021894 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-f681348e-662a-491f-a969-f2f80ba72d69 tempest-TestVolumeBootPattern-1304354335 tempest-TestVolumeBootPattern-1304354335-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:46:01.028197 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG dbcounter [-] [129321] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=129321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:46:01.204688 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.policy [None req-f681348e-662a-491f-a969-f2f80ba72d69 tempest-TestVolumeBootPattern-1304354335 tempest-TestVolumeBootPattern-1304354335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab469b18ce0444d9884cdddc34ef7247', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fb41c547884511893b768b833f4e90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129321) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:46:01.214581 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: INFO nova.api.openstack.requestlog [None req-f681348e-662a-491f-a969-f2f80ba72d69 tempest-TestVolumeBootPattern-1304354335 tempest-TestVolumeBootPattern-1304354335-project] 10.222.0.75 "GET /compute/v2.1/servers/475179d2-21d7-4ace-90eb-e6525cb14928" status: 200 len: 1266 microversion: 2.1 time: 0.206487 May 26 12:46:01.215395 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: [pid: 129321|app: 0|req: 400/822] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 26 12:46:01 2022] GET /compute/v2.1/servers/475179d2-21d7-4ace-90eb-e6525cb14928 => generated 1266 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:46:01.336415 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi [None req-896b2739-7256-4d50-aaee-8d07f0516dcf tempest-TestMinimumBasicScenario-102576986 tempest-TestMinimumBasicScenario-102576986-project] Calling method '>' {{(pid=129322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:46:01.338164 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.compute.api [None req-896b2739-7256-4d50-aaee-8d07f0516dcf tempest-TestMinimumBasicScenario-102576986 tempest-TestMinimumBasicScenario-102576986-project] [instance: 76661008-e6d3-4646-a9ba-d5d0e83a4b65] Fetching instance by UUID {{(pid=129322) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:46:01.350049 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-896b2739-7256-4d50-aaee-8d07f0516dcf tempest-TestMinimumBasicScenario-102576986 tempest-TestMinimumBasicScenario-102576986-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:46:01.351367 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-896b2739-7256-4d50-aaee-8d07f0516dcf tempest-TestMinimumBasicScenario-102576986 tempest-TestMinimumBasicScenario-102576986-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:46:01.353191 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-896b2739-7256-4d50-aaee-8d07f0516dcf tempest-TestMinimumBasicScenario-102576986 tempest-TestMinimumBasicScenario-102576986-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:46:01.354440 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-896b2739-7256-4d50-aaee-8d07f0516dcf tempest-TestMinimumBasicScenario-102576986 tempest-TestMinimumBasicScenario-102576986-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:46:01.650479 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi [None req-eab71c33-732c-4638-860a-c40e2266ea0c tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Action: 'create', calling method: .version_select at 0x7f82fbf489d0>, body: {"keypair": {"name": "tempest-keypair-1648631296", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFw5XRIKAdBbLx2J72++/yHIS/aL0Zg7x4ZIIibTztgAlTxEZW3tMpAtD/Wqdh9a6+vxuX8TYFc5pQ4W9EA++Ah9HhGMTdv0/G95IJIS08PCwoJJiBQCUhcCPGiWItSZ0w=="}} {{(pid=129321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 12:46:01.652320 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.policy [None req-896b2739-7256-4d50-aaee-8d07f0516dcf tempest-TestMinimumBasicScenario-102576986 tempest-TestMinimumBasicScenario-102576986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0352a80bdc174b9a9df4eca60b81eba4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fa2c4d6423444e487d259062656129b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129322) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:46:01.661859 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: INFO nova.api.openstack.requestlog [None req-896b2739-7256-4d50-aaee-8d07f0516dcf tempest-TestMinimumBasicScenario-102576986 tempest-TestMinimumBasicScenario-102576986-project] 10.222.0.75 "GET /compute/v2.1/servers/76661008-e6d3-4646-a9ba-d5d0e83a4b65" status: 200 len: 1755 microversion: 2.1 time: 0.332557 May 26 12:46:01.663096 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: [pid: 129322|app: 0|req: 423/823] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 26 12:46:01 2022] GET /compute/v2.1/servers/76661008-e6d3-4646-a9ba-d5d0e83a4b65 => generated 1755 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:46:01.672404 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.quota [None req-eab71c33-732c-4638-860a-c40e2266ea0c tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Getting quotas for project 2675272fb40d4847819f83ec04afecef. Resources: {'key_pairs'} {{(pid=129321) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 26 12:46:01.678351 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.quota [None req-eab71c33-732c-4638-860a-c40e2266ea0c tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Getting quotas for user e811736979c44b02b14fecb74c6bd7ab and project 2675272fb40d4847819f83ec04afecef. Resources: {'key_pairs'} {{(pid=129321) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 26 12:46:01.708816 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: INFO nova.api.openstack.requestlog [None req-eab71c33-732c-4638-860a-c40e2266ea0c tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] 10.222.0.75 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.063837 May 26 12:46:01.708816 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: [pid: 129321|app: 0|req: 401/824] 10.222.0.75 () {62 vars in 1199 bytes} [Thu May 26 12:46:01 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 66 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) May 26 12:46:02.232456 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi [None req-a306f044-8fc2-4920-afc7-a2aca1bdb17f tempest-TestVolumeBootPattern-1304354335 tempest-TestVolumeBootPattern-1304354335-project] Calling method '>' {{(pid=129322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:46:02.233077 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.compute.api [None req-a306f044-8fc2-4920-afc7-a2aca1bdb17f tempest-TestVolumeBootPattern-1304354335 tempest-TestVolumeBootPattern-1304354335-project] [instance: 475179d2-21d7-4ace-90eb-e6525cb14928] Fetching instance by UUID {{(pid=129322) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:46:02.239701 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-a306f044-8fc2-4920-afc7-a2aca1bdb17f tempest-TestVolumeBootPattern-1304354335 tempest-TestVolumeBootPattern-1304354335-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:46:02.240167 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-a306f044-8fc2-4920-afc7-a2aca1bdb17f tempest-TestVolumeBootPattern-1304354335 tempest-TestVolumeBootPattern-1304354335-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:46:02.240940 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-a306f044-8fc2-4920-afc7-a2aca1bdb17f tempest-TestVolumeBootPattern-1304354335 tempest-TestVolumeBootPattern-1304354335-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:46:02.241405 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-a306f044-8fc2-4920-afc7-a2aca1bdb17f tempest-TestVolumeBootPattern-1304354335 tempest-TestVolumeBootPattern-1304354335-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:46:02.465210 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.policy [None req-a306f044-8fc2-4920-afc7-a2aca1bdb17f tempest-TestVolumeBootPattern-1304354335 tempest-TestVolumeBootPattern-1304354335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab469b18ce0444d9884cdddc34ef7247', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fb41c547884511893b768b833f4e90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129322) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:46:02.474599 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: INFO nova.api.openstack.requestlog [None req-a306f044-8fc2-4920-afc7-a2aca1bdb17f tempest-TestVolumeBootPattern-1304354335 tempest-TestVolumeBootPattern-1304354335-project] 10.222.0.75 "GET /compute/v2.1/servers/475179d2-21d7-4ace-90eb-e6525cb14928" status: 200 len: 1266 microversion: 2.1 time: 0.246033 May 26 12:46:02.475383 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: [pid: 129322|app: 0|req: 424/825] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 26 12:46:02 2022] GET /compute/v2.1/servers/475179d2-21d7-4ace-90eb-e6525cb14928 => generated 1266 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:46:02.628524 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi [req-31a3ef86-5abe-4584-a007-3cadfb415da8 req-34a7f74d-584a-46c3-a4c0-3844632d61c5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "475179d2-21d7-4ace-90eb-e6525cb14928", "name": "network-vif-plugged", "status": "completed", "tag": "ee0c6b40-1d57-4fbb-97a8-db624e2f3d50"}]} {{(pid=129321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 12:46:02.643113 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [req-31a3ef86-5abe-4584-a007-3cadfb415da8 req-34a7f74d-584a-46c3-a4c0-3844632d61c5 service nova] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:46:02.644190 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [req-31a3ef86-5abe-4584-a007-3cadfb415da8 req-34a7f74d-584a-46c3-a4c0-3844632d61c5 service nova] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:46:02.666124 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: INFO nova.api.openstack.compute.server_external_events [req-31a3ef86-5abe-4584-a007-3cadfb415da8 req-34a7f74d-584a-46c3-a4c0-3844632d61c5 service nova] Creating event network-vif-plugged:ee0c6b40-1d57-4fbb-97a8-db624e2f3d50 for instance 475179d2-21d7-4ace-90eb-e6525cb14928 on hv-cinder-81966 May 26 12:46:02.674614 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: INFO nova.api.openstack.requestlog [req-31a3ef86-5abe-4584-a007-3cadfb415da8 req-34a7f74d-584a-46c3-a4c0-3844632d61c5 service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052489 May 26 12:46:02.676686 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: [pid: 129321|app: 0|req: 402/826] 10.222.0.75 () {64 vars in 1317 bytes} [Thu May 26 12:46:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 12:46:02.684322 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi [None req-a263b9e0-a6e6-4298-960d-a897ee6f10cd tempest-TestMinimumBasicScenario-102576986 tempest-TestMinimumBasicScenario-102576986-project] Calling method '>' {{(pid=129322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:46:02.685325 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.compute.api [None req-a263b9e0-a6e6-4298-960d-a897ee6f10cd tempest-TestMinimumBasicScenario-102576986 tempest-TestMinimumBasicScenario-102576986-project] [instance: 76661008-e6d3-4646-a9ba-d5d0e83a4b65] Fetching instance by UUID {{(pid=129322) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:46:02.702290 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-a263b9e0-a6e6-4298-960d-a897ee6f10cd tempest-TestMinimumBasicScenario-102576986 tempest-TestMinimumBasicScenario-102576986-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:46:02.703286 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-a263b9e0-a6e6-4298-960d-a897ee6f10cd tempest-TestMinimumBasicScenario-102576986 tempest-TestMinimumBasicScenario-102576986-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:46:02.704412 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-a263b9e0-a6e6-4298-960d-a897ee6f10cd tempest-TestMinimumBasicScenario-102576986 tempest-TestMinimumBasicScenario-102576986-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:46:02.705081 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-a263b9e0-a6e6-4298-960d-a897ee6f10cd tempest-TestMinimumBasicScenario-102576986 tempest-TestMinimumBasicScenario-102576986-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:46:02.970371 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.policy [None req-a263b9e0-a6e6-4298-960d-a897ee6f10cd tempest-TestMinimumBasicScenario-102576986 tempest-TestMinimumBasicScenario-102576986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0352a80bdc174b9a9df4eca60b81eba4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fa2c4d6423444e487d259062656129b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129322) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:46:02.979810 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: INFO nova.api.openstack.requestlog [None req-a263b9e0-a6e6-4298-960d-a897ee6f10cd tempest-TestMinimumBasicScenario-102576986 tempest-TestMinimumBasicScenario-102576986-project] 10.222.0.75 "GET /compute/v2.1/servers/76661008-e6d3-4646-a9ba-d5d0e83a4b65" status: 200 len: 1758 microversion: 2.1 time: 0.303792 May 26 12:46:02.992202 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: [pid: 129322|app: 0|req: 425/827] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 26 12:46:02 2022] GET /compute/v2.1/servers/76661008-e6d3-4646-a9ba-d5d0e83a4b65 => generated 1758 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 12:46:03.327014 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi [None req-32ac757f-acf2-4d4f-af79-43eae84a7bac tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1510851183", "imageRef": "1e3c323d-d797-4e6d-bd9a-482d90084b0c", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "ab4fbad5-47b6-41f0-b9ab-c8045af65685"}], "security_groups": [{"name": "tempest-securitygroup--1576634262"}], "key_name": "tempest-keypair-1648631296", "user_data": "}} {{(pid=129321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 12:46:03.432355 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.network.neutron [None req-32ac757f-acf2-4d4f-af79-43eae84a7bac tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] validate_networks() for [('ab4fbad5-47b6-41f0-b9ab-c8045af65685', None, None, None, None, None)] {{(pid=129321) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 26 12:46:03.492508 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi [None req-eabe00f9-bf77-4158-bee5-9415d9868181 tempest-TestVolumeBootPattern-1304354335 tempest-TestVolumeBootPattern-1304354335-project] Calling method '>' {{(pid=129322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:46:03.493116 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.compute.api [None req-eabe00f9-bf77-4158-bee5-9415d9868181 tempest-TestVolumeBootPattern-1304354335 tempest-TestVolumeBootPattern-1304354335-project] [instance: 475179d2-21d7-4ace-90eb-e6525cb14928] Fetching instance by UUID {{(pid=129322) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:46:03.500113 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-eabe00f9-bf77-4158-bee5-9415d9868181 tempest-TestVolumeBootPattern-1304354335 tempest-TestVolumeBootPattern-1304354335-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:46:03.500538 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-eabe00f9-bf77-4158-bee5-9415d9868181 tempest-TestVolumeBootPattern-1304354335 tempest-TestVolumeBootPattern-1304354335-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:46:03.501322 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-eabe00f9-bf77-4158-bee5-9415d9868181 tempest-TestVolumeBootPattern-1304354335 tempest-TestVolumeBootPattern-1304354335-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:46:03.501757 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-eabe00f9-bf77-4158-bee5-9415d9868181 tempest-TestVolumeBootPattern-1304354335 tempest-TestVolumeBootPattern-1304354335-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:46:03.640584 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.policy [None req-eabe00f9-bf77-4158-bee5-9415d9868181 tempest-TestVolumeBootPattern-1304354335 tempest-TestVolumeBootPattern-1304354335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab469b18ce0444d9884cdddc34ef7247', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fb41c547884511893b768b833f4e90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129322) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:46:03.650581 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: INFO nova.api.openstack.requestlog [None req-eabe00f9-bf77-4158-bee5-9415d9868181 tempest-TestVolumeBootPattern-1304354335 tempest-TestVolumeBootPattern-1304354335-project] 10.222.0.75 "GET /compute/v2.1/servers/475179d2-21d7-4ace-90eb-e6525cb14928" status: 200 len: 1266 microversion: 2.1 time: 0.162019 May 26 12:46:03.651238 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: [pid: 129322|app: 0|req: 426/828] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 26 12:46:03 2022] GET /compute/v2.1/servers/475179d2-21d7-4ace-90eb-e6525cb14928 => generated 1266 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:46:03.823524 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.virt.hardware [None req-32ac757f-acf2-4d4f-af79-43eae84a7bac tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Flavor limits 0:0:0 {{(pid=129321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 26 12:46:03.824049 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.virt.hardware [None req-32ac757f-acf2-4d4f-af79-43eae84a7bac tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Image limits 0:0:0 {{(pid=129321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 26 12:46:03.824435 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.virt.hardware [None req-32ac757f-acf2-4d4f-af79-43eae84a7bac tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Flavor pref 0:0:0 {{(pid=129321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 26 12:46:03.824842 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.virt.hardware [None req-32ac757f-acf2-4d4f-af79-43eae84a7bac tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Image pref 0:0:0 {{(pid=129321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 26 12:46:03.825249 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.virt.hardware [None req-32ac757f-acf2-4d4f-af79-43eae84a7bac tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 26 12:46:03.835681 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-32ac757f-acf2-4d4f-af79-43eae84a7bac tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:46:03.836154 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-32ac757f-acf2-4d4f-af79-43eae84a7bac tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:46:03.836996 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-32ac757f-acf2-4d4f-af79-43eae84a7bac tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:46:03.837429 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-32ac757f-acf2-4d4f-af79-43eae84a7bac tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:46:03.854761 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.quota [None req-32ac757f-acf2-4d4f-af79-43eae84a7bac tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Getting quotas for project 2675272fb40d4847819f83ec04afecef. Resources: {'instances', 'cores', 'ram'} {{(pid=129321) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 26 12:46:03.858900 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.quota [None req-32ac757f-acf2-4d4f-af79-43eae84a7bac tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Getting quotas for user e811736979c44b02b14fecb74c6bd7ab and project 2675272fb40d4847819f83ec04afecef. Resources: {'instances', 'cores', 'ram'} {{(pid=129321) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 26 12:46:03.870491 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.compute.api [None req-32ac757f-acf2-4d4f-af79-43eae84a7bac tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Going to run 1 instances... {{(pid=129321) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 26 12:46:03.873363 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.compute.api [None req-32ac757f-acf2-4d4f-af79-43eae84a7bac tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] [instance: f44f180b-9143-43d6-b9cd-ced0c42fd928] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1e3c323d-d797-4e6d-bd9a-482d90084b0c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129321) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 26 12:46:03.920488 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: INFO nova.api.openstack.requestlog [None req-32ac757f-acf2-4d4f-af79-43eae84a7bac tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] 10.222.0.75 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 0.598204 May 26 12:46:03.921054 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: [pid: 129321|app: 0|req: 403/829] 10.222.0.75 () {62 vars in 1187 bytes} [Thu May 26 12:46:03 2022] POST /compute/v2.1/servers => generated 402 bytes in 600 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) May 26 12:46:03.932774 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi [None req-97562cee-4d08-451a-9996-14d7e5160fce tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Calling method '>' {{(pid=129322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:46:03.933410 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.compute.api [None req-97562cee-4d08-451a-9996-14d7e5160fce tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] [instance: f44f180b-9143-43d6-b9cd-ced0c42fd928] Fetching instance by UUID {{(pid=129322) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:46:03.990323 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.policy [None req-97562cee-4d08-451a-9996-14d7e5160fce tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e811736979c44b02b14fecb74c6bd7ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675272fb40d4847819f83ec04afecef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129322) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:46:03.997797 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.policy [None req-97562cee-4d08-451a-9996-14d7e5160fce tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e811736979c44b02b14fecb74c6bd7ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675272fb40d4847819f83ec04afecef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129322) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:46:03.999332 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.policy [None req-97562cee-4d08-451a-9996-14d7e5160fce tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e811736979c44b02b14fecb74c6bd7ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675272fb40d4847819f83ec04afecef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129322) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:46:04.000468 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: INFO nova.api.openstack.requestlog [None req-97562cee-4d08-451a-9996-14d7e5160fce tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] 10.222.0.75 "GET /compute/v2.1/servers/f44f180b-9143-43d6-b9cd-ced0c42fd928" status: 200 len: 1282 microversion: 2.20 time: 0.072409 May 26 12:46:04.001032 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: [pid: 129322|app: 0|req: 427/830] 10.222.0.75 () {60 vars in 1276 bytes} [Thu May 26 12:46:03 2022] GET /compute/v2.1/servers/f44f180b-9143-43d6-b9cd-ced0c42fd928 => generated 1282 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 12:46:04.668282 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi [None req-65f6529e-2917-4707-ac2f-1866bff4c844 tempest-TestVolumeBootPattern-1304354335 tempest-TestVolumeBootPattern-1304354335-project] Calling method '>' {{(pid=129321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:46:04.668897 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.compute.api [None req-65f6529e-2917-4707-ac2f-1866bff4c844 tempest-TestVolumeBootPattern-1304354335 tempest-TestVolumeBootPattern-1304354335-project] [instance: 475179d2-21d7-4ace-90eb-e6525cb14928] Fetching instance by UUID {{(pid=129321) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:46:04.676311 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-65f6529e-2917-4707-ac2f-1866bff4c844 tempest-TestVolumeBootPattern-1304354335 tempest-TestVolumeBootPattern-1304354335-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:46:04.676762 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-65f6529e-2917-4707-ac2f-1866bff4c844 tempest-TestVolumeBootPattern-1304354335 tempest-TestVolumeBootPattern-1304354335-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:46:04.677621 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-65f6529e-2917-4707-ac2f-1866bff4c844 tempest-TestVolumeBootPattern-1304354335 tempest-TestVolumeBootPattern-1304354335-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:46:04.678081 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-65f6529e-2917-4707-ac2f-1866bff4c844 tempest-TestVolumeBootPattern-1304354335 tempest-TestVolumeBootPattern-1304354335-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:46:04.817118 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.policy [None req-65f6529e-2917-4707-ac2f-1866bff4c844 tempest-TestVolumeBootPattern-1304354335 tempest-TestVolumeBootPattern-1304354335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab469b18ce0444d9884cdddc34ef7247', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fb41c547884511893b768b833f4e90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129321) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:46:04.825323 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: INFO nova.api.openstack.requestlog [None req-65f6529e-2917-4707-ac2f-1866bff4c844 tempest-TestVolumeBootPattern-1304354335 tempest-TestVolumeBootPattern-1304354335-project] 10.222.0.75 "GET /compute/v2.1/servers/475179d2-21d7-4ace-90eb-e6525cb14928" status: 200 len: 1454 microversion: 2.1 time: 0.161504 May 26 12:46:04.825964 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: [pid: 129321|app: 0|req: 404/831] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 26 12:46:04 2022] GET /compute/v2.1/servers/475179d2-21d7-4ace-90eb-e6525cb14928 => generated 1454 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:46:04.841567 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi [None req-d46d15a3-f5dd-4cd7-b8ae-fae2f0adb7ee tempest-TestVolumeBootPattern-1304354335 tempest-TestVolumeBootPattern-1304354335-project] Calling method '>' {{(pid=129322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:46:04.842145 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.compute.api [None req-d46d15a3-f5dd-4cd7-b8ae-fae2f0adb7ee tempest-TestVolumeBootPattern-1304354335 tempest-TestVolumeBootPattern-1304354335-project] [instance: 475179d2-21d7-4ace-90eb-e6525cb14928] Fetching instance by UUID {{(pid=129322) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:46:04.849284 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-d46d15a3-f5dd-4cd7-b8ae-fae2f0adb7ee tempest-TestVolumeBootPattern-1304354335 tempest-TestVolumeBootPattern-1304354335-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:46:04.849730 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-d46d15a3-f5dd-4cd7-b8ae-fae2f0adb7ee tempest-TestVolumeBootPattern-1304354335 tempest-TestVolumeBootPattern-1304354335-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:46:04.850489 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-d46d15a3-f5dd-4cd7-b8ae-fae2f0adb7ee tempest-TestVolumeBootPattern-1304354335 tempest-TestVolumeBootPattern-1304354335-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:46:04.850918 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-d46d15a3-f5dd-4cd7-b8ae-fae2f0adb7ee tempest-TestVolumeBootPattern-1304354335 tempest-TestVolumeBootPattern-1304354335-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:46:04.985117 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.policy [None req-d46d15a3-f5dd-4cd7-b8ae-fae2f0adb7ee tempest-TestVolumeBootPattern-1304354335 tempest-TestVolumeBootPattern-1304354335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab469b18ce0444d9884cdddc34ef7247', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fb41c547884511893b768b833f4e90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129322) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:46:04.993777 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: INFO nova.api.openstack.requestlog [None req-d46d15a3-f5dd-4cd7-b8ae-fae2f0adb7ee tempest-TestVolumeBootPattern-1304354335 tempest-TestVolumeBootPattern-1304354335-project] 10.222.0.75 "GET /compute/v2.1/servers/475179d2-21d7-4ace-90eb-e6525cb14928" status: 200 len: 1454 microversion: 2.1 time: 0.155972 May 26 12:46:04.994588 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: [pid: 129322|app: 0|req: 428/832] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 26 12:46:04 2022] GET /compute/v2.1/servers/475179d2-21d7-4ace-90eb-e6525cb14928 => generated 1454 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:46:05.023646 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi [None req-af03556a-5bca-418c-8241-48c5103af7f8 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Calling method '>' {{(pid=129321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:46:05.024669 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.compute.api [None req-af03556a-5bca-418c-8241-48c5103af7f8 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] [instance: f44f180b-9143-43d6-b9cd-ced0c42fd928] Fetching instance by UUID {{(pid=129321) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:46:05.036490 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-af03556a-5bca-418c-8241-48c5103af7f8 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:46:05.037281 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-af03556a-5bca-418c-8241-48c5103af7f8 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:46:05.038188 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-af03556a-5bca-418c-8241-48c5103af7f8 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:46:05.040588 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-af03556a-5bca-418c-8241-48c5103af7f8 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:46:05.112481 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.policy [None req-af03556a-5bca-418c-8241-48c5103af7f8 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e811736979c44b02b14fecb74c6bd7ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675272fb40d4847819f83ec04afecef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129321) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:46:05.121477 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.policy [None req-af03556a-5bca-418c-8241-48c5103af7f8 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e811736979c44b02b14fecb74c6bd7ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675272fb40d4847819f83ec04afecef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129321) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:46:05.123078 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.policy [None req-af03556a-5bca-418c-8241-48c5103af7f8 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e811736979c44b02b14fecb74c6bd7ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675272fb40d4847819f83ec04afecef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129321) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:46:05.124318 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: INFO nova.api.openstack.requestlog [None req-af03556a-5bca-418c-8241-48c5103af7f8 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] 10.222.0.75 "GET /compute/v2.1/servers/f44f180b-9143-43d6-b9cd-ced0c42fd928" status: 200 len: 1278 microversion: 2.20 time: 0.109687 May 26 12:46:05.124908 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: [pid: 129321|app: 0|req: 405/833] 10.222.0.75 () {60 vars in 1276 bytes} [Thu May 26 12:46:05 2022] GET /compute/v2.1/servers/f44f180b-9143-43d6-b9cd-ced0c42fd928 => generated 1278 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 12:46:06.143760 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi [None req-38f2b6dc-5d29-41ab-a238-9ec669bde459 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Calling method '>' {{(pid=129322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:46:06.144399 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.compute.api [None req-38f2b6dc-5d29-41ab-a238-9ec669bde459 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] [instance: f44f180b-9143-43d6-b9cd-ced0c42fd928] Fetching instance by UUID {{(pid=129322) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:46:06.154098 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-38f2b6dc-5d29-41ab-a238-9ec669bde459 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:46:06.158038 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-38f2b6dc-5d29-41ab-a238-9ec669bde459 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:46:06.160594 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-38f2b6dc-5d29-41ab-a238-9ec669bde459 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:46:06.161233 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-38f2b6dc-5d29-41ab-a238-9ec669bde459 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:46:06.283712 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.policy [None req-38f2b6dc-5d29-41ab-a238-9ec669bde459 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e811736979c44b02b14fecb74c6bd7ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675272fb40d4847819f83ec04afecef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129322) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:46:06.293583 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.policy [None req-38f2b6dc-5d29-41ab-a238-9ec669bde459 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e811736979c44b02b14fecb74c6bd7ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675272fb40d4847819f83ec04afecef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129322) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:46:06.295300 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.policy [None req-38f2b6dc-5d29-41ab-a238-9ec669bde459 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e811736979c44b02b14fecb74c6bd7ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675272fb40d4847819f83ec04afecef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129322) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:46:06.296518 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: INFO nova.api.openstack.requestlog [None req-38f2b6dc-5d29-41ab-a238-9ec669bde459 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] 10.222.0.75 "GET /compute/v2.1/servers/f44f180b-9143-43d6-b9cd-ced0c42fd928" status: 200 len: 1340 microversion: 2.20 time: 0.158092 May 26 12:46:06.297102 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: [pid: 129322|app: 0|req: 429/834] 10.222.0.75 () {60 vars in 1276 bytes} [Thu May 26 12:46:06 2022] GET /compute/v2.1/servers/f44f180b-9143-43d6-b9cd-ced0c42fd928 => generated 1340 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 12:46:07.183855 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi [req-f07b3470-b858-47a6-b214-2e3a4e19bd94 req-da4580b3-b77a-46c1-9967-f714cba75e0b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "475179d2-21d7-4ace-90eb-e6525cb14928", "tag": "ee0c6b40-1d57-4fbb-97a8-db624e2f3d50"}]} {{(pid=129321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 12:46:07.200998 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [req-f07b3470-b858-47a6-b214-2e3a4e19bd94 req-da4580b3-b77a-46c1-9967-f714cba75e0b service nova] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:46:07.202602 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [req-f07b3470-b858-47a6-b214-2e3a4e19bd94 req-da4580b3-b77a-46c1-9967-f714cba75e0b service nova] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:46:07.217658 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: INFO nova.api.openstack.compute.server_external_events [req-f07b3470-b858-47a6-b214-2e3a4e19bd94 req-da4580b3-b77a-46c1-9967-f714cba75e0b service nova] Creating event network-changed:ee0c6b40-1d57-4fbb-97a8-db624e2f3d50 for instance 475179d2-21d7-4ace-90eb-e6525cb14928 on hv-cinder-81966 May 26 12:46:07.223931 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: INFO nova.api.openstack.requestlog [req-f07b3470-b858-47a6-b214-2e3a4e19bd94 req-da4580b3-b77a-46c1-9967-f714cba75e0b service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045037 May 26 12:46:07.225121 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: [pid: 129321|app: 0|req: 406/835] 10.222.0.75 () {64 vars in 1317 bytes} [Thu May 26 12:46:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 26 12:46:07.314477 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi [None req-e648ad93-4cf9-4298-a6fb-a8a6ffc19bdb tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Calling method '>' {{(pid=129322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:46:07.315848 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.compute.api [None req-e648ad93-4cf9-4298-a6fb-a8a6ffc19bdb tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] [instance: f44f180b-9143-43d6-b9cd-ced0c42fd928] Fetching instance by UUID {{(pid=129322) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:46:07.326702 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-e648ad93-4cf9-4298-a6fb-a8a6ffc19bdb tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:46:07.327453 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-e648ad93-4cf9-4298-a6fb-a8a6ffc19bdb tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:46:07.328453 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-e648ad93-4cf9-4298-a6fb-a8a6ffc19bdb tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:46:07.329037 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-e648ad93-4cf9-4298-a6fb-a8a6ffc19bdb tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:46:07.503047 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.policy [None req-e648ad93-4cf9-4298-a6fb-a8a6ffc19bdb tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e811736979c44b02b14fecb74c6bd7ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675272fb40d4847819f83ec04afecef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129322) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:46:07.514651 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.policy [None req-e648ad93-4cf9-4298-a6fb-a8a6ffc19bdb tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e811736979c44b02b14fecb74c6bd7ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675272fb40d4847819f83ec04afecef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129322) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:46:07.516435 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.policy [None req-e648ad93-4cf9-4298-a6fb-a8a6ffc19bdb tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e811736979c44b02b14fecb74c6bd7ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675272fb40d4847819f83ec04afecef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129322) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:46:07.517809 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: INFO nova.api.openstack.requestlog [None req-e648ad93-4cf9-4298-a6fb-a8a6ffc19bdb tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] 10.222.0.75 "GET /compute/v2.1/servers/f44f180b-9143-43d6-b9cd-ced0c42fd928" status: 200 len: 1408 microversion: 2.20 time: 0.207274 May 26 12:46:07.518589 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: [pid: 129322|app: 0|req: 430/836] 10.222.0.75 () {60 vars in 1276 bytes} [Thu May 26 12:46:07 2022] GET /compute/v2.1/servers/f44f180b-9143-43d6-b9cd-ced0c42fd928 => generated 1408 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 12:46:07.666289 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi [req-f6db89ad-e143-4de1-91f0-f060ea4f8b7b req-3f99eae4-e38e-4ad8-8645-3b25ffadd03d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f44f180b-9143-43d6-b9cd-ced0c42fd928", "tag": "f9559056-2d17-4245-b9b6-e29db32c9ee2"}]} {{(pid=129321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 12:46:07.708817 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [req-f6db89ad-e143-4de1-91f0-f060ea4f8b7b req-3f99eae4-e38e-4ad8-8645-3b25ffadd03d service nova] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:46:07.714455 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [req-f6db89ad-e143-4de1-91f0-f060ea4f8b7b req-3f99eae4-e38e-4ad8-8645-3b25ffadd03d service nova] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:46:07.734928 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: INFO nova.api.openstack.compute.server_external_events [req-f6db89ad-e143-4de1-91f0-f060ea4f8b7b req-3f99eae4-e38e-4ad8-8645-3b25ffadd03d service nova] Creating event network-changed:f9559056-2d17-4245-b9b6-e29db32c9ee2 for instance f44f180b-9143-43d6-b9cd-ced0c42fd928 on hv-cinder-81966 May 26 12:46:07.747402 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: INFO nova.api.openstack.requestlog [req-f6db89ad-e143-4de1-91f0-f060ea4f8b7b req-3f99eae4-e38e-4ad8-8645-3b25ffadd03d service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.089325 May 26 12:46:07.752837 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: [pid: 129321|app: 0|req: 407/837] 10.222.0.75 () {64 vars in 1317 bytes} [Thu May 26 12:46:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 12:46:08.541433 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi [None req-c0cee683-1819-454d-bd62-8cc590f6f3af tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Calling method '>' {{(pid=129322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:46:08.542034 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.compute.api [None req-c0cee683-1819-454d-bd62-8cc590f6f3af tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] [instance: f44f180b-9143-43d6-b9cd-ced0c42fd928] Fetching instance by UUID {{(pid=129322) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:46:08.549645 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-c0cee683-1819-454d-bd62-8cc590f6f3af tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:46:08.550093 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-c0cee683-1819-454d-bd62-8cc590f6f3af tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:46:08.550878 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-c0cee683-1819-454d-bd62-8cc590f6f3af tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:46:08.551305 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-c0cee683-1819-454d-bd62-8cc590f6f3af tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:46:08.705499 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.policy [None req-c0cee683-1819-454d-bd62-8cc590f6f3af tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e811736979c44b02b14fecb74c6bd7ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675272fb40d4847819f83ec04afecef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129322) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:46:08.714472 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.policy [None req-c0cee683-1819-454d-bd62-8cc590f6f3af tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e811736979c44b02b14fecb74c6bd7ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675272fb40d4847819f83ec04afecef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129322) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:46:08.715993 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.policy [None req-c0cee683-1819-454d-bd62-8cc590f6f3af tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e811736979c44b02b14fecb74c6bd7ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675272fb40d4847819f83ec04afecef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129322) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:46:08.717148 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: INFO nova.api.openstack.requestlog [None req-c0cee683-1819-454d-bd62-8cc590f6f3af tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] 10.222.0.75 "GET /compute/v2.1/servers/f44f180b-9143-43d6-b9cd-ced0c42fd928" status: 200 len: 1408 microversion: 2.20 time: 0.180369 May 26 12:46:08.717734 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: [pid: 129322|app: 0|req: 431/838] 10.222.0.75 () {60 vars in 1276 bytes} [Thu May 26 12:46:08 2022] GET /compute/v2.1/servers/f44f180b-9143-43d6-b9cd-ced0c42fd928 => generated 1408 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 12:46:09.737991 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi [None req-1dcef04c-b15e-4fc0-9363-b7f2253566d8 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Calling method '>' {{(pid=129321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:46:09.738672 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.compute.api [None req-1dcef04c-b15e-4fc0-9363-b7f2253566d8 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] [instance: f44f180b-9143-43d6-b9cd-ced0c42fd928] Fetching instance by UUID {{(pid=129321) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:46:09.745128 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-1dcef04c-b15e-4fc0-9363-b7f2253566d8 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:46:09.745577 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-1dcef04c-b15e-4fc0-9363-b7f2253566d8 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:46:09.746335 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-1dcef04c-b15e-4fc0-9363-b7f2253566d8 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:46:09.746763 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-1dcef04c-b15e-4fc0-9363-b7f2253566d8 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:46:09.887957 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.policy [None req-1dcef04c-b15e-4fc0-9363-b7f2253566d8 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e811736979c44b02b14fecb74c6bd7ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675272fb40d4847819f83ec04afecef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129321) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:46:09.896957 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.policy [None req-1dcef04c-b15e-4fc0-9363-b7f2253566d8 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e811736979c44b02b14fecb74c6bd7ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675272fb40d4847819f83ec04afecef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129321) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:46:09.898462 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.policy [None req-1dcef04c-b15e-4fc0-9363-b7f2253566d8 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e811736979c44b02b14fecb74c6bd7ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675272fb40d4847819f83ec04afecef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129321) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:46:09.899659 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: INFO nova.api.openstack.requestlog [None req-1dcef04c-b15e-4fc0-9363-b7f2253566d8 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] 10.222.0.75 "GET /compute/v2.1/servers/f44f180b-9143-43d6-b9cd-ced0c42fd928" status: 200 len: 1408 microversion: 2.20 time: 0.167442 May 26 12:46:09.900184 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: [pid: 129321|app: 0|req: 408/839] 10.222.0.75 () {60 vars in 1276 bytes} [Thu May 26 12:46:09 2022] GET /compute/v2.1/servers/f44f180b-9143-43d6-b9cd-ced0c42fd928 => generated 1408 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 12:46:10.920069 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi [None req-a7494c2f-4815-463a-9965-68902ac43805 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Calling method '>' {{(pid=129322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:46:10.921044 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.compute.api [None req-a7494c2f-4815-463a-9965-68902ac43805 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] [instance: f44f180b-9143-43d6-b9cd-ced0c42fd928] Fetching instance by UUID {{(pid=129322) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:46:10.929772 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-a7494c2f-4815-463a-9965-68902ac43805 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:46:10.930287 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-a7494c2f-4815-463a-9965-68902ac43805 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:46:10.931079 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-a7494c2f-4815-463a-9965-68902ac43805 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:46:10.931516 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-a7494c2f-4815-463a-9965-68902ac43805 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:46:10.936613 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG dbcounter [-] [129322] Writing DB stats nova_cell1:SELECT=100 {{(pid=129322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:46:11.082693 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.policy [None req-a7494c2f-4815-463a-9965-68902ac43805 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e811736979c44b02b14fecb74c6bd7ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675272fb40d4847819f83ec04afecef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129322) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:46:11.092974 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.policy [None req-a7494c2f-4815-463a-9965-68902ac43805 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e811736979c44b02b14fecb74c6bd7ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675272fb40d4847819f83ec04afecef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129322) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:46:11.094491 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.policy [None req-a7494c2f-4815-463a-9965-68902ac43805 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e811736979c44b02b14fecb74c6bd7ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675272fb40d4847819f83ec04afecef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129322) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:46:11.095782 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: INFO nova.api.openstack.requestlog [None req-a7494c2f-4815-463a-9965-68902ac43805 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] 10.222.0.75 "GET /compute/v2.1/servers/f44f180b-9143-43d6-b9cd-ced0c42fd928" status: 200 len: 1408 microversion: 2.20 time: 0.181034 May 26 12:46:11.096739 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: [pid: 129322|app: 0|req: 432/840] 10.222.0.75 () {60 vars in 1276 bytes} [Thu May 26 12:46:10 2022] GET /compute/v2.1/servers/f44f180b-9143-43d6-b9cd-ced0c42fd928 => generated 1408 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 26 12:46:12.116840 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi [None req-de89eba7-ac40-4a7a-aca9-b29cff58b22c tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Calling method '>' {{(pid=129321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:46:12.117435 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.compute.api [None req-de89eba7-ac40-4a7a-aca9-b29cff58b22c tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] [instance: f44f180b-9143-43d6-b9cd-ced0c42fd928] Fetching instance by UUID {{(pid=129321) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:46:12.124231 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-de89eba7-ac40-4a7a-aca9-b29cff58b22c tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:46:12.124674 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-de89eba7-ac40-4a7a-aca9-b29cff58b22c tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:46:12.125441 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-de89eba7-ac40-4a7a-aca9-b29cff58b22c tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:46:12.125864 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-de89eba7-ac40-4a7a-aca9-b29cff58b22c tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:46:12.268133 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.policy [None req-de89eba7-ac40-4a7a-aca9-b29cff58b22c tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e811736979c44b02b14fecb74c6bd7ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675272fb40d4847819f83ec04afecef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129321) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:46:12.276854 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.policy [None req-de89eba7-ac40-4a7a-aca9-b29cff58b22c tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e811736979c44b02b14fecb74c6bd7ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675272fb40d4847819f83ec04afecef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129321) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:46:12.278390 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.policy [None req-de89eba7-ac40-4a7a-aca9-b29cff58b22c tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e811736979c44b02b14fecb74c6bd7ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675272fb40d4847819f83ec04afecef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129321) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:46:12.279509 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: INFO nova.api.openstack.requestlog [None req-de89eba7-ac40-4a7a-aca9-b29cff58b22c tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] 10.222.0.75 "GET /compute/v2.1/servers/f44f180b-9143-43d6-b9cd-ced0c42fd928" status: 200 len: 1408 microversion: 2.20 time: 0.167148 May 26 12:46:12.280122 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: [pid: 129321|app: 0|req: 409/841] 10.222.0.75 () {60 vars in 1276 bytes} [Thu May 26 12:46:12 2022] GET /compute/v2.1/servers/f44f180b-9143-43d6-b9cd-ced0c42fd928 => generated 1408 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 12:46:13.299149 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi [None req-2c78f132-13d5-45e5-9f16-2f06ed48ffb5 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Calling method '>' {{(pid=129322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:46:13.299875 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.compute.api [None req-2c78f132-13d5-45e5-9f16-2f06ed48ffb5 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] [instance: f44f180b-9143-43d6-b9cd-ced0c42fd928] Fetching instance by UUID {{(pid=129322) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:46:13.307127 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-2c78f132-13d5-45e5-9f16-2f06ed48ffb5 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:46:13.307566 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-2c78f132-13d5-45e5-9f16-2f06ed48ffb5 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:46:13.308414 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-2c78f132-13d5-45e5-9f16-2f06ed48ffb5 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:46:13.309288 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-2c78f132-13d5-45e5-9f16-2f06ed48ffb5 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:46:13.447209 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.policy [None req-2c78f132-13d5-45e5-9f16-2f06ed48ffb5 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e811736979c44b02b14fecb74c6bd7ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675272fb40d4847819f83ec04afecef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129322) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:46:13.455731 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.policy [None req-2c78f132-13d5-45e5-9f16-2f06ed48ffb5 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e811736979c44b02b14fecb74c6bd7ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675272fb40d4847819f83ec04afecef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129322) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:46:13.457678 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.policy [None req-2c78f132-13d5-45e5-9f16-2f06ed48ffb5 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e811736979c44b02b14fecb74c6bd7ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675272fb40d4847819f83ec04afecef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129322) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:46:13.458794 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: INFO nova.api.openstack.requestlog [None req-2c78f132-13d5-45e5-9f16-2f06ed48ffb5 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] 10.222.0.75 "GET /compute/v2.1/servers/f44f180b-9143-43d6-b9cd-ced0c42fd928" status: 200 len: 1408 microversion: 2.20 time: 0.164032 May 26 12:46:13.459365 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: [pid: 129322|app: 0|req: 433/842] 10.222.0.75 () {60 vars in 1276 bytes} [Thu May 26 12:46:13 2022] GET /compute/v2.1/servers/f44f180b-9143-43d6-b9cd-ced0c42fd928 => generated 1408 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 12:46:14.477703 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi [None req-af420463-5efa-4781-96ea-b6a957ae22b7 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Calling method '>' {{(pid=129321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:46:14.478571 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.compute.api [None req-af420463-5efa-4781-96ea-b6a957ae22b7 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] [instance: f44f180b-9143-43d6-b9cd-ced0c42fd928] Fetching instance by UUID {{(pid=129321) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:46:14.480731 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG dbcounter [-] [129321] Writing DB stats nova_cell0:SELECT=2 {{(pid=129321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:46:14.481821 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG dbcounter [-] [129321] Writing DB stats nova_cell0:SELECT=10 {{(pid=129321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:46:14.488876 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-af420463-5efa-4781-96ea-b6a957ae22b7 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:46:14.489412 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-af420463-5efa-4781-96ea-b6a957ae22b7 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:46:14.490195 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-af420463-5efa-4781-96ea-b6a957ae22b7 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:46:14.490630 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-af420463-5efa-4781-96ea-b6a957ae22b7 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:46:14.700553 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.policy [None req-af420463-5efa-4781-96ea-b6a957ae22b7 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e811736979c44b02b14fecb74c6bd7ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675272fb40d4847819f83ec04afecef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129321) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:46:14.712030 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.policy [None req-af420463-5efa-4781-96ea-b6a957ae22b7 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e811736979c44b02b14fecb74c6bd7ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675272fb40d4847819f83ec04afecef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129321) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:46:14.713605 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.policy [None req-af420463-5efa-4781-96ea-b6a957ae22b7 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e811736979c44b02b14fecb74c6bd7ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675272fb40d4847819f83ec04afecef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129321) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:46:14.714924 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: INFO nova.api.openstack.requestlog [None req-af420463-5efa-4781-96ea-b6a957ae22b7 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] 10.222.0.75 "GET /compute/v2.1/servers/f44f180b-9143-43d6-b9cd-ced0c42fd928" status: 200 len: 1408 microversion: 2.20 time: 0.241524 May 26 12:46:14.715966 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: [pid: 129321|app: 0|req: 410/843] 10.222.0.75 () {60 vars in 1276 bytes} [Thu May 26 12:46:14 2022] GET /compute/v2.1/servers/f44f180b-9143-43d6-b9cd-ced0c42fd928 => generated 1408 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 12:46:14.736187 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi [req-f4f850aa-0d3c-4545-9b51-291533fc6abb req-60b6b934-5771-43f3-afb6-68b5a622cb01 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f44f180b-9143-43d6-b9cd-ced0c42fd928", "name": "network-vif-plugged", "status": "completed", "tag": "f9559056-2d17-4245-b9b6-e29db32c9ee2"}]} {{(pid=129322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 12:46:14.742396 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG dbcounter [-] [129322] Writing DB stats nova_cell0:SELECT=2 {{(pid=129322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:46:14.748136 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [req-f4f850aa-0d3c-4545-9b51-291533fc6abb req-60b6b934-5771-43f3-afb6-68b5a622cb01 service nova] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:46:14.749350 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [req-f4f850aa-0d3c-4545-9b51-291533fc6abb req-60b6b934-5771-43f3-afb6-68b5a622cb01 service nova] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:46:14.762893 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: INFO nova.api.openstack.compute.server_external_events [req-f4f850aa-0d3c-4545-9b51-291533fc6abb req-60b6b934-5771-43f3-afb6-68b5a622cb01 service nova] Creating event network-vif-plugged:f9559056-2d17-4245-b9b6-e29db32c9ee2 for instance f44f180b-9143-43d6-b9cd-ced0c42fd928 on hv-cinder-81966 May 26 12:46:14.769980 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: INFO nova.api.openstack.requestlog [req-f4f850aa-0d3c-4545-9b51-291533fc6abb req-60b6b934-5771-43f3-afb6-68b5a622cb01 service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052807 May 26 12:46:14.771085 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: [pid: 129322|app: 0|req: 434/844] 10.222.0.75 () {64 vars in 1317 bytes} [Thu May 26 12:46:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 12:46:15.742599 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi [None req-9ecfd8e6-d49c-488d-bcb4-b95aa1f01047 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Calling method '>' {{(pid=129321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:46:15.743283 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.compute.api [None req-9ecfd8e6-d49c-488d-bcb4-b95aa1f01047 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] [instance: f44f180b-9143-43d6-b9cd-ced0c42fd928] Fetching instance by UUID {{(pid=129321) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:46:15.749997 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-9ecfd8e6-d49c-488d-bcb4-b95aa1f01047 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:46:15.750438 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-9ecfd8e6-d49c-488d-bcb4-b95aa1f01047 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:46:15.751199 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-9ecfd8e6-d49c-488d-bcb4-b95aa1f01047 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:46:15.751654 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-9ecfd8e6-d49c-488d-bcb4-b95aa1f01047 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:46:15.889899 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.policy [None req-9ecfd8e6-d49c-488d-bcb4-b95aa1f01047 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e811736979c44b02b14fecb74c6bd7ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675272fb40d4847819f83ec04afecef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129321) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:46:15.898629 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.policy [None req-9ecfd8e6-d49c-488d-bcb4-b95aa1f01047 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e811736979c44b02b14fecb74c6bd7ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675272fb40d4847819f83ec04afecef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129321) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:46:15.900155 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.policy [None req-9ecfd8e6-d49c-488d-bcb4-b95aa1f01047 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e811736979c44b02b14fecb74c6bd7ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675272fb40d4847819f83ec04afecef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129321) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:46:15.901257 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: INFO nova.api.openstack.requestlog [None req-9ecfd8e6-d49c-488d-bcb4-b95aa1f01047 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] 10.222.0.75 "GET /compute/v2.1/servers/f44f180b-9143-43d6-b9cd-ced0c42fd928" status: 200 len: 1408 microversion: 2.20 time: 0.164826 May 26 12:46:15.901824 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: [pid: 129321|app: 0|req: 411/845] 10.222.0.75 () {60 vars in 1276 bytes} [Thu May 26 12:46:15 2022] GET /compute/v2.1/servers/f44f180b-9143-43d6-b9cd-ced0c42fd928 => generated 1408 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 12:46:16.928887 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi [None req-7bedbb2e-62d4-4ab9-9844-3d4e00d1d859 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Calling method '>' {{(pid=129322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:46:16.928887 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.compute.api [None req-7bedbb2e-62d4-4ab9-9844-3d4e00d1d859 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] [instance: f44f180b-9143-43d6-b9cd-ced0c42fd928] Fetching instance by UUID {{(pid=129322) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:46:16.928887 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG dbcounter [-] [129322] Writing DB stats nova_api:SELECT=80,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=129322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:46:16.933036 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-7bedbb2e-62d4-4ab9-9844-3d4e00d1d859 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:46:16.933491 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-7bedbb2e-62d4-4ab9-9844-3d4e00d1d859 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:46:16.934262 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-7bedbb2e-62d4-4ab9-9844-3d4e00d1d859 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:46:16.934695 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-7bedbb2e-62d4-4ab9-9844-3d4e00d1d859 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:46:17.107455 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.policy [None req-7bedbb2e-62d4-4ab9-9844-3d4e00d1d859 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e811736979c44b02b14fecb74c6bd7ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675272fb40d4847819f83ec04afecef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129322) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:46:17.121661 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.policy [None req-7bedbb2e-62d4-4ab9-9844-3d4e00d1d859 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e811736979c44b02b14fecb74c6bd7ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675272fb40d4847819f83ec04afecef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129322) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:46:17.124418 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.policy [None req-7bedbb2e-62d4-4ab9-9844-3d4e00d1d859 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e811736979c44b02b14fecb74c6bd7ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675272fb40d4847819f83ec04afecef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129322) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:46:17.126137 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: INFO nova.api.openstack.requestlog [None req-7bedbb2e-62d4-4ab9-9844-3d4e00d1d859 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] 10.222.0.75 "GET /compute/v2.1/servers/f44f180b-9143-43d6-b9cd-ced0c42fd928" status: 200 len: 1600 microversion: 2.20 time: 0.208634 May 26 12:46:17.127232 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: [pid: 129322|app: 0|req: 435/846] 10.222.0.75 () {60 vars in 1276 bytes} [Thu May 26 12:46:16 2022] GET /compute/v2.1/servers/f44f180b-9143-43d6-b9cd-ced0c42fd928 => generated 1600 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 12:46:17.145990 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi [None req-80c91bd9-2b4e-48b2-9a0c-6d9f7a807b2f tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Calling method '>' {{(pid=129321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:46:17.146631 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.compute.api [None req-80c91bd9-2b4e-48b2-9a0c-6d9f7a807b2f tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] [instance: f44f180b-9143-43d6-b9cd-ced0c42fd928] Fetching instance by UUID {{(pid=129321) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:46:17.154637 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-80c91bd9-2b4e-48b2-9a0c-6d9f7a807b2f tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:46:17.155930 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-80c91bd9-2b4e-48b2-9a0c-6d9f7a807b2f tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:46:17.157168 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-80c91bd9-2b4e-48b2-9a0c-6d9f7a807b2f tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:46:17.157730 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-80c91bd9-2b4e-48b2-9a0c-6d9f7a807b2f tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:46:17.264217 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: INFO nova.api.openstack.requestlog [None req-80c91bd9-2b4e-48b2-9a0c-6d9f7a807b2f tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] 10.222.0.75 "GET /compute/v2.1/servers/f44f180b-9143-43d6-b9cd-ced0c42fd928/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.122500 May 26 12:46:17.265138 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: [pid: 129321|app: 0|req: 412/847] 10.222.0.75 () {60 vars in 1315 bytes} [Thu May 26 12:46:17 2022] GET /compute/v2.1/servers/f44f180b-9143-43d6-b9cd-ced0c42fd928/os-interface => generated 284 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 26 12:46:18.566055 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi [req-6a592294-c568-4f82-b32b-766f498aef3b req-1cc70841-05dd-40cc-a484-4725d9adef5d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f44f180b-9143-43d6-b9cd-ced0c42fd928", "tag": "f9559056-2d17-4245-b9b6-e29db32c9ee2"}]} {{(pid=129322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 12:46:18.577421 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [req-6a592294-c568-4f82-b32b-766f498aef3b req-1cc70841-05dd-40cc-a484-4725d9adef5d service nova] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:46:18.577990 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [req-6a592294-c568-4f82-b32b-766f498aef3b req-1cc70841-05dd-40cc-a484-4725d9adef5d service nova] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:46:18.590865 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: INFO nova.api.openstack.compute.server_external_events [req-6a592294-c568-4f82-b32b-766f498aef3b req-1cc70841-05dd-40cc-a484-4725d9adef5d service nova] Creating event network-changed:f9559056-2d17-4245-b9b6-e29db32c9ee2 for instance f44f180b-9143-43d6-b9cd-ced0c42fd928 on hv-cinder-81966 May 26 12:46:18.596907 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: INFO nova.api.openstack.requestlog [req-6a592294-c568-4f82-b32b-766f498aef3b req-1cc70841-05dd-40cc-a484-4725d9adef5d service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034654 May 26 12:46:18.597806 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: [pid: 129322|app: 0|req: 436/848] 10.222.0.75 () {64 vars in 1317 bytes} [Thu May 26 12:46:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 12:46:38.698652 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG dbcounter [-] [129321] Writing DB stats nova_api:SELECT=83,nova_api:INSERT=4 {{(pid=129321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:46:38.700017 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG dbcounter [-] [129321] Writing DB stats nova_cell1:SELECT=52 {{(pid=129321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:46:38.706604 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi [None req-87f06758-c129-4b72-bf02-73ed7c7a8a68 tempest-TestShelveInstance-546397589 tempest-TestShelveInstance-546397589-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=129321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 12:46:38.707527 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.compute.api [None req-87f06758-c129-4b72-bf02-73ed7c7a8a68 tempest-TestShelveInstance-546397589 tempest-TestShelveInstance-546397589-project] [instance: 05cf529d-df00-4ff9-b0d2-0e27563d2861] Fetching instance by UUID {{(pid=129321) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:46:38.716097 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-87f06758-c129-4b72-bf02-73ed7c7a8a68 tempest-TestShelveInstance-546397589 tempest-TestShelveInstance-546397589-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:46:38.716565 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-87f06758-c129-4b72-bf02-73ed7c7a8a68 tempest-TestShelveInstance-546397589 tempest-TestShelveInstance-546397589-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:46:38.717934 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-87f06758-c129-4b72-bf02-73ed7c7a8a68 tempest-TestShelveInstance-546397589 tempest-TestShelveInstance-546397589-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:46:38.718367 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-87f06758-c129-4b72-bf02-73ed7c7a8a68 tempest-TestShelveInstance-546397589 tempest-TestShelveInstance-546397589-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:46:38.744459 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.objects.instance [None req-87f06758-c129-4b72-bf02-73ed7c7a8a68 tempest-TestShelveInstance-546397589 tempest-TestShelveInstance-546397589-project] Lazy-loading 'flavor' on Instance uuid 05cf529d-df00-4ff9-b0d2-0e27563d2861 {{(pid=129321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 26 12:46:38.828419 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: INFO nova.api.openstack.requestlog [None req-87f06758-c129-4b72-bf02-73ed7c7a8a68 tempest-TestShelveInstance-546397589 tempest-TestShelveInstance-546397589-project] 10.222.0.75 "POST /compute/v2.1/servers/05cf529d-df00-4ff9-b0d2-0e27563d2861/action" status: 202 len: 0 microversion: 2.1 time: 0.131410 May 26 12:46:38.829238 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: [pid: 129321|app: 0|req: 413/849] 10.222.0.75 () {60 vars in 1277 bytes} [Thu May 26 12:46:38 2022] POST /compute/v2.1/servers/05cf529d-df00-4ff9-b0d2-0e27563d2861/action => generated 0 bytes in 133 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 26 12:46:38.836467 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG dbcounter [-] [129322] Writing DB stats nova_api:SELECT=3 {{(pid=129322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:46:38.837528 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG dbcounter [-] [129322] Writing DB stats nova_cell1:SELECT=20 {{(pid=129322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:46:38.842151 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi [None req-a0701fa9-216f-4a67-baad-2ed694df5faa tempest-TestShelveInstance-546397589 tempest-TestShelveInstance-546397589-project] Calling method '>' {{(pid=129322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:46:38.842910 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.compute.api [None req-a0701fa9-216f-4a67-baad-2ed694df5faa tempest-TestShelveInstance-546397589 tempest-TestShelveInstance-546397589-project] [instance: 05cf529d-df00-4ff9-b0d2-0e27563d2861] Fetching instance by UUID {{(pid=129322) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:46:38.851668 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-a0701fa9-216f-4a67-baad-2ed694df5faa tempest-TestShelveInstance-546397589 tempest-TestShelveInstance-546397589-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:46:38.852151 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-a0701fa9-216f-4a67-baad-2ed694df5faa tempest-TestShelveInstance-546397589 tempest-TestShelveInstance-546397589-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:46:38.853057 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-a0701fa9-216f-4a67-baad-2ed694df5faa tempest-TestShelveInstance-546397589 tempest-TestShelveInstance-546397589-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:46:38.853672 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-a0701fa9-216f-4a67-baad-2ed694df5faa tempest-TestShelveInstance-546397589 tempest-TestShelveInstance-546397589-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:46:38.996694 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.policy [None req-a0701fa9-216f-4a67-baad-2ed694df5faa tempest-TestShelveInstance-546397589 tempest-TestShelveInstance-546397589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d9bf2dcfce24386a1aaf9709d88da45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1f2f503ef674a4b97f848b69f8b63c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129322) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:46:39.006041 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: INFO nova.api.openstack.requestlog [None req-a0701fa9-216f-4a67-baad-2ed694df5faa tempest-TestShelveInstance-546397589 tempest-TestShelveInstance-546397589-project] 10.222.0.75 "GET /compute/v2.1/servers/05cf529d-df00-4ff9-b0d2-0e27563d2861" status: 200 len: 1568 microversion: 2.1 time: 0.169982 May 26 12:46:39.006257 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: [pid: 129322|app: 0|req: 437/850] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 26 12:46:38 2022] GET /compute/v2.1/servers/05cf529d-df00-4ff9-b0d2-0e27563d2861 => generated 1568 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:46:40.024673 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi [None req-3c1066c8-cd37-451b-a3b0-fd6ac062a0f2 tempest-TestShelveInstance-546397589 tempest-TestShelveInstance-546397589-project] Calling method '>' {{(pid=129321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:46:40.025336 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.compute.api [None req-3c1066c8-cd37-451b-a3b0-fd6ac062a0f2 tempest-TestShelveInstance-546397589 tempest-TestShelveInstance-546397589-project] [instance: 05cf529d-df00-4ff9-b0d2-0e27563d2861] Fetching instance by UUID {{(pid=129321) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:46:40.033246 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-3c1066c8-cd37-451b-a3b0-fd6ac062a0f2 tempest-TestShelveInstance-546397589 tempest-TestShelveInstance-546397589-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:46:40.033685 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-3c1066c8-cd37-451b-a3b0-fd6ac062a0f2 tempest-TestShelveInstance-546397589 tempest-TestShelveInstance-546397589-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:46:40.034457 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-3c1066c8-cd37-451b-a3b0-fd6ac062a0f2 tempest-TestShelveInstance-546397589 tempest-TestShelveInstance-546397589-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:46:40.034881 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-3c1066c8-cd37-451b-a3b0-fd6ac062a0f2 tempest-TestShelveInstance-546397589 tempest-TestShelveInstance-546397589-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:46:40.187717 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.policy [None req-3c1066c8-cd37-451b-a3b0-fd6ac062a0f2 tempest-TestShelveInstance-546397589 tempest-TestShelveInstance-546397589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d9bf2dcfce24386a1aaf9709d88da45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1f2f503ef674a4b97f848b69f8b63c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129321) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:46:40.196465 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: INFO nova.api.openstack.requestlog [None req-3c1066c8-cd37-451b-a3b0-fd6ac062a0f2 tempest-TestShelveInstance-546397589 tempest-TestShelveInstance-546397589-project] 10.222.0.75 "GET /compute/v2.1/servers/05cf529d-df00-4ff9-b0d2-0e27563d2861" status: 200 len: 1568 microversion: 2.1 time: 0.176167 May 26 12:46:40.197056 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: [pid: 129321|app: 0|req: 414/851] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 26 12:46:40 2022] GET /compute/v2.1/servers/05cf529d-df00-4ff9-b0d2-0e27563d2861 => generated 1568 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:46:41.218220 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi [None req-ef8c58e4-6de1-418f-849b-ef35d9a47d41 tempest-TestShelveInstance-546397589 tempest-TestShelveInstance-546397589-project] Calling method '>' {{(pid=129322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:46:41.219179 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.compute.api [None req-ef8c58e4-6de1-418f-849b-ef35d9a47d41 tempest-TestShelveInstance-546397589 tempest-TestShelveInstance-546397589-project] [instance: 05cf529d-df00-4ff9-b0d2-0e27563d2861] Fetching instance by UUID {{(pid=129322) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:46:41.228227 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-ef8c58e4-6de1-418f-849b-ef35d9a47d41 tempest-TestShelveInstance-546397589 tempest-TestShelveInstance-546397589-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:46:41.228671 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-ef8c58e4-6de1-418f-849b-ef35d9a47d41 tempest-TestShelveInstance-546397589 tempest-TestShelveInstance-546397589-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:46:41.229432 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-ef8c58e4-6de1-418f-849b-ef35d9a47d41 tempest-TestShelveInstance-546397589 tempest-TestShelveInstance-546397589-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:46:41.229856 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-ef8c58e4-6de1-418f-849b-ef35d9a47d41 tempest-TestShelveInstance-546397589 tempest-TestShelveInstance-546397589-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:46:41.377925 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.policy [None req-ef8c58e4-6de1-418f-849b-ef35d9a47d41 tempest-TestShelveInstance-546397589 tempest-TestShelveInstance-546397589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d9bf2dcfce24386a1aaf9709d88da45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1f2f503ef674a4b97f848b69f8b63c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129322) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:46:41.386125 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: INFO nova.api.openstack.requestlog [None req-ef8c58e4-6de1-418f-849b-ef35d9a47d41 tempest-TestShelveInstance-546397589 tempest-TestShelveInstance-546397589-project] 10.222.0.75 "GET /compute/v2.1/servers/05cf529d-df00-4ff9-b0d2-0e27563d2861" status: 200 len: 1568 microversion: 2.1 time: 0.174350 May 26 12:46:41.386684 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: [pid: 129322|app: 0|req: 438/852] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 26 12:46:41 2022] GET /compute/v2.1/servers/05cf529d-df00-4ff9-b0d2-0e27563d2861 => generated 1568 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:46:42.405939 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi [None req-20d04ab7-537a-4ec5-8be9-1433113d7809 tempest-TestShelveInstance-546397589 tempest-TestShelveInstance-546397589-project] Calling method '>' {{(pid=129321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:46:42.406827 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.compute.api [None req-20d04ab7-537a-4ec5-8be9-1433113d7809 tempest-TestShelveInstance-546397589 tempest-TestShelveInstance-546397589-project] [instance: 05cf529d-df00-4ff9-b0d2-0e27563d2861] Fetching instance by UUID {{(pid=129321) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:46:42.415763 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-20d04ab7-537a-4ec5-8be9-1433113d7809 tempest-TestShelveInstance-546397589 tempest-TestShelveInstance-546397589-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:46:42.416251 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-20d04ab7-537a-4ec5-8be9-1433113d7809 tempest-TestShelveInstance-546397589 tempest-TestShelveInstance-546397589-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:46:42.417237 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-20d04ab7-537a-4ec5-8be9-1433113d7809 tempest-TestShelveInstance-546397589 tempest-TestShelveInstance-546397589-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:46:42.417875 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-20d04ab7-537a-4ec5-8be9-1433113d7809 tempest-TestShelveInstance-546397589 tempest-TestShelveInstance-546397589-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:46:42.562365 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.policy [None req-20d04ab7-537a-4ec5-8be9-1433113d7809 tempest-TestShelveInstance-546397589 tempest-TestShelveInstance-546397589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d9bf2dcfce24386a1aaf9709d88da45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1f2f503ef674a4b97f848b69f8b63c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129321) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:46:42.570961 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: INFO nova.api.openstack.requestlog [None req-20d04ab7-537a-4ec5-8be9-1433113d7809 tempest-TestShelveInstance-546397589 tempest-TestShelveInstance-546397589-project] 10.222.0.75 "GET /compute/v2.1/servers/05cf529d-df00-4ff9-b0d2-0e27563d2861" status: 200 len: 1568 microversion: 2.1 time: 0.169580 May 26 12:46:42.571578 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: [pid: 129321|app: 0|req: 415/853] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 26 12:46:42 2022] GET /compute/v2.1/servers/05cf529d-df00-4ff9-b0d2-0e27563d2861 => generated 1568 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:46:43.588868 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi [None req-e5c309fe-6c02-4ad7-b401-1a0ee190fcfb tempest-TestShelveInstance-546397589 tempest-TestShelveInstance-546397589-project] Calling method '>' {{(pid=129322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:46:43.589523 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.compute.api [None req-e5c309fe-6c02-4ad7-b401-1a0ee190fcfb tempest-TestShelveInstance-546397589 tempest-TestShelveInstance-546397589-project] [instance: 05cf529d-df00-4ff9-b0d2-0e27563d2861] Fetching instance by UUID {{(pid=129322) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:46:43.600376 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-e5c309fe-6c02-4ad7-b401-1a0ee190fcfb tempest-TestShelveInstance-546397589 tempest-TestShelveInstance-546397589-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:46:43.600853 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-e5c309fe-6c02-4ad7-b401-1a0ee190fcfb tempest-TestShelveInstance-546397589 tempest-TestShelveInstance-546397589-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:46:43.601802 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-e5c309fe-6c02-4ad7-b401-1a0ee190fcfb tempest-TestShelveInstance-546397589 tempest-TestShelveInstance-546397589-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:46:43.602128 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-e5c309fe-6c02-4ad7-b401-1a0ee190fcfb tempest-TestShelveInstance-546397589 tempest-TestShelveInstance-546397589-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:46:43.744878 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.policy [None req-e5c309fe-6c02-4ad7-b401-1a0ee190fcfb tempest-TestShelveInstance-546397589 tempest-TestShelveInstance-546397589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d9bf2dcfce24386a1aaf9709d88da45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1f2f503ef674a4b97f848b69f8b63c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129322) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:46:43.753289 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: INFO nova.api.openstack.requestlog [None req-e5c309fe-6c02-4ad7-b401-1a0ee190fcfb tempest-TestShelveInstance-546397589 tempest-TestShelveInstance-546397589-project] 10.222.0.75 "GET /compute/v2.1/servers/05cf529d-df00-4ff9-b0d2-0e27563d2861" status: 200 len: 1568 microversion: 2.1 time: 0.168394 May 26 12:46:43.753870 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: [pid: 129322|app: 0|req: 439/854] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 26 12:46:43 2022] GET /compute/v2.1/servers/05cf529d-df00-4ff9-b0d2-0e27563d2861 => generated 1568 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:46:44.773085 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi [None req-2c954437-774a-4018-a040-0cb550d09634 tempest-TestShelveInstance-546397589 tempest-TestShelveInstance-546397589-project] Calling method '>' {{(pid=129321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:46:44.773868 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.compute.api [None req-2c954437-774a-4018-a040-0cb550d09634 tempest-TestShelveInstance-546397589 tempest-TestShelveInstance-546397589-project] [instance: 05cf529d-df00-4ff9-b0d2-0e27563d2861] Fetching instance by UUID {{(pid=129321) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:46:44.781703 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-2c954437-774a-4018-a040-0cb550d09634 tempest-TestShelveInstance-546397589 tempest-TestShelveInstance-546397589-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:46:44.782208 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-2c954437-774a-4018-a040-0cb550d09634 tempest-TestShelveInstance-546397589 tempest-TestShelveInstance-546397589-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:46:44.782994 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-2c954437-774a-4018-a040-0cb550d09634 tempest-TestShelveInstance-546397589 tempest-TestShelveInstance-546397589-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:46:44.783434 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-2c954437-774a-4018-a040-0cb550d09634 tempest-TestShelveInstance-546397589 tempest-TestShelveInstance-546397589-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:46:44.929048 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.policy [None req-2c954437-774a-4018-a040-0cb550d09634 tempest-TestShelveInstance-546397589 tempest-TestShelveInstance-546397589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d9bf2dcfce24386a1aaf9709d88da45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1f2f503ef674a4b97f848b69f8b63c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129321) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:46:44.938022 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: INFO nova.api.openstack.requestlog [None req-2c954437-774a-4018-a040-0cb550d09634 tempest-TestShelveInstance-546397589 tempest-TestShelveInstance-546397589-project] 10.222.0.75 "GET /compute/v2.1/servers/05cf529d-df00-4ff9-b0d2-0e27563d2861" status: 200 len: 1568 microversion: 2.1 time: 0.169055 May 26 12:46:44.938625 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: [pid: 129321|app: 0|req: 416/855] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 26 12:46:44 2022] GET /compute/v2.1/servers/05cf529d-df00-4ff9-b0d2-0e27563d2861 => generated 1568 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:46:45.958797 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi [None req-5f882af4-39b8-4e3e-8f23-c3db3d7651d9 tempest-TestShelveInstance-546397589 tempest-TestShelveInstance-546397589-project] Calling method '>' {{(pid=129322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:46:45.959670 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.compute.api [None req-5f882af4-39b8-4e3e-8f23-c3db3d7651d9 tempest-TestShelveInstance-546397589 tempest-TestShelveInstance-546397589-project] [instance: 05cf529d-df00-4ff9-b0d2-0e27563d2861] Fetching instance by UUID {{(pid=129322) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:46:45.966899 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-5f882af4-39b8-4e3e-8f23-c3db3d7651d9 tempest-TestShelveInstance-546397589 tempest-TestShelveInstance-546397589-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:46:45.967324 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-5f882af4-39b8-4e3e-8f23-c3db3d7651d9 tempest-TestShelveInstance-546397589 tempest-TestShelveInstance-546397589-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:46:45.968134 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-5f882af4-39b8-4e3e-8f23-c3db3d7651d9 tempest-TestShelveInstance-546397589 tempest-TestShelveInstance-546397589-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:46:45.968559 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-5f882af4-39b8-4e3e-8f23-c3db3d7651d9 tempest-TestShelveInstance-546397589 tempest-TestShelveInstance-546397589-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:46:46.104565 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.policy [None req-5f882af4-39b8-4e3e-8f23-c3db3d7651d9 tempest-TestShelveInstance-546397589 tempest-TestShelveInstance-546397589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d9bf2dcfce24386a1aaf9709d88da45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1f2f503ef674a4b97f848b69f8b63c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129322) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:46:46.112941 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: INFO nova.api.openstack.requestlog [None req-5f882af4-39b8-4e3e-8f23-c3db3d7651d9 tempest-TestShelveInstance-546397589 tempest-TestShelveInstance-546397589-project] 10.222.0.75 "GET /compute/v2.1/servers/05cf529d-df00-4ff9-b0d2-0e27563d2861" status: 200 len: 1568 microversion: 2.1 time: 0.160085 May 26 12:46:46.113576 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: [pid: 129322|app: 0|req: 440/856] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 26 12:46:45 2022] GET /compute/v2.1/servers/05cf529d-df00-4ff9-b0d2-0e27563d2861 => generated 1568 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:46:47.132407 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi [None req-79661b14-6662-4154-a59d-c7dde850dd94 tempest-TestShelveInstance-546397589 tempest-TestShelveInstance-546397589-project] Calling method '>' {{(pid=129321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:46:47.133005 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.compute.api [None req-79661b14-6662-4154-a59d-c7dde850dd94 tempest-TestShelveInstance-546397589 tempest-TestShelveInstance-546397589-project] [instance: 05cf529d-df00-4ff9-b0d2-0e27563d2861] Fetching instance by UUID {{(pid=129321) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:46:47.139846 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-79661b14-6662-4154-a59d-c7dde850dd94 tempest-TestShelveInstance-546397589 tempest-TestShelveInstance-546397589-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:46:47.140431 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-79661b14-6662-4154-a59d-c7dde850dd94 tempest-TestShelveInstance-546397589 tempest-TestShelveInstance-546397589-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:46:47.141199 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-79661b14-6662-4154-a59d-c7dde850dd94 tempest-TestShelveInstance-546397589 tempest-TestShelveInstance-546397589-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:46:47.141626 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-79661b14-6662-4154-a59d-c7dde850dd94 tempest-TestShelveInstance-546397589 tempest-TestShelveInstance-546397589-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:46:47.281117 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.policy [None req-79661b14-6662-4154-a59d-c7dde850dd94 tempest-TestShelveInstance-546397589 tempest-TestShelveInstance-546397589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d9bf2dcfce24386a1aaf9709d88da45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1f2f503ef674a4b97f848b69f8b63c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129321) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:46:47.289325 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: INFO nova.api.openstack.requestlog [None req-79661b14-6662-4154-a59d-c7dde850dd94 tempest-TestShelveInstance-546397589 tempest-TestShelveInstance-546397589-project] 10.222.0.75 "GET /compute/v2.1/servers/05cf529d-df00-4ff9-b0d2-0e27563d2861" status: 200 len: 1568 microversion: 2.1 time: 0.162541 May 26 12:46:47.289927 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: [pid: 129321|app: 0|req: 417/857] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 26 12:46:47 2022] GET /compute/v2.1/servers/05cf529d-df00-4ff9-b0d2-0e27563d2861 => generated 1568 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:46:48.307779 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi [None req-915af841-fe1e-43b1-9d54-9f799f69204f tempest-TestShelveInstance-546397589 tempest-TestShelveInstance-546397589-project] Calling method '>' {{(pid=129322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:46:48.308427 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.compute.api [None req-915af841-fe1e-43b1-9d54-9f799f69204f tempest-TestShelveInstance-546397589 tempest-TestShelveInstance-546397589-project] [instance: 05cf529d-df00-4ff9-b0d2-0e27563d2861] Fetching instance by UUID {{(pid=129322) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:46:48.317452 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-915af841-fe1e-43b1-9d54-9f799f69204f tempest-TestShelveInstance-546397589 tempest-TestShelveInstance-546397589-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:46:48.317904 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-915af841-fe1e-43b1-9d54-9f799f69204f tempest-TestShelveInstance-546397589 tempest-TestShelveInstance-546397589-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:46:48.318730 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-915af841-fe1e-43b1-9d54-9f799f69204f tempest-TestShelveInstance-546397589 tempest-TestShelveInstance-546397589-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:46:48.319217 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-915af841-fe1e-43b1-9d54-9f799f69204f tempest-TestShelveInstance-546397589 tempest-TestShelveInstance-546397589-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:46:48.468911 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.policy [None req-915af841-fe1e-43b1-9d54-9f799f69204f tempest-TestShelveInstance-546397589 tempest-TestShelveInstance-546397589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d9bf2dcfce24386a1aaf9709d88da45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1f2f503ef674a4b97f848b69f8b63c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129322) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:46:48.478315 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: INFO nova.api.openstack.requestlog [None req-915af841-fe1e-43b1-9d54-9f799f69204f tempest-TestShelveInstance-546397589 tempest-TestShelveInstance-546397589-project] 10.222.0.75 "GET /compute/v2.1/servers/05cf529d-df00-4ff9-b0d2-0e27563d2861" status: 200 len: 1568 microversion: 2.1 time: 0.174782 May 26 12:46:48.478919 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: [pid: 129322|app: 0|req: 441/858] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 26 12:46:48 2022] GET /compute/v2.1/servers/05cf529d-df00-4ff9-b0d2-0e27563d2861 => generated 1568 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:46:49.496324 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi [None req-9dd88aca-a558-4a1d-852a-9ff634775cb8 tempest-TestShelveInstance-546397589 tempest-TestShelveInstance-546397589-project] Calling method '>' {{(pid=129321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:46:49.496925 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.compute.api [None req-9dd88aca-a558-4a1d-852a-9ff634775cb8 tempest-TestShelveInstance-546397589 tempest-TestShelveInstance-546397589-project] [instance: 05cf529d-df00-4ff9-b0d2-0e27563d2861] Fetching instance by UUID {{(pid=129321) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:46:49.503681 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-9dd88aca-a558-4a1d-852a-9ff634775cb8 tempest-TestShelveInstance-546397589 tempest-TestShelveInstance-546397589-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:46:49.504126 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-9dd88aca-a558-4a1d-852a-9ff634775cb8 tempest-TestShelveInstance-546397589 tempest-TestShelveInstance-546397589-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:46:49.504890 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-9dd88aca-a558-4a1d-852a-9ff634775cb8 tempest-TestShelveInstance-546397589 tempest-TestShelveInstance-546397589-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:46:49.505326 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-9dd88aca-a558-4a1d-852a-9ff634775cb8 tempest-TestShelveInstance-546397589 tempest-TestShelveInstance-546397589-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:46:49.745365 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.policy [None req-9dd88aca-a558-4a1d-852a-9ff634775cb8 tempest-TestShelveInstance-546397589 tempest-TestShelveInstance-546397589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d9bf2dcfce24386a1aaf9709d88da45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1f2f503ef674a4b97f848b69f8b63c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129321) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:46:49.753205 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: INFO nova.api.openstack.requestlog [None req-9dd88aca-a558-4a1d-852a-9ff634775cb8 tempest-TestShelveInstance-546397589 tempest-TestShelveInstance-546397589-project] 10.222.0.75 "GET /compute/v2.1/servers/05cf529d-df00-4ff9-b0d2-0e27563d2861" status: 200 len: 1568 microversion: 2.1 time: 0.260960 May 26 12:46:49.754252 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: [pid: 129321|app: 0|req: 418/859] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 26 12:46:49 2022] GET /compute/v2.1/servers/05cf529d-df00-4ff9-b0d2-0e27563d2861 => generated 1568 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:46:50.770867 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi [None req-13a425fd-71d4-4185-a267-f56699404c46 tempest-TestShelveInstance-546397589 tempest-TestShelveInstance-546397589-project] Calling method '>' {{(pid=129322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:46:50.771639 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.compute.api [None req-13a425fd-71d4-4185-a267-f56699404c46 tempest-TestShelveInstance-546397589 tempest-TestShelveInstance-546397589-project] [instance: 05cf529d-df00-4ff9-b0d2-0e27563d2861] Fetching instance by UUID {{(pid=129322) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:46:50.779289 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-13a425fd-71d4-4185-a267-f56699404c46 tempest-TestShelveInstance-546397589 tempest-TestShelveInstance-546397589-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:46:50.779823 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-13a425fd-71d4-4185-a267-f56699404c46 tempest-TestShelveInstance-546397589 tempest-TestShelveInstance-546397589-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:46:50.780749 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-13a425fd-71d4-4185-a267-f56699404c46 tempest-TestShelveInstance-546397589 tempest-TestShelveInstance-546397589-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:46:50.781238 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-13a425fd-71d4-4185-a267-f56699404c46 tempest-TestShelveInstance-546397589 tempest-TestShelveInstance-546397589-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:46:50.933091 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.policy [None req-13a425fd-71d4-4185-a267-f56699404c46 tempest-TestShelveInstance-546397589 tempest-TestShelveInstance-546397589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d9bf2dcfce24386a1aaf9709d88da45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1f2f503ef674a4b97f848b69f8b63c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129322) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:46:50.942906 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: INFO nova.api.openstack.requestlog [None req-13a425fd-71d4-4185-a267-f56699404c46 tempest-TestShelveInstance-546397589 tempest-TestShelveInstance-546397589-project] 10.222.0.75 "GET /compute/v2.1/servers/05cf529d-df00-4ff9-b0d2-0e27563d2861" status: 200 len: 1568 microversion: 2.1 time: 0.175969 May 26 12:46:50.943656 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: [pid: 129322|app: 0|req: 442/860] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 26 12:46:50 2022] GET /compute/v2.1/servers/05cf529d-df00-4ff9-b0d2-0e27563d2861 => generated 1568 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:46:51.964711 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi [None req-28712a87-b72e-42ac-a50b-e16ea14a24b1 tempest-TestShelveInstance-546397589 tempest-TestShelveInstance-546397589-project] Calling method '>' {{(pid=129321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:46:51.965296 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.compute.api [None req-28712a87-b72e-42ac-a50b-e16ea14a24b1 tempest-TestShelveInstance-546397589 tempest-TestShelveInstance-546397589-project] [instance: 05cf529d-df00-4ff9-b0d2-0e27563d2861] Fetching instance by UUID {{(pid=129321) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:46:51.972331 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-28712a87-b72e-42ac-a50b-e16ea14a24b1 tempest-TestShelveInstance-546397589 tempest-TestShelveInstance-546397589-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:46:51.972992 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-28712a87-b72e-42ac-a50b-e16ea14a24b1 tempest-TestShelveInstance-546397589 tempest-TestShelveInstance-546397589-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:46:51.973636 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-28712a87-b72e-42ac-a50b-e16ea14a24b1 tempest-TestShelveInstance-546397589 tempest-TestShelveInstance-546397589-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:46:51.974064 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-28712a87-b72e-42ac-a50b-e16ea14a24b1 tempest-TestShelveInstance-546397589 tempest-TestShelveInstance-546397589-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:46:52.127355 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.policy [None req-28712a87-b72e-42ac-a50b-e16ea14a24b1 tempest-TestShelveInstance-546397589 tempest-TestShelveInstance-546397589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d9bf2dcfce24386a1aaf9709d88da45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1f2f503ef674a4b97f848b69f8b63c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129321) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:46:52.136412 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: INFO nova.api.openstack.requestlog [None req-28712a87-b72e-42ac-a50b-e16ea14a24b1 tempest-TestShelveInstance-546397589 tempest-TestShelveInstance-546397589-project] 10.222.0.75 "GET /compute/v2.1/servers/05cf529d-df00-4ff9-b0d2-0e27563d2861" status: 200 len: 1568 microversion: 2.1 time: 0.175476 May 26 12:46:52.137141 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: [pid: 129321|app: 0|req: 419/861] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 26 12:46:51 2022] GET /compute/v2.1/servers/05cf529d-df00-4ff9-b0d2-0e27563d2861 => generated 1568 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:46:53.155136 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi [None req-b4bb98bd-170d-4fb7-87ac-d26b399ae5d5 tempest-TestShelveInstance-546397589 tempest-TestShelveInstance-546397589-project] Calling method '>' {{(pid=129322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:46:53.155762 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.compute.api [None req-b4bb98bd-170d-4fb7-87ac-d26b399ae5d5 tempest-TestShelveInstance-546397589 tempest-TestShelveInstance-546397589-project] [instance: 05cf529d-df00-4ff9-b0d2-0e27563d2861] Fetching instance by UUID {{(pid=129322) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:46:53.164361 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-b4bb98bd-170d-4fb7-87ac-d26b399ae5d5 tempest-TestShelveInstance-546397589 tempest-TestShelveInstance-546397589-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:46:53.164842 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-b4bb98bd-170d-4fb7-87ac-d26b399ae5d5 tempest-TestShelveInstance-546397589 tempest-TestShelveInstance-546397589-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:46:53.165640 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-b4bb98bd-170d-4fb7-87ac-d26b399ae5d5 tempest-TestShelveInstance-546397589 tempest-TestShelveInstance-546397589-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:46:53.166072 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-b4bb98bd-170d-4fb7-87ac-d26b399ae5d5 tempest-TestShelveInstance-546397589 tempest-TestShelveInstance-546397589-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:46:53.309773 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.policy [None req-b4bb98bd-170d-4fb7-87ac-d26b399ae5d5 tempest-TestShelveInstance-546397589 tempest-TestShelveInstance-546397589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d9bf2dcfce24386a1aaf9709d88da45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1f2f503ef674a4b97f848b69f8b63c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129322) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:46:53.317645 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: INFO nova.api.openstack.requestlog [None req-b4bb98bd-170d-4fb7-87ac-d26b399ae5d5 tempest-TestShelveInstance-546397589 tempest-TestShelveInstance-546397589-project] 10.222.0.75 "GET /compute/v2.1/servers/05cf529d-df00-4ff9-b0d2-0e27563d2861" status: 200 len: 1509 microversion: 2.1 time: 0.167196 May 26 12:46:53.318769 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: [pid: 129322|app: 0|req: 443/862] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 26 12:46:53 2022] GET /compute/v2.1/servers/05cf529d-df00-4ff9-b0d2-0e27563d2861 => generated 1509 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:46:53.335281 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi [None req-1fcc404f-bd7e-431a-a7d8-9ded252c2b85 tempest-TestShelveInstance-546397589 tempest-TestShelveInstance-546397589-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=129321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 12:46:53.335922 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.compute.api [None req-1fcc404f-bd7e-431a-a7d8-9ded252c2b85 tempest-TestShelveInstance-546397589 tempest-TestShelveInstance-546397589-project] [instance: 05cf529d-df00-4ff9-b0d2-0e27563d2861] Fetching instance by UUID {{(pid=129321) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:46:53.342986 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-1fcc404f-bd7e-431a-a7d8-9ded252c2b85 tempest-TestShelveInstance-546397589 tempest-TestShelveInstance-546397589-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:46:53.343437 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-1fcc404f-bd7e-431a-a7d8-9ded252c2b85 tempest-TestShelveInstance-546397589 tempest-TestShelveInstance-546397589-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:46:53.344327 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-1fcc404f-bd7e-431a-a7d8-9ded252c2b85 tempest-TestShelveInstance-546397589 tempest-TestShelveInstance-546397589-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:46:53.344759 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-1fcc404f-bd7e-431a-a7d8-9ded252c2b85 tempest-TestShelveInstance-546397589 tempest-TestShelveInstance-546397589-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:46:53.426738 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: INFO nova.api.openstack.requestlog [None req-1fcc404f-bd7e-431a-a7d8-9ded252c2b85 tempest-TestShelveInstance-546397589 tempest-TestShelveInstance-546397589-project] 10.222.0.75 "POST /compute/v2.1/servers/05cf529d-df00-4ff9-b0d2-0e27563d2861/action" status: 202 len: 0 microversion: 2.1 time: 0.095655 May 26 12:46:53.428117 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: [pid: 129321|app: 0|req: 420/863] 10.222.0.75 () {60 vars in 1277 bytes} [Thu May 26 12:46:53 2022] POST /compute/v2.1/servers/05cf529d-df00-4ff9-b0d2-0e27563d2861/action => generated 0 bytes in 98 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 26 12:46:53.437084 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi [None req-67e1c69e-5b02-4f85-a499-0c8da7118c73 tempest-TestShelveInstance-546397589 tempest-TestShelveInstance-546397589-project] Calling method '>' {{(pid=129322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:46:53.437878 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.compute.api [None req-67e1c69e-5b02-4f85-a499-0c8da7118c73 tempest-TestShelveInstance-546397589 tempest-TestShelveInstance-546397589-project] [instance: 05cf529d-df00-4ff9-b0d2-0e27563d2861] Fetching instance by UUID {{(pid=129322) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:46:53.445071 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-67e1c69e-5b02-4f85-a499-0c8da7118c73 tempest-TestShelveInstance-546397589 tempest-TestShelveInstance-546397589-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:46:53.445510 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-67e1c69e-5b02-4f85-a499-0c8da7118c73 tempest-TestShelveInstance-546397589 tempest-TestShelveInstance-546397589-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:46:53.446297 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-67e1c69e-5b02-4f85-a499-0c8da7118c73 tempest-TestShelveInstance-546397589 tempest-TestShelveInstance-546397589-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:46:53.446713 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-67e1c69e-5b02-4f85-a499-0c8da7118c73 tempest-TestShelveInstance-546397589 tempest-TestShelveInstance-546397589-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:46:53.587460 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.policy [None req-67e1c69e-5b02-4f85-a499-0c8da7118c73 tempest-TestShelveInstance-546397589 tempest-TestShelveInstance-546397589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d9bf2dcfce24386a1aaf9709d88da45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1f2f503ef674a4b97f848b69f8b63c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129322) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:46:53.595522 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: INFO nova.api.openstack.requestlog [None req-67e1c69e-5b02-4f85-a499-0c8da7118c73 tempest-TestShelveInstance-546397589 tempest-TestShelveInstance-546397589-project] 10.222.0.75 "GET /compute/v2.1/servers/05cf529d-df00-4ff9-b0d2-0e27563d2861" status: 200 len: 1517 microversion: 2.1 time: 0.162952 May 26 12:46:53.596114 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: [pid: 129322|app: 0|req: 444/864] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 26 12:46:53 2022] GET /compute/v2.1/servers/05cf529d-df00-4ff9-b0d2-0e27563d2861 => generated 1517 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:46:54.615836 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi [None req-de430608-7ed3-4946-9ae0-8e67c77450e2 tempest-TestShelveInstance-546397589 tempest-TestShelveInstance-546397589-project] Calling method '>' {{(pid=129321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:46:54.616991 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.compute.api [None req-de430608-7ed3-4946-9ae0-8e67c77450e2 tempest-TestShelveInstance-546397589 tempest-TestShelveInstance-546397589-project] [instance: 05cf529d-df00-4ff9-b0d2-0e27563d2861] Fetching instance by UUID {{(pid=129321) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:46:54.627762 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-de430608-7ed3-4946-9ae0-8e67c77450e2 tempest-TestShelveInstance-546397589 tempest-TestShelveInstance-546397589-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:46:54.628501 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-de430608-7ed3-4946-9ae0-8e67c77450e2 tempest-TestShelveInstance-546397589 tempest-TestShelveInstance-546397589-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:46:54.629793 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-de430608-7ed3-4946-9ae0-8e67c77450e2 tempest-TestShelveInstance-546397589 tempest-TestShelveInstance-546397589-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:46:54.630503 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-de430608-7ed3-4946-9ae0-8e67c77450e2 tempest-TestShelveInstance-546397589 tempest-TestShelveInstance-546397589-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:46:54.777908 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.policy [None req-de430608-7ed3-4946-9ae0-8e67c77450e2 tempest-TestShelveInstance-546397589 tempest-TestShelveInstance-546397589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d9bf2dcfce24386a1aaf9709d88da45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1f2f503ef674a4b97f848b69f8b63c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129321) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:46:54.788308 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: INFO nova.api.openstack.requestlog [None req-de430608-7ed3-4946-9ae0-8e67c77450e2 tempest-TestShelveInstance-546397589 tempest-TestShelveInstance-546397589-project] 10.222.0.75 "GET /compute/v2.1/servers/05cf529d-df00-4ff9-b0d2-0e27563d2861" status: 200 len: 1519 microversion: 2.1 time: 0.178336 May 26 12:46:54.789510 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: [pid: 129321|app: 0|req: 421/865] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 26 12:46:54 2022] GET /compute/v2.1/servers/05cf529d-df00-4ff9-b0d2-0e27563d2861 => generated 1519 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:46:54.915883 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi [req-17053395-f2cb-478c-831a-a4dc8324c282 req-9ca12198-9062-48a9-9961-d89146a45d18 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "05cf529d-df00-4ff9-b0d2-0e27563d2861", "name": "network-vif-unplugged", "status": "completed", "tag": "6408ddad-3849-44bf-b29b-b7e4852f543d"}]} {{(pid=129322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 12:46:54.929911 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [req-17053395-f2cb-478c-831a-a4dc8324c282 req-9ca12198-9062-48a9-9961-d89146a45d18 service nova] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:46:54.930686 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [req-17053395-f2cb-478c-831a-a4dc8324c282 req-9ca12198-9062-48a9-9961-d89146a45d18 service nova] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:46:54.946549 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.compute.server_external_events [req-17053395-f2cb-478c-831a-a4dc8324c282 req-9ca12198-9062-48a9-9961-d89146a45d18 service nova] Unable to find a host for instance 05cf529d-df00-4ff9-b0d2-0e27563d2861. Dropping event network-vif-unplugged {{(pid=129322) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} May 26 12:46:54.948727 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: INFO nova.api.openstack.requestlog [req-17053395-f2cb-478c-831a-a4dc8324c282 req-9ca12198-9062-48a9-9961-d89146a45d18 service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.037115 May 26 12:46:54.949372 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: [pid: 129322|app: 0|req: 445/866] 10.222.0.75 () {64 vars in 1317 bytes} [Thu May 26 12:46:54 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 40 msecs (HTTP/1.1 207) 9 headers in 367 bytes (2 switches on core 0) May 26 12:46:55.806745 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi [None req-9443f39e-d554-441d-85ab-211cb3471995 tempest-TestShelveInstance-546397589 tempest-TestShelveInstance-546397589-project] Calling method '>' {{(pid=129321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:46:55.807414 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.compute.api [None req-9443f39e-d554-441d-85ab-211cb3471995 tempest-TestShelveInstance-546397589 tempest-TestShelveInstance-546397589-project] [instance: 05cf529d-df00-4ff9-b0d2-0e27563d2861] Fetching instance by UUID {{(pid=129321) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:46:55.814566 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-9443f39e-d554-441d-85ab-211cb3471995 tempest-TestShelveInstance-546397589 tempest-TestShelveInstance-546397589-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:46:55.815080 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-9443f39e-d554-441d-85ab-211cb3471995 tempest-TestShelveInstance-546397589 tempest-TestShelveInstance-546397589-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:46:55.815859 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-9443f39e-d554-441d-85ab-211cb3471995 tempest-TestShelveInstance-546397589 tempest-TestShelveInstance-546397589-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:46:55.816504 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-9443f39e-d554-441d-85ab-211cb3471995 tempest-TestShelveInstance-546397589 tempest-TestShelveInstance-546397589-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:46:56.032025 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.policy [None req-9443f39e-d554-441d-85ab-211cb3471995 tempest-TestShelveInstance-546397589 tempest-TestShelveInstance-546397589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d9bf2dcfce24386a1aaf9709d88da45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1f2f503ef674a4b97f848b69f8b63c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129321) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:46:56.040386 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: INFO nova.api.openstack.requestlog [None req-9443f39e-d554-441d-85ab-211cb3471995 tempest-TestShelveInstance-546397589 tempest-TestShelveInstance-546397589-project] 10.222.0.75 "GET /compute/v2.1/servers/05cf529d-df00-4ff9-b0d2-0e27563d2861" status: 200 len: 1575 microversion: 2.1 time: 0.237622 May 26 12:46:56.041097 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: [pid: 129321|app: 0|req: 422/867] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 26 12:46:55 2022] GET /compute/v2.1/servers/05cf529d-df00-4ff9-b0d2-0e27563d2861 => generated 1575 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:46:57.058743 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi [None req-c1d53940-4099-445f-987a-c7fd55a74c22 tempest-TestShelveInstance-546397589 tempest-TestShelveInstance-546397589-project] Calling method '>' {{(pid=129322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:46:57.059313 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.compute.api [None req-c1d53940-4099-445f-987a-c7fd55a74c22 tempest-TestShelveInstance-546397589 tempest-TestShelveInstance-546397589-project] [instance: 05cf529d-df00-4ff9-b0d2-0e27563d2861] Fetching instance by UUID {{(pid=129322) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:46:57.066547 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-c1d53940-4099-445f-987a-c7fd55a74c22 tempest-TestShelveInstance-546397589 tempest-TestShelveInstance-546397589-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:46:57.067088 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-c1d53940-4099-445f-987a-c7fd55a74c22 tempest-TestShelveInstance-546397589 tempest-TestShelveInstance-546397589-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:46:57.068130 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-c1d53940-4099-445f-987a-c7fd55a74c22 tempest-TestShelveInstance-546397589 tempest-TestShelveInstance-546397589-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:46:57.068655 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-c1d53940-4099-445f-987a-c7fd55a74c22 tempest-TestShelveInstance-546397589 tempest-TestShelveInstance-546397589-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:46:57.139807 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi [None req-92bb05d0-3c11-445e-b437-e4ccce4d8438 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Calling method '>' {{(pid=129321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:46:57.140551 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.compute.api [None req-92bb05d0-3c11-445e-b437-e4ccce4d8438 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] [instance: e911acec-b583-42eb-b5de-dee9573bad6c] Fetching instance by UUID {{(pid=129321) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:46:57.147479 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-92bb05d0-3c11-445e-b437-e4ccce4d8438 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:46:57.147966 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-92bb05d0-3c11-445e-b437-e4ccce4d8438 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:46:57.148742 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-92bb05d0-3c11-445e-b437-e4ccce4d8438 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:46:57.149172 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-92bb05d0-3c11-445e-b437-e4ccce4d8438 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:46:57.218885 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.policy [None req-c1d53940-4099-445f-987a-c7fd55a74c22 tempest-TestShelveInstance-546397589 tempest-TestShelveInstance-546397589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d9bf2dcfce24386a1aaf9709d88da45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1f2f503ef674a4b97f848b69f8b63c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129322) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:46:57.226939 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: INFO nova.api.openstack.requestlog [None req-c1d53940-4099-445f-987a-c7fd55a74c22 tempest-TestShelveInstance-546397589 tempest-TestShelveInstance-546397589-project] 10.222.0.75 "GET /compute/v2.1/servers/05cf529d-df00-4ff9-b0d2-0e27563d2861" status: 200 len: 1575 microversion: 2.1 time: 0.172262 May 26 12:46:57.236563 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: [pid: 129322|app: 0|req: 446/868] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 26 12:46:57 2022] GET /compute/v2.1/servers/05cf529d-df00-4ff9-b0d2-0e27563d2861 => generated 1575 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:46:57.237879 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.objects.instance [None req-92bb05d0-3c11-445e-b437-e4ccce4d8438 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lazy-loading 'services' on Instance uuid e911acec-b583-42eb-b5de-dee9573bad6c {{(pid=129321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 26 12:46:57.318542 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: INFO nova.api.openstack.requestlog [None req-92bb05d0-3c11-445e-b437-e4ccce4d8438 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] 10.222.0.75 "DELETE /compute/v2.1/servers/e911acec-b583-42eb-b5de-dee9573bad6c/os-volume_attachments/fa551505-a93f-430a-b293-ca5ec956d51f" status: 202 len: 0 microversion: 2.1 time: 0.182163 May 26 12:46:57.319085 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: [pid: 129321|app: 0|req: 423/869] 10.222.0.75 () {58 vars in 1415 bytes} [Thu May 26 12:46:57 2022] DELETE /compute/v2.1/servers/e911acec-b583-42eb-b5de-dee9573bad6c/os-volume_attachments/fa551505-a93f-430a-b293-ca5ec956d51f => generated 0 bytes in 184 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 26 12:46:57.327626 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi [None req-94c50d8b-f815-40fd-ad2d-7b2cf264f9ab tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Calling method '>' {{(pid=129322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:46:57.328563 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.compute.api [None req-94c50d8b-f815-40fd-ad2d-7b2cf264f9ab tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] [instance: e911acec-b583-42eb-b5de-dee9573bad6c] Fetching instance by UUID {{(pid=129322) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:46:57.335347 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-94c50d8b-f815-40fd-ad2d-7b2cf264f9ab tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:46:57.335828 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-94c50d8b-f815-40fd-ad2d-7b2cf264f9ab tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:46:57.336598 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-94c50d8b-f815-40fd-ad2d-7b2cf264f9ab tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:46:57.337024 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-94c50d8b-f815-40fd-ad2d-7b2cf264f9ab tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:46:57.379742 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: INFO nova.api.openstack.requestlog [None req-94c50d8b-f815-40fd-ad2d-7b2cf264f9ab tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] 10.222.0.75 "GET /compute/v2.1/servers/e911acec-b583-42eb-b5de-dee9573bad6c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053576 May 26 12:46:57.379742 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: [pid: 129322|app: 0|req: 447/870] 10.222.0.75 () {58 vars in 1301 bytes} [Thu May 26 12:46:57 2022] GET /compute/v2.1/servers/e911acec-b583-42eb-b5de-dee9573bad6c/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 12:46:58.250473 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi [None req-009833a1-f339-4c23-b1e2-729944bac460 tempest-TestShelveInstance-546397589 tempest-TestShelveInstance-546397589-project] Calling method '>' {{(pid=129321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:46:58.251674 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.compute.api [None req-009833a1-f339-4c23-b1e2-729944bac460 tempest-TestShelveInstance-546397589 tempest-TestShelveInstance-546397589-project] [instance: 05cf529d-df00-4ff9-b0d2-0e27563d2861] Fetching instance by UUID {{(pid=129321) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:46:58.260009 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-009833a1-f339-4c23-b1e2-729944bac460 tempest-TestShelveInstance-546397589 tempest-TestShelveInstance-546397589-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:46:58.260458 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-009833a1-f339-4c23-b1e2-729944bac460 tempest-TestShelveInstance-546397589 tempest-TestShelveInstance-546397589-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:46:58.261235 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-009833a1-f339-4c23-b1e2-729944bac460 tempest-TestShelveInstance-546397589 tempest-TestShelveInstance-546397589-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:46:58.261676 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-009833a1-f339-4c23-b1e2-729944bac460 tempest-TestShelveInstance-546397589 tempest-TestShelveInstance-546397589-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:46:58.390485 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi [None req-d1ea8908-5a4c-4573-be1e-2485dad4c3ad tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Calling method '>' {{(pid=129322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:46:58.391438 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.compute.api [None req-d1ea8908-5a4c-4573-be1e-2485dad4c3ad tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] [instance: e911acec-b583-42eb-b5de-dee9573bad6c] Fetching instance by UUID {{(pid=129322) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:46:58.398873 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-d1ea8908-5a4c-4573-be1e-2485dad4c3ad tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:46:58.399329 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-d1ea8908-5a4c-4573-be1e-2485dad4c3ad tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:46:58.400140 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-d1ea8908-5a4c-4573-be1e-2485dad4c3ad tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:46:58.400581 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-d1ea8908-5a4c-4573-be1e-2485dad4c3ad tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:46:58.415262 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.policy [None req-009833a1-f339-4c23-b1e2-729944bac460 tempest-TestShelveInstance-546397589 tempest-TestShelveInstance-546397589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d9bf2dcfce24386a1aaf9709d88da45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1f2f503ef674a4b97f848b69f8b63c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129321) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:46:58.425296 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: INFO nova.api.openstack.requestlog [None req-009833a1-f339-4c23-b1e2-729944bac460 tempest-TestShelveInstance-546397589 tempest-TestShelveInstance-546397589-project] 10.222.0.75 "GET /compute/v2.1/servers/05cf529d-df00-4ff9-b0d2-0e27563d2861" status: 200 len: 1575 microversion: 2.1 time: 0.183077 May 26 12:46:58.425997 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: [pid: 129321|app: 0|req: 424/871] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 26 12:46:58 2022] GET /compute/v2.1/servers/05cf529d-df00-4ff9-b0d2-0e27563d2861 => generated 1575 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:46:58.435172 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: INFO nova.api.openstack.requestlog [None req-d1ea8908-5a4c-4573-be1e-2485dad4c3ad tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] 10.222.0.75 "GET /compute/v2.1/servers/e911acec-b583-42eb-b5de-dee9573bad6c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048671 May 26 12:46:58.435951 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: [pid: 129322|app: 0|req: 448/872] 10.222.0.75 () {58 vars in 1301 bytes} [Thu May 26 12:46:58 2022] GET /compute/v2.1/servers/e911acec-b583-42eb-b5de-dee9573bad6c/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 12:46:59.443372 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi [None req-10739058-aaec-44ec-9f0d-7feb93cb4a8c tempest-TestShelveInstance-546397589 tempest-TestShelveInstance-546397589-project] Calling method '>' {{(pid=129321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:46:59.444168 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.compute.api [None req-10739058-aaec-44ec-9f0d-7feb93cb4a8c tempest-TestShelveInstance-546397589 tempest-TestShelveInstance-546397589-project] [instance: 05cf529d-df00-4ff9-b0d2-0e27563d2861] Fetching instance by UUID {{(pid=129321) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:46:59.446816 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi [None req-2c2569fe-09cb-4c9f-8cfb-8cf56d12cb22 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Calling method '>' {{(pid=129322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:46:59.447791 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.compute.api [None req-2c2569fe-09cb-4c9f-8cfb-8cf56d12cb22 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] [instance: e911acec-b583-42eb-b5de-dee9573bad6c] Fetching instance by UUID {{(pid=129322) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:46:59.451137 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-10739058-aaec-44ec-9f0d-7feb93cb4a8c tempest-TestShelveInstance-546397589 tempest-TestShelveInstance-546397589-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:46:59.451648 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-10739058-aaec-44ec-9f0d-7feb93cb4a8c tempest-TestShelveInstance-546397589 tempest-TestShelveInstance-546397589-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:46:59.452460 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-10739058-aaec-44ec-9f0d-7feb93cb4a8c tempest-TestShelveInstance-546397589 tempest-TestShelveInstance-546397589-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:46:59.452890 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-10739058-aaec-44ec-9f0d-7feb93cb4a8c tempest-TestShelveInstance-546397589 tempest-TestShelveInstance-546397589-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:46:59.454338 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-2c2569fe-09cb-4c9f-8cfb-8cf56d12cb22 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:46:59.454794 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-2c2569fe-09cb-4c9f-8cfb-8cf56d12cb22 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:46:59.455592 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-2c2569fe-09cb-4c9f-8cfb-8cf56d12cb22 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:46:59.456111 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-2c2569fe-09cb-4c9f-8cfb-8cf56d12cb22 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:46:59.489527 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: INFO nova.api.openstack.requestlog [None req-2c2569fe-09cb-4c9f-8cfb-8cf56d12cb22 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] 10.222.0.75 "GET /compute/v2.1/servers/e911acec-b583-42eb-b5de-dee9573bad6c/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.046916 May 26 12:46:59.490176 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: [pid: 129322|app: 0|req: 449/873] 10.222.0.75 () {58 vars in 1301 bytes} [Thu May 26 12:46:59 2022] GET /compute/v2.1/servers/e911acec-b583-42eb-b5de-dee9573bad6c/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 26 12:46:59.574115 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi [None req-6ea57a59-5a91-47dd-bebb-3318d1db7ede tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Calling method '>' {{(pid=129322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:46:59.574614 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.compute.api [None req-6ea57a59-5a91-47dd-bebb-3318d1db7ede tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] [instance: e911acec-b583-42eb-b5de-dee9573bad6c] Fetching instance by UUID {{(pid=129322) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:46:59.581736 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-6ea57a59-5a91-47dd-bebb-3318d1db7ede tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:46:59.582148 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-6ea57a59-5a91-47dd-bebb-3318d1db7ede tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:46:59.582946 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-6ea57a59-5a91-47dd-bebb-3318d1db7ede tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:46:59.583409 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-6ea57a59-5a91-47dd-bebb-3318d1db7ede tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:46:59.611667 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.compute.api [None req-6ea57a59-5a91-47dd-bebb-3318d1db7ede tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] [instance: e911acec-b583-42eb-b5de-dee9573bad6c] Going to try to terminate instance {{(pid=129322) delete /opt/stack/nova/nova/compute/api.py:2664}} May 26 12:46:59.703355 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: INFO nova.api.openstack.requestlog [None req-6ea57a59-5a91-47dd-bebb-3318d1db7ede tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] 10.222.0.75 "DELETE /compute/v2.1/servers/e911acec-b583-42eb-b5de-dee9573bad6c" status: 204 len: 0 microversion: 2.1 time: 0.132826 May 26 12:46:59.707719 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: [pid: 129322|app: 0|req: 450/874] 10.222.0.75 () {58 vars in 1238 bytes} [Thu May 26 12:46:59 2022] DELETE /compute/v2.1/servers/e911acec-b583-42eb-b5de-dee9573bad6c => generated 0 bytes in 135 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 26 12:46:59.713849 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi [None req-7848f7b5-c335-4ef3-9eeb-fc18b93c6b16 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Calling method '>' {{(pid=129322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:46:59.714423 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.compute.api [None req-7848f7b5-c335-4ef3-9eeb-fc18b93c6b16 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] [instance: e911acec-b583-42eb-b5de-dee9573bad6c] Fetching instance by UUID {{(pid=129322) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:46:59.720778 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-7848f7b5-c335-4ef3-9eeb-fc18b93c6b16 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:46:59.721180 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-7848f7b5-c335-4ef3-9eeb-fc18b93c6b16 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:46:59.721937 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-7848f7b5-c335-4ef3-9eeb-fc18b93c6b16 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:46:59.722364 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-7848f7b5-c335-4ef3-9eeb-fc18b93c6b16 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:46:59.764641 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.policy [None req-10739058-aaec-44ec-9f0d-7feb93cb4a8c tempest-TestShelveInstance-546397589 tempest-TestShelveInstance-546397589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d9bf2dcfce24386a1aaf9709d88da45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1f2f503ef674a4b97f848b69f8b63c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129321) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:46:59.768392 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG dbcounter [-] [129321] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=129321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:46:59.774683 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: INFO nova.api.openstack.requestlog [None req-10739058-aaec-44ec-9f0d-7feb93cb4a8c tempest-TestShelveInstance-546397589 tempest-TestShelveInstance-546397589-project] 10.222.0.75 "GET /compute/v2.1/servers/05cf529d-df00-4ff9-b0d2-0e27563d2861" status: 200 len: 1575 microversion: 2.1 time: 0.335566 May 26 12:46:59.775282 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: [pid: 129321|app: 0|req: 425/875] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 26 12:46:59 2022] GET /compute/v2.1/servers/05cf529d-df00-4ff9-b0d2-0e27563d2861 => generated 1575 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:46:59.868549 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.policy [None req-7848f7b5-c335-4ef3-9eeb-fc18b93c6b16 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0431b1f25497443ba483b3c440669080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e36ab03283d4ce6a2fed5e111e03d34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129322) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:46:59.877238 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: INFO nova.api.openstack.requestlog [None req-7848f7b5-c335-4ef3-9eeb-fc18b93c6b16 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] 10.222.0.75 "GET /compute/v2.1/servers/e911acec-b583-42eb-b5de-dee9573bad6c" status: 200 len: 1690 microversion: 2.1 time: 0.167875 May 26 12:46:59.877894 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: [pid: 129322|app: 0|req: 451/876] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 26 12:46:59 2022] GET /compute/v2.1/servers/e911acec-b583-42eb-b5de-dee9573bad6c => generated 1690 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:47:00.793938 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi [None req-06f87247-6792-468c-8397-a79244d4ec4b tempest-TestShelveInstance-546397589 tempest-TestShelveInstance-546397589-project] Calling method '>' {{(pid=129321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:47:00.794542 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.compute.api [None req-06f87247-6792-468c-8397-a79244d4ec4b tempest-TestShelveInstance-546397589 tempest-TestShelveInstance-546397589-project] [instance: 05cf529d-df00-4ff9-b0d2-0e27563d2861] Fetching instance by UUID {{(pid=129321) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:47:00.802399 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-06f87247-6792-468c-8397-a79244d4ec4b tempest-TestShelveInstance-546397589 tempest-TestShelveInstance-546397589-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:47:00.802841 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-06f87247-6792-468c-8397-a79244d4ec4b tempest-TestShelveInstance-546397589 tempest-TestShelveInstance-546397589-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:47:00.803709 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-06f87247-6792-468c-8397-a79244d4ec4b tempest-TestShelveInstance-546397589 tempest-TestShelveInstance-546397589-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:47:00.804040 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-06f87247-6792-468c-8397-a79244d4ec4b tempest-TestShelveInstance-546397589 tempest-TestShelveInstance-546397589-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:47:00.894985 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi [None req-86620cf0-7439-4c25-b192-001aeb2930d5 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Calling method '>' {{(pid=129322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:47:00.895640 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.compute.api [None req-86620cf0-7439-4c25-b192-001aeb2930d5 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] [instance: e911acec-b583-42eb-b5de-dee9573bad6c] Fetching instance by UUID {{(pid=129322) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:47:00.904942 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-86620cf0-7439-4c25-b192-001aeb2930d5 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:47:00.904942 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-86620cf0-7439-4c25-b192-001aeb2930d5 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:47:00.904942 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-86620cf0-7439-4c25-b192-001aeb2930d5 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:47:00.905365 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-86620cf0-7439-4c25-b192-001aeb2930d5 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:47:00.926870 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG dbcounter [-] [129322] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:47:00.950386 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.policy [None req-06f87247-6792-468c-8397-a79244d4ec4b tempest-TestShelveInstance-546397589 tempest-TestShelveInstance-546397589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d9bf2dcfce24386a1aaf9709d88da45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1f2f503ef674a4b97f848b69f8b63c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129321) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:47:00.959816 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: INFO nova.api.openstack.requestlog [None req-06f87247-6792-468c-8397-a79244d4ec4b tempest-TestShelveInstance-546397589 tempest-TestShelveInstance-546397589-project] 10.222.0.75 "GET /compute/v2.1/servers/05cf529d-df00-4ff9-b0d2-0e27563d2861" status: 200 len: 1575 microversion: 2.1 time: 0.170031 May 26 12:47:00.960420 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: [pid: 129321|app: 0|req: 426/877] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 26 12:47:00 2022] GET /compute/v2.1/servers/05cf529d-df00-4ff9-b0d2-0e27563d2861 => generated 1575 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:47:01.052760 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.policy [None req-86620cf0-7439-4c25-b192-001aeb2930d5 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0431b1f25497443ba483b3c440669080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e36ab03283d4ce6a2fed5e111e03d34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129322) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:47:01.065037 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: INFO nova.api.openstack.requestlog [None req-86620cf0-7439-4c25-b192-001aeb2930d5 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] 10.222.0.75 "GET /compute/v2.1/servers/e911acec-b583-42eb-b5de-dee9573bad6c" status: 200 len: 1690 microversion: 2.1 time: 0.174099 May 26 12:47:01.065770 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: [pid: 129322|app: 0|req: 452/878] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 26 12:47:00 2022] GET /compute/v2.1/servers/e911acec-b583-42eb-b5de-dee9573bad6c => generated 1690 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 12:47:01.978972 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi [None req-e0d2e5d3-2db4-4538-8e49-a1ddb652787f tempest-TestShelveInstance-546397589 tempest-TestShelveInstance-546397589-project] Calling method '>' {{(pid=129321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:47:01.979666 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.compute.api [None req-e0d2e5d3-2db4-4538-8e49-a1ddb652787f tempest-TestShelveInstance-546397589 tempest-TestShelveInstance-546397589-project] [instance: 05cf529d-df00-4ff9-b0d2-0e27563d2861] Fetching instance by UUID {{(pid=129321) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:47:01.986608 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-e0d2e5d3-2db4-4538-8e49-a1ddb652787f tempest-TestShelveInstance-546397589 tempest-TestShelveInstance-546397589-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:47:01.987055 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-e0d2e5d3-2db4-4538-8e49-a1ddb652787f tempest-TestShelveInstance-546397589 tempest-TestShelveInstance-546397589-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:47:01.987861 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-e0d2e5d3-2db4-4538-8e49-a1ddb652787f tempest-TestShelveInstance-546397589 tempest-TestShelveInstance-546397589-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:47:01.988290 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-e0d2e5d3-2db4-4538-8e49-a1ddb652787f tempest-TestShelveInstance-546397589 tempest-TestShelveInstance-546397589-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:47:02.087282 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi [None req-3033e860-7cea-48ad-b74f-9d44d46d6270 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Calling method '>' {{(pid=129322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:47:02.088243 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.compute.api [None req-3033e860-7cea-48ad-b74f-9d44d46d6270 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] [instance: e911acec-b583-42eb-b5de-dee9573bad6c] Fetching instance by UUID {{(pid=129322) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:47:02.095472 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-3033e860-7cea-48ad-b74f-9d44d46d6270 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:47:02.095964 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-3033e860-7cea-48ad-b74f-9d44d46d6270 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:47:02.096748 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-3033e860-7cea-48ad-b74f-9d44d46d6270 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:47:02.097179 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-3033e860-7cea-48ad-b74f-9d44d46d6270 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:47:02.129835 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.policy [None req-e0d2e5d3-2db4-4538-8e49-a1ddb652787f tempest-TestShelveInstance-546397589 tempest-TestShelveInstance-546397589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d9bf2dcfce24386a1aaf9709d88da45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1f2f503ef674a4b97f848b69f8b63c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129321) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:47:02.138417 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: INFO nova.api.openstack.requestlog [None req-e0d2e5d3-2db4-4538-8e49-a1ddb652787f tempest-TestShelveInstance-546397589 tempest-TestShelveInstance-546397589-project] 10.222.0.75 "GET /compute/v2.1/servers/05cf529d-df00-4ff9-b0d2-0e27563d2861" status: 200 len: 1575 microversion: 2.1 time: 0.163265 May 26 12:47:02.139232 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: [pid: 129321|app: 0|req: 427/879] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 26 12:47:01 2022] GET /compute/v2.1/servers/05cf529d-df00-4ff9-b0d2-0e27563d2861 => generated 1575 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:47:02.237736 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.policy [None req-3033e860-7cea-48ad-b74f-9d44d46d6270 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0431b1f25497443ba483b3c440669080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e36ab03283d4ce6a2fed5e111e03d34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129322) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:47:02.246860 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: INFO nova.api.openstack.requestlog [None req-3033e860-7cea-48ad-b74f-9d44d46d6270 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] 10.222.0.75 "GET /compute/v2.1/servers/e911acec-b583-42eb-b5de-dee9573bad6c" status: 200 len: 1690 microversion: 2.1 time: 0.163589 May 26 12:47:02.247438 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: [pid: 129322|app: 0|req: 453/880] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 26 12:47:02 2022] GET /compute/v2.1/servers/e911acec-b583-42eb-b5de-dee9573bad6c => generated 1690 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:47:03.156984 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi [None req-12f7197c-1c95-42f5-af8e-46e3e6bd67b0 tempest-TestShelveInstance-546397589 tempest-TestShelveInstance-546397589-project] Calling method '>' {{(pid=129321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:47:03.157560 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.compute.api [None req-12f7197c-1c95-42f5-af8e-46e3e6bd67b0 tempest-TestShelveInstance-546397589 tempest-TestShelveInstance-546397589-project] [instance: 05cf529d-df00-4ff9-b0d2-0e27563d2861] Fetching instance by UUID {{(pid=129321) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:47:03.164908 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-12f7197c-1c95-42f5-af8e-46e3e6bd67b0 tempest-TestShelveInstance-546397589 tempest-TestShelveInstance-546397589-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:47:03.165348 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-12f7197c-1c95-42f5-af8e-46e3e6bd67b0 tempest-TestShelveInstance-546397589 tempest-TestShelveInstance-546397589-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:47:03.166093 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-12f7197c-1c95-42f5-af8e-46e3e6bd67b0 tempest-TestShelveInstance-546397589 tempest-TestShelveInstance-546397589-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:47:03.166544 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-12f7197c-1c95-42f5-af8e-46e3e6bd67b0 tempest-TestShelveInstance-546397589 tempest-TestShelveInstance-546397589-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:47:03.264008 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi [None req-1dacf38b-dd7e-419b-9020-251afbaf6391 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Calling method '>' {{(pid=129322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:47:03.264629 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.compute.api [None req-1dacf38b-dd7e-419b-9020-251afbaf6391 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] [instance: e911acec-b583-42eb-b5de-dee9573bad6c] Fetching instance by UUID {{(pid=129322) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:47:03.272211 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-1dacf38b-dd7e-419b-9020-251afbaf6391 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:47:03.272658 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-1dacf38b-dd7e-419b-9020-251afbaf6391 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:47:03.273443 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-1dacf38b-dd7e-419b-9020-251afbaf6391 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:47:03.273875 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-1dacf38b-dd7e-419b-9020-251afbaf6391 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:47:03.314095 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.policy [None req-12f7197c-1c95-42f5-af8e-46e3e6bd67b0 tempest-TestShelveInstance-546397589 tempest-TestShelveInstance-546397589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d9bf2dcfce24386a1aaf9709d88da45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1f2f503ef674a4b97f848b69f8b63c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129321) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:47:03.319610 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: INFO nova.api.openstack.requestlog [None req-12f7197c-1c95-42f5-af8e-46e3e6bd67b0 tempest-TestShelveInstance-546397589 tempest-TestShelveInstance-546397589-project] 10.222.0.75 "GET /compute/v2.1/servers/05cf529d-df00-4ff9-b0d2-0e27563d2861" status: 200 len: 1575 microversion: 2.1 time: 0.167247 May 26 12:47:03.320163 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: [pid: 129321|app: 0|req: 428/881] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 26 12:47:03 2022] GET /compute/v2.1/servers/05cf529d-df00-4ff9-b0d2-0e27563d2861 => generated 1575 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:47:03.414192 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.policy [None req-1dacf38b-dd7e-419b-9020-251afbaf6391 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0431b1f25497443ba483b3c440669080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e36ab03283d4ce6a2fed5e111e03d34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129322) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:47:03.422939 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: INFO nova.api.openstack.requestlog [None req-1dacf38b-dd7e-419b-9020-251afbaf6391 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] 10.222.0.75 "GET /compute/v2.1/servers/e911acec-b583-42eb-b5de-dee9573bad6c" status: 200 len: 1690 microversion: 2.1 time: 0.162927 May 26 12:47:03.423548 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: [pid: 129322|app: 0|req: 454/882] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 26 12:47:03 2022] GET /compute/v2.1/servers/e911acec-b583-42eb-b5de-dee9573bad6c => generated 1690 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:47:04.340301 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi [None req-2809dc93-9dc0-4052-9f6c-1d68cf353451 tempest-TestShelveInstance-546397589 tempest-TestShelveInstance-546397589-project] Calling method '>' {{(pid=129321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:47:04.340942 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.compute.api [None req-2809dc93-9dc0-4052-9f6c-1d68cf353451 tempest-TestShelveInstance-546397589 tempest-TestShelveInstance-546397589-project] [instance: 05cf529d-df00-4ff9-b0d2-0e27563d2861] Fetching instance by UUID {{(pid=129321) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:47:04.349302 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-2809dc93-9dc0-4052-9f6c-1d68cf353451 tempest-TestShelveInstance-546397589 tempest-TestShelveInstance-546397589-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:47:04.349724 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-2809dc93-9dc0-4052-9f6c-1d68cf353451 tempest-TestShelveInstance-546397589 tempest-TestShelveInstance-546397589-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:47:04.350492 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-2809dc93-9dc0-4052-9f6c-1d68cf353451 tempest-TestShelveInstance-546397589 tempest-TestShelveInstance-546397589-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:47:04.350919 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-2809dc93-9dc0-4052-9f6c-1d68cf353451 tempest-TestShelveInstance-546397589 tempest-TestShelveInstance-546397589-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:47:04.440066 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi [None req-cb831167-1ea3-4086-afcd-3329093d2867 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Calling method '>' {{(pid=129322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:47:04.440667 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.compute.api [None req-cb831167-1ea3-4086-afcd-3329093d2867 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] [instance: e911acec-b583-42eb-b5de-dee9573bad6c] Fetching instance by UUID {{(pid=129322) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:47:04.447946 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-cb831167-1ea3-4086-afcd-3329093d2867 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:47:04.448392 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-cb831167-1ea3-4086-afcd-3329093d2867 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:47:04.449166 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-cb831167-1ea3-4086-afcd-3329093d2867 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:47:04.449589 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-cb831167-1ea3-4086-afcd-3329093d2867 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:47:04.503704 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.policy [None req-2809dc93-9dc0-4052-9f6c-1d68cf353451 tempest-TestShelveInstance-546397589 tempest-TestShelveInstance-546397589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d9bf2dcfce24386a1aaf9709d88da45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1f2f503ef674a4b97f848b69f8b63c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129321) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:47:04.512992 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: INFO nova.api.openstack.requestlog [None req-2809dc93-9dc0-4052-9f6c-1d68cf353451 tempest-TestShelveInstance-546397589 tempest-TestShelveInstance-546397589-project] 10.222.0.75 "GET /compute/v2.1/servers/05cf529d-df00-4ff9-b0d2-0e27563d2861" status: 200 len: 1575 microversion: 2.1 time: 0.177074 May 26 12:47:04.513573 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: [pid: 129321|app: 0|req: 429/883] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 26 12:47:04 2022] GET /compute/v2.1/servers/05cf529d-df00-4ff9-b0d2-0e27563d2861 => generated 1575 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:47:04.587076 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.policy [None req-cb831167-1ea3-4086-afcd-3329093d2867 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0431b1f25497443ba483b3c440669080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e36ab03283d4ce6a2fed5e111e03d34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129322) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:47:04.597704 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: INFO nova.api.openstack.requestlog [None req-cb831167-1ea3-4086-afcd-3329093d2867 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] 10.222.0.75 "GET /compute/v2.1/servers/e911acec-b583-42eb-b5de-dee9573bad6c" status: 200 len: 1690 microversion: 2.1 time: 0.161163 May 26 12:47:04.598324 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: [pid: 129322|app: 0|req: 455/884] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 26 12:47:04 2022] GET /compute/v2.1/servers/e911acec-b583-42eb-b5de-dee9573bad6c => generated 1690 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 12:47:05.510942 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi [req-1f76a786-580b-4da5-b066-806632f3ca6d req-43750e9a-af2c-4729-8408-14dfc466f3e6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e911acec-b583-42eb-b5de-dee9573bad6c", "name": "network-vif-deleted", "tag": "fc5a0b73-9cdf-4e1b-8b93-f12bfc2ac6a4"}]} {{(pid=129321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 12:47:05.522410 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [req-1f76a786-580b-4da5-b066-806632f3ca6d req-43750e9a-af2c-4729-8408-14dfc466f3e6 service nova] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:47:05.523242 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [req-1f76a786-580b-4da5-b066-806632f3ca6d req-43750e9a-af2c-4729-8408-14dfc466f3e6 service nova] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:47:05.536430 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi [None req-be2a3b56-7661-4b2e-a2f7-dd8458411b09 tempest-TestShelveInstance-546397589 tempest-TestShelveInstance-546397589-project] Calling method '>' {{(pid=129322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:47:05.537093 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.compute.api [None req-be2a3b56-7661-4b2e-a2f7-dd8458411b09 tempest-TestShelveInstance-546397589 tempest-TestShelveInstance-546397589-project] [instance: 05cf529d-df00-4ff9-b0d2-0e27563d2861] Fetching instance by UUID {{(pid=129322) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:47:05.544195 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-be2a3b56-7661-4b2e-a2f7-dd8458411b09 tempest-TestShelveInstance-546397589 tempest-TestShelveInstance-546397589-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:47:05.544642 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-be2a3b56-7661-4b2e-a2f7-dd8458411b09 tempest-TestShelveInstance-546397589 tempest-TestShelveInstance-546397589-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:47:05.545582 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-be2a3b56-7661-4b2e-a2f7-dd8458411b09 tempest-TestShelveInstance-546397589 tempest-TestShelveInstance-546397589-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:47:05.546264 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-be2a3b56-7661-4b2e-a2f7-dd8458411b09 tempest-TestShelveInstance-546397589 tempest-TestShelveInstance-546397589-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:47:05.554317 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: INFO nova.api.openstack.compute.server_external_events [req-1f76a786-580b-4da5-b066-806632f3ca6d req-43750e9a-af2c-4729-8408-14dfc466f3e6 service nova] Creating event network-vif-deleted:fc5a0b73-9cdf-4e1b-8b93-f12bfc2ac6a4 for instance e911acec-b583-42eb-b5de-dee9573bad6c on hv-cinder-81966 May 26 12:47:05.560958 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: INFO nova.api.openstack.requestlog [req-1f76a786-580b-4da5-b066-806632f3ca6d req-43750e9a-af2c-4729-8408-14dfc466f3e6 service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053658 May 26 12:47:05.561609 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: [pid: 129321|app: 0|req: 430/885] 10.222.0.75 () {64 vars in 1317 bytes} [Thu May 26 12:47:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 12:47:05.620507 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi [None req-0e7e8a9e-faa6-421a-8496-2f726bbe243d tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Calling method '>' {{(pid=129321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:47:05.621227 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.compute.api [None req-0e7e8a9e-faa6-421a-8496-2f726bbe243d tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] [instance: e911acec-b583-42eb-b5de-dee9573bad6c] Fetching instance by UUID {{(pid=129321) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:47:05.636846 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-0e7e8a9e-faa6-421a-8496-2f726bbe243d tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:47:05.638346 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-0e7e8a9e-faa6-421a-8496-2f726bbe243d tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:47:05.644641 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-0e7e8a9e-faa6-421a-8496-2f726bbe243d tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:47:05.648812 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-0e7e8a9e-faa6-421a-8496-2f726bbe243d tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:47:05.708160 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-0e7e8a9e-faa6-421a-8496-2f726bbe243d tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:47:05.708966 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-0e7e8a9e-faa6-421a-8496-2f726bbe243d tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:47:05.711435 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.objects.instance [None req-0e7e8a9e-faa6-421a-8496-2f726bbe243d tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lazy-loading 'fault' on Instance uuid e911acec-b583-42eb-b5de-dee9573bad6c {{(pid=129321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 26 12:47:05.771449 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.policy [None req-be2a3b56-7661-4b2e-a2f7-dd8458411b09 tempest-TestShelveInstance-546397589 tempest-TestShelveInstance-546397589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d9bf2dcfce24386a1aaf9709d88da45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1f2f503ef674a4b97f848b69f8b63c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129322) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:47:05.782063 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: INFO nova.api.openstack.requestlog [None req-be2a3b56-7661-4b2e-a2f7-dd8458411b09 tempest-TestShelveInstance-546397589 tempest-TestShelveInstance-546397589-project] 10.222.0.75 "GET /compute/v2.1/servers/05cf529d-df00-4ff9-b0d2-0e27563d2861" status: 200 len: 1575 microversion: 2.1 time: 0.255026 May 26 12:47:05.782914 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: [pid: 129322|app: 0|req: 456/886] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 26 12:47:05 2022] GET /compute/v2.1/servers/05cf529d-df00-4ff9-b0d2-0e27563d2861 => generated 1575 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 12:47:05.794739 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.policy [None req-0e7e8a9e-faa6-421a-8496-2f726bbe243d tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0431b1f25497443ba483b3c440669080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e36ab03283d4ce6a2fed5e111e03d34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129321) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:47:05.802624 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: INFO nova.api.openstack.requestlog [None req-0e7e8a9e-faa6-421a-8496-2f726bbe243d tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] 10.222.0.75 "GET /compute/v2.1/servers/e911acec-b583-42eb-b5de-dee9573bad6c" status: 200 len: 1336 microversion: 2.1 time: 0.187826 May 26 12:47:05.803212 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: [pid: 129321|app: 0|req: 431/887] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 26 12:47:05 2022] GET /compute/v2.1/servers/e911acec-b583-42eb-b5de-dee9573bad6c => generated 1336 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:47:06.803197 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi [None req-2d312488-0f41-4174-9240-7feaf49f1098 tempest-TestShelveInstance-546397589 tempest-TestShelveInstance-546397589-project] Calling method '>' {{(pid=129322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:47:06.803877 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.compute.api [None req-2d312488-0f41-4174-9240-7feaf49f1098 tempest-TestShelveInstance-546397589 tempest-TestShelveInstance-546397589-project] [instance: 05cf529d-df00-4ff9-b0d2-0e27563d2861] Fetching instance by UUID {{(pid=129322) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:47:06.810754 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-2d312488-0f41-4174-9240-7feaf49f1098 tempest-TestShelveInstance-546397589 tempest-TestShelveInstance-546397589-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:47:06.811214 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-2d312488-0f41-4174-9240-7feaf49f1098 tempest-TestShelveInstance-546397589 tempest-TestShelveInstance-546397589-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:47:06.812028 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-2d312488-0f41-4174-9240-7feaf49f1098 tempest-TestShelveInstance-546397589 tempest-TestShelveInstance-546397589-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:47:06.812467 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-2d312488-0f41-4174-9240-7feaf49f1098 tempest-TestShelveInstance-546397589 tempest-TestShelveInstance-546397589-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:47:06.823079 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi [None req-6afa9cb7-e1c0-4d47-bf81-def54d7fa983 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Calling method '>' {{(pid=129321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:47:06.824256 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.compute.api [None req-6afa9cb7-e1c0-4d47-bf81-def54d7fa983 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] [instance: e911acec-b583-42eb-b5de-dee9573bad6c] Fetching instance by UUID {{(pid=129321) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:47:06.831567 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-6afa9cb7-e1c0-4d47-bf81-def54d7fa983 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:47:06.832018 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-6afa9cb7-e1c0-4d47-bf81-def54d7fa983 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:47:06.832786 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-6afa9cb7-e1c0-4d47-bf81-def54d7fa983 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:47:06.833332 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-6afa9cb7-e1c0-4d47-bf81-def54d7fa983 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:47:06.858425 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: INFO nova.api.openstack.wsgi [None req-6afa9cb7-e1c0-4d47-bf81-def54d7fa983 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] HTTP exception thrown: Instance e911acec-b583-42eb-b5de-dee9573bad6c could not be found. May 26 12:47:06.860175 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi [None req-6afa9cb7-e1c0-4d47-bf81-def54d7fa983 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Request method failure captured: May 26 12:47:06.860175 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: request: GET /compute/v2.1/servers/e911acec-b583-42eb-b5de-dee9573bad6c HTTP/1.1 May 26 12:47:06.860175 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: Accept: application/json May 26 12:47:06.860175 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: Accept-Encoding: identity May 26 12:47:06.860175 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: Connection: close May 26 12:47:06.860175 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: Content-Length: 0 May 26 12:47:06.860175 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: Content-Type: application/json May 26 12:47:06.860175 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: Host: 10.222.0.75 May 26 12:47:06.860175 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: Openstack-System-Scope: None May 26 12:47:06.860175 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: User-Agent: python-urllib3/1.26.9 May 26 12:47:06.860175 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: X-Auth-Token: gAAAAABij3S0WbtMcFtLpl5UW4FUUirUww6kWxRFtP_FyC7fCIkKgIa10qp1d64SXO8XGZoWAnH5qdlCU3B3TdVumzT0bkV7P07uLiWhB_0UPHRg81du51UJgft-JAW7F3hpRjJiDiRCUUj2q5hZ29CV8Ux0gDDTwJGidVvj6aJ5fGBZ3S5YWD8 May 26 12:47:06.860175 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: X-Domain-Id: None May 26 12:47:06.860175 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: X-Domain-Name: None May 26 12:47:06.860175 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: X-Identity-Status: Confirmed May 26 12:47:06.860175 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: X-Is-Admin-Project: True May 26 12:47:06.860175 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: X-Project-Domain-Id: default May 26 12:47:06.860175 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: X-Project-Domain-Name: Default May 26 12:47:06.860175 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: X-Project-Id: 9e36ab03283d4ce6a2fed5e111e03d34 May 26 12:47:06.860175 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-547315860 May 26 12:47:06.860175 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: X-Role: member,reader May 26 12:47:06.860175 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: X-Roles: member,reader May 26 12:47:06.861778 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/9e36ab03283d4ce6a2fed5e111e03d34"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.75:8080", "publicURL": "http://10.222.0.75:8080/v1/AUTH_9e36ab03283d4ce6a2fed5e111e03d34"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2/9e36ab03283d4ce6a2fed5e111e03d34"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/9e36ab03283d4ce6a2fed5e111e03d34"}]}] May 26 12:47:06.861778 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: X-Tenant: tempest-ServerRescueNegativeTestJSON-547315860 May 26 12:47:06.861778 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: X-Tenant-Id: 9e36ab03283d4ce6a2fed5e111e03d34 May 26 12:47:06.861778 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-547315860 May 26 12:47:06.861778 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: X-User: tempest-ServerRescueNegativeTestJSON-547315860-project May 26 12:47:06.861778 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: X-User-Domain-Id: default May 26 12:47:06.861778 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: X-User-Domain-Name: Default May 26 12:47:06.861778 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: X-User-Id: 0431b1f25497443ba483b3c440669080 May 26 12:47:06.861778 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: X-User-Name: tempest-ServerRescueNegativeTestJSON-547315860-project May 26 12:47:06.861778 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: method: > May 26 12:47:06.861778 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: exception: Instance e911acec-b583-42eb-b5de-dee9573bad6c could not be found. May 26 12:47:06.861778 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: action_args: {'id': 'e911acec-b583-42eb-b5de-dee9573bad6c'} May 26 12:47:06.862670 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: {{(pid=129321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 12:47:06.862670 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 12:47:06.862670 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 26 12:47:06.862670 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 26 12:47:06.862670 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 26 12:47:06.862670 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 26 12:47:06.862670 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 26 12:47:06.862670 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 26 12:47:06.862670 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 26 12:47:06.862670 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 26 12:47:06.862670 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e911acec-b583-42eb-b5de-dee9573bad6c could not be found. May 26 12:47:06.862670 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi May 26 12:47:06.862670 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 12:47:06.862670 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi May 26 12:47:06.862670 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 12:47:06.862670 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 12:47:06.862670 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 12:47:06.862670 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 12:47:06.862670 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 12:47:06.862670 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 12:47:06.864424 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 12:47:06.864424 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 26 12:47:06.864424 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 26 12:47:06.864424 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 26 12:47:06.864424 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 26 12:47:06.864424 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 26 12:47:06.864424 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 12:47:06.864424 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e911acec-b583-42eb-b5de-dee9573bad6c could not be found. May 26 12:47:06.864424 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi May 26 12:47:06.864424 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 12:47:06.864424 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi May 26 12:47:06.864424 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 12:47:06.864424 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 12:47:06.864424 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 12:47:06.864424 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 12:47:06.864424 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 12:47:06.864424 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e911acec-b583-42eb-b5de-dee9573bad6c could not be found. May 26 12:47:06.864424 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi May 26 12:47:06.865808 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi [None req-6afa9cb7-e1c0-4d47-bf81-def54d7fa983 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Returning 404 to user: Instance e911acec-b583-42eb-b5de-dee9573bad6c could not be found. {{(pid=129321) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 12:47:06.865808 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: INFO nova.api.openstack.requestlog [None req-6afa9cb7-e1c0-4d47-bf81-def54d7fa983 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] 10.222.0.75 "GET /compute/v2.1/servers/e911acec-b583-42eb-b5de-dee9573bad6c" status: 404 len: 111 microversion: 2.1 time: 0.045769 May 26 12:47:06.865808 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: [pid: 129321|app: 0|req: 432/888] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 26 12:47:06 2022] GET /compute/v2.1/servers/e911acec-b583-42eb-b5de-dee9573bad6c => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 26 12:47:06.870452 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi [None req-d97c424c-ffca-4b76-99d6-1a3d1ad7e09a tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Calling method '.version_select at 0x7f82fbfca550>' {{(pid=129321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:47:06.892313 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: INFO nova.api.openstack.requestlog [None req-d97c424c-ffca-4b76-99d6-1a3d1ad7e09a tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] 10.222.0.75 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1228551541" status: 202 len: 0 microversion: 2.1 time: 0.025315 May 26 12:47:06.893012 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: [pid: 129321|app: 0|req: 433/889] 10.222.0.75 () {58 vars in 1220 bytes} [Thu May 26 12:47:06 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1228551541 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 26 12:47:06.957082 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.policy [None req-2d312488-0f41-4174-9240-7feaf49f1098 tempest-TestShelveInstance-546397589 tempest-TestShelveInstance-546397589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d9bf2dcfce24386a1aaf9709d88da45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1f2f503ef674a4b97f848b69f8b63c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129322) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:47:06.965088 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: INFO nova.api.openstack.requestlog [None req-2d312488-0f41-4174-9240-7feaf49f1098 tempest-TestShelveInstance-546397589 tempest-TestShelveInstance-546397589-project] 10.222.0.75 "GET /compute/v2.1/servers/05cf529d-df00-4ff9-b0d2-0e27563d2861" status: 200 len: 1575 microversion: 2.1 time: 0.167828 May 26 12:47:06.975427 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: [pid: 129322|app: 0|req: 457/890] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 26 12:47:06 2022] GET /compute/v2.1/servers/05cf529d-df00-4ff9-b0d2-0e27563d2861 => generated 1575 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:47:07.983300 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi [None req-15232615-3466-4a69-909d-9c007c59f34c tempest-TestShelveInstance-546397589 tempest-TestShelveInstance-546397589-project] Calling method '>' {{(pid=129321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:47:07.983989 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.compute.api [None req-15232615-3466-4a69-909d-9c007c59f34c tempest-TestShelveInstance-546397589 tempest-TestShelveInstance-546397589-project] [instance: 05cf529d-df00-4ff9-b0d2-0e27563d2861] Fetching instance by UUID {{(pid=129321) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:47:07.991582 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-15232615-3466-4a69-909d-9c007c59f34c tempest-TestShelveInstance-546397589 tempest-TestShelveInstance-546397589-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:47:07.992022 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-15232615-3466-4a69-909d-9c007c59f34c tempest-TestShelveInstance-546397589 tempest-TestShelveInstance-546397589-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:47:07.992789 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-15232615-3466-4a69-909d-9c007c59f34c tempest-TestShelveInstance-546397589 tempest-TestShelveInstance-546397589-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:47:07.993218 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-15232615-3466-4a69-909d-9c007c59f34c tempest-TestShelveInstance-546397589 tempest-TestShelveInstance-546397589-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:47:08.146320 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.policy [None req-15232615-3466-4a69-909d-9c007c59f34c tempest-TestShelveInstance-546397589 tempest-TestShelveInstance-546397589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d9bf2dcfce24386a1aaf9709d88da45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1f2f503ef674a4b97f848b69f8b63c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129321) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:47:08.155148 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: INFO nova.api.openstack.requestlog [None req-15232615-3466-4a69-909d-9c007c59f34c tempest-TestShelveInstance-546397589 tempest-TestShelveInstance-546397589-project] 10.222.0.75 "GET /compute/v2.1/servers/05cf529d-df00-4ff9-b0d2-0e27563d2861" status: 200 len: 1575 microversion: 2.1 time: 0.176337 May 26 12:47:08.155796 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: [pid: 129321|app: 0|req: 434/891] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 26 12:47:07 2022] GET /compute/v2.1/servers/05cf529d-df00-4ff9-b0d2-0e27563d2861 => generated 1575 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:47:09.105486 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi [req-19166c06-f692-40ef-901d-c78fdd97d67f req-ff6feb64-4935-4e92-af11-7821d087f013 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "05cf529d-df00-4ff9-b0d2-0e27563d2861", "name": "network-vif-plugged", "status": "completed", "tag": "6408ddad-3849-44bf-b29b-b7e4852f543d"}]} {{(pid=129322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 12:47:09.110141 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG dbcounter [-] [129322] Writing DB stats nova_api:SELECT=48,nova_api:UPDATE=1 {{(pid=129322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:47:09.118693 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [req-19166c06-f692-40ef-901d-c78fdd97d67f req-ff6feb64-4935-4e92-af11-7821d087f013 service nova] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:47:09.119159 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [req-19166c06-f692-40ef-901d-c78fdd97d67f req-ff6feb64-4935-4e92-af11-7821d087f013 service nova] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:47:09.143459 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: INFO nova.api.openstack.compute.server_external_events [req-19166c06-f692-40ef-901d-c78fdd97d67f req-ff6feb64-4935-4e92-af11-7821d087f013 service nova] Creating event network-vif-plugged:6408ddad-3849-44bf-b29b-b7e4852f543d for instance 05cf529d-df00-4ff9-b0d2-0e27563d2861 on hv-cinder-81966 May 26 12:47:09.149266 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: INFO nova.api.openstack.requestlog [req-19166c06-f692-40ef-901d-c78fdd97d67f req-ff6feb64-4935-4e92-af11-7821d087f013 service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047897 May 26 12:47:09.149923 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: [pid: 129322|app: 0|req: 458/892] 10.222.0.75 () {64 vars in 1317 bytes} [Thu May 26 12:47:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 26 12:47:09.175142 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi [None req-dbe045e6-52cd-4931-a18b-f37ce7172af2 tempest-TestShelveInstance-546397589 tempest-TestShelveInstance-546397589-project] Calling method '>' {{(pid=129321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:47:09.177056 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.compute.api [None req-dbe045e6-52cd-4931-a18b-f37ce7172af2 tempest-TestShelveInstance-546397589 tempest-TestShelveInstance-546397589-project] [instance: 05cf529d-df00-4ff9-b0d2-0e27563d2861] Fetching instance by UUID {{(pid=129321) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:47:09.179696 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG dbcounter [-] [129321] Writing DB stats nova_api:SELECT=50,nova_api:DELETE=1 {{(pid=129321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:47:09.185626 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-dbe045e6-52cd-4931-a18b-f37ce7172af2 tempest-TestShelveInstance-546397589 tempest-TestShelveInstance-546397589-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:47:09.186014 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-dbe045e6-52cd-4931-a18b-f37ce7172af2 tempest-TestShelveInstance-546397589 tempest-TestShelveInstance-546397589-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:47:09.186748 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-dbe045e6-52cd-4931-a18b-f37ce7172af2 tempest-TestShelveInstance-546397589 tempest-TestShelveInstance-546397589-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:47:09.187173 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-dbe045e6-52cd-4931-a18b-f37ce7172af2 tempest-TestShelveInstance-546397589 tempest-TestShelveInstance-546397589-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:47:09.341963 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.policy [None req-dbe045e6-52cd-4931-a18b-f37ce7172af2 tempest-TestShelveInstance-546397589 tempest-TestShelveInstance-546397589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d9bf2dcfce24386a1aaf9709d88da45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1f2f503ef674a4b97f848b69f8b63c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129321) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:47:09.353159 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: INFO nova.api.openstack.requestlog [None req-dbe045e6-52cd-4931-a18b-f37ce7172af2 tempest-TestShelveInstance-546397589 tempest-TestShelveInstance-546397589-project] 10.222.0.75 "GET /compute/v2.1/servers/05cf529d-df00-4ff9-b0d2-0e27563d2861" status: 200 len: 1575 microversion: 2.1 time: 0.183424 May 26 12:47:09.353742 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: [pid: 129321|app: 0|req: 435/893] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 26 12:47:09 2022] GET /compute/v2.1/servers/05cf529d-df00-4ff9-b0d2-0e27563d2861 => generated 1575 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:47:09.833300 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi [None req-c87ce059-aae5-48ee-9b7d-1a04a6eedbc2 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Calling method '>' {{(pid=129322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:47:09.833889 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.compute.api [None req-c87ce059-aae5-48ee-9b7d-1a04a6eedbc2 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] [instance: 605b9171-aa87-432a-b179-c552640e73dd] Fetching instance by UUID {{(pid=129322) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:47:09.843293 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-c87ce059-aae5-48ee-9b7d-1a04a6eedbc2 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:47:09.843832 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-c87ce059-aae5-48ee-9b7d-1a04a6eedbc2 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:47:09.844760 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-c87ce059-aae5-48ee-9b7d-1a04a6eedbc2 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:47:09.845195 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-c87ce059-aae5-48ee-9b7d-1a04a6eedbc2 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:47:09.883867 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.compute.api [None req-c87ce059-aae5-48ee-9b7d-1a04a6eedbc2 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] [instance: 605b9171-aa87-432a-b179-c552640e73dd] Going to try to terminate instance {{(pid=129322) delete /opt/stack/nova/nova/compute/api.py:2664}} May 26 12:47:09.972740 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: INFO nova.api.openstack.requestlog [None req-c87ce059-aae5-48ee-9b7d-1a04a6eedbc2 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] 10.222.0.75 "DELETE /compute/v2.1/servers/605b9171-aa87-432a-b179-c552640e73dd" status: 204 len: 0 microversion: 2.1 time: 0.144271 May 26 12:47:09.974176 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: [pid: 129322|app: 0|req: 459/894] 10.222.0.75 () {58 vars in 1238 bytes} [Thu May 26 12:47:09 2022] DELETE /compute/v2.1/servers/605b9171-aa87-432a-b179-c552640e73dd => generated 0 bytes in 148 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 26 12:47:09.982301 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi [None req-4915ac88-aaf8-4497-a1ba-18c85aaa4522 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Calling method '>' {{(pid=129321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:47:09.982927 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.compute.api [None req-4915ac88-aaf8-4497-a1ba-18c85aaa4522 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] [instance: 605b9171-aa87-432a-b179-c552640e73dd] Fetching instance by UUID {{(pid=129321) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:47:09.998800 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-4915ac88-aaf8-4497-a1ba-18c85aaa4522 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:47:09.999193 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-4915ac88-aaf8-4497-a1ba-18c85aaa4522 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:47:10.002581 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-4915ac88-aaf8-4497-a1ba-18c85aaa4522 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:47:10.003244 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-4915ac88-aaf8-4497-a1ba-18c85aaa4522 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:47:10.171343 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.policy [None req-4915ac88-aaf8-4497-a1ba-18c85aaa4522 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0431b1f25497443ba483b3c440669080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e36ab03283d4ce6a2fed5e111e03d34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129321) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:47:10.180198 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: INFO nova.api.openstack.requestlog [None req-4915ac88-aaf8-4497-a1ba-18c85aaa4522 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] 10.222.0.75 "GET /compute/v2.1/servers/605b9171-aa87-432a-b179-c552640e73dd" status: 200 len: 1508 microversion: 2.1 time: 0.201812 May 26 12:47:10.180846 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: [pid: 129321|app: 0|req: 436/895] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 26 12:47:09 2022] GET /compute/v2.1/servers/605b9171-aa87-432a-b179-c552640e73dd => generated 1508 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:47:10.441000 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi [None req-0a67a2d6-309d-49b6-af91-96acce9a409b tempest-TestMinimumBasicScenario-102576986 tempest-TestMinimumBasicScenario-102576986-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-291455924"}} {{(pid=129322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 12:47:10.441600 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.compute.api [None req-0a67a2d6-309d-49b6-af91-96acce9a409b tempest-TestMinimumBasicScenario-102576986 tempest-TestMinimumBasicScenario-102576986-project] [instance: 76661008-e6d3-4646-a9ba-d5d0e83a4b65] Fetching instance by UUID {{(pid=129322) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:47:10.448228 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-0a67a2d6-309d-49b6-af91-96acce9a409b tempest-TestMinimumBasicScenario-102576986 tempest-TestMinimumBasicScenario-102576986-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:47:10.448672 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-0a67a2d6-309d-49b6-af91-96acce9a409b tempest-TestMinimumBasicScenario-102576986 tempest-TestMinimumBasicScenario-102576986-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:47:10.449450 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-0a67a2d6-309d-49b6-af91-96acce9a409b tempest-TestMinimumBasicScenario-102576986 tempest-TestMinimumBasicScenario-102576986-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:47:10.449885 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-0a67a2d6-309d-49b6-af91-96acce9a409b tempest-TestMinimumBasicScenario-102576986 tempest-TestMinimumBasicScenario-102576986-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:47:10.475952 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi [None req-5a1d77c7-5ab4-4a1b-9515-3183311bed6a tempest-TestShelveInstance-546397589 tempest-TestShelveInstance-546397589-project] Calling method '>' {{(pid=129321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:47:10.476566 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.compute.api [None req-5a1d77c7-5ab4-4a1b-9515-3183311bed6a tempest-TestShelveInstance-546397589 tempest-TestShelveInstance-546397589-project] [instance: 05cf529d-df00-4ff9-b0d2-0e27563d2861] Fetching instance by UUID {{(pid=129321) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:47:10.483070 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-5a1d77c7-5ab4-4a1b-9515-3183311bed6a tempest-TestShelveInstance-546397589 tempest-TestShelveInstance-546397589-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:47:10.483525 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-5a1d77c7-5ab4-4a1b-9515-3183311bed6a tempest-TestShelveInstance-546397589 tempest-TestShelveInstance-546397589-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:47:10.484335 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-5a1d77c7-5ab4-4a1b-9515-3183311bed6a tempest-TestShelveInstance-546397589 tempest-TestShelveInstance-546397589-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:47:10.484763 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-5a1d77c7-5ab4-4a1b-9515-3183311bed6a tempest-TestShelveInstance-546397589 tempest-TestShelveInstance-546397589-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:47:10.590206 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: INFO nova.network.security_group_api [None req-0a67a2d6-309d-49b6-af91-96acce9a409b tempest-TestMinimumBasicScenario-102576986 tempest-TestMinimumBasicScenario-102576986-project] Removing security group 3370a4d8-716a-4536-a60f-b07cbf0f7ade from port 4aebdf54-88c1-42d5-a224-778a4410cff0 May 26 12:47:10.620265 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.policy [None req-5a1d77c7-5ab4-4a1b-9515-3183311bed6a tempest-TestShelveInstance-546397589 tempest-TestShelveInstance-546397589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d9bf2dcfce24386a1aaf9709d88da45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1f2f503ef674a4b97f848b69f8b63c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129321) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:47:10.628579 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: INFO nova.api.openstack.requestlog [None req-5a1d77c7-5ab4-4a1b-9515-3183311bed6a tempest-TestShelveInstance-546397589 tempest-TestShelveInstance-546397589-project] 10.222.0.75 "GET /compute/v2.1/servers/05cf529d-df00-4ff9-b0d2-0e27563d2861" status: 200 len: 1575 microversion: 2.1 time: 0.261806 May 26 12:47:10.629123 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: [pid: 129321|app: 0|req: 437/896] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 26 12:47:10 2022] GET /compute/v2.1/servers/05cf529d-df00-4ff9-b0d2-0e27563d2861 => generated 1575 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:47:11.001900 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: INFO nova.api.openstack.requestlog [None req-0a67a2d6-309d-49b6-af91-96acce9a409b tempest-TestMinimumBasicScenario-102576986 tempest-TestMinimumBasicScenario-102576986-project] 10.222.0.75 "POST /compute/v2.1/servers/76661008-e6d3-4646-a9ba-d5d0e83a4b65/action" status: 202 len: 0 microversion: 2.1 time: 0.680772 May 26 12:47:11.003221 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: [pid: 129322|app: 0|req: 460/897] 10.222.0.75 () {60 vars in 1277 bytes} [Thu May 26 12:47:10 2022] POST /compute/v2.1/servers/76661008-e6d3-4646-a9ba-d5d0e83a4b65/action => generated 0 bytes in 683 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 26 12:47:11.011875 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi [req-d3f25971-b967-460a-864a-7ef96a01e531 req-b94a65cb-933c-4c73-9b6f-af7d8e769634 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "76661008-e6d3-4646-a9ba-d5d0e83a4b65", "tag": "4aebdf54-88c1-42d5-a224-778a4410cff0"}]} {{(pid=129321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 12:47:11.021622 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [req-d3f25971-b967-460a-864a-7ef96a01e531 req-b94a65cb-933c-4c73-9b6f-af7d8e769634 service nova] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:47:11.021930 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [req-d3f25971-b967-460a-864a-7ef96a01e531 req-b94a65cb-933c-4c73-9b6f-af7d8e769634 service nova] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:47:11.034806 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: INFO nova.api.openstack.compute.server_external_events [req-d3f25971-b967-460a-864a-7ef96a01e531 req-b94a65cb-933c-4c73-9b6f-af7d8e769634 service nova] Creating event network-changed:4aebdf54-88c1-42d5-a224-778a4410cff0 for instance 76661008-e6d3-4646-a9ba-d5d0e83a4b65 on hv-cinder-81966 May 26 12:47:11.054000 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: INFO nova.api.openstack.requestlog [req-d3f25971-b967-460a-864a-7ef96a01e531 req-b94a65cb-933c-4c73-9b6f-af7d8e769634 service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044939 May 26 12:47:11.054967 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: [pid: 129321|app: 0|req: 438/898] 10.222.0.75 () {64 vars in 1317 bytes} [Thu May 26 12:47:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 12:47:11.198173 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi [None req-972dfaf9-15cd-47ba-aa26-1098dbfb607d tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Calling method '>' {{(pid=129322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:47:11.202977 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.compute.api [None req-972dfaf9-15cd-47ba-aa26-1098dbfb607d tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] [instance: 605b9171-aa87-432a-b179-c552640e73dd] Fetching instance by UUID {{(pid=129322) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:47:11.218242 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-972dfaf9-15cd-47ba-aa26-1098dbfb607d tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:47:11.218698 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-972dfaf9-15cd-47ba-aa26-1098dbfb607d tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:47:11.219475 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-972dfaf9-15cd-47ba-aa26-1098dbfb607d tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:47:11.219928 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-972dfaf9-15cd-47ba-aa26-1098dbfb607d tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:47:11.534946 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.policy [None req-972dfaf9-15cd-47ba-aa26-1098dbfb607d tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0431b1f25497443ba483b3c440669080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e36ab03283d4ce6a2fed5e111e03d34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129322) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:47:11.543571 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: INFO nova.api.openstack.requestlog [None req-972dfaf9-15cd-47ba-aa26-1098dbfb607d tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] 10.222.0.75 "GET /compute/v2.1/servers/605b9171-aa87-432a-b179-c552640e73dd" status: 200 len: 1508 microversion: 2.1 time: 0.349260 May 26 12:47:11.544338 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: [pid: 129322|app: 0|req: 461/899] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 26 12:47:11 2022] GET /compute/v2.1/servers/605b9171-aa87-432a-b179-c552640e73dd => generated 1508 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:47:11.647469 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi [None req-f7fe0f88-a566-471d-a72d-386add0cba62 tempest-TestShelveInstance-546397589 tempest-TestShelveInstance-546397589-project] Calling method '>' {{(pid=129321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:47:11.648187 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.compute.api [None req-f7fe0f88-a566-471d-a72d-386add0cba62 tempest-TestShelveInstance-546397589 tempest-TestShelveInstance-546397589-project] [instance: 05cf529d-df00-4ff9-b0d2-0e27563d2861] Fetching instance by UUID {{(pid=129321) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:47:11.655844 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-f7fe0f88-a566-471d-a72d-386add0cba62 tempest-TestShelveInstance-546397589 tempest-TestShelveInstance-546397589-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:47:11.656299 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-f7fe0f88-a566-471d-a72d-386add0cba62 tempest-TestShelveInstance-546397589 tempest-TestShelveInstance-546397589-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:47:11.657084 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-f7fe0f88-a566-471d-a72d-386add0cba62 tempest-TestShelveInstance-546397589 tempest-TestShelveInstance-546397589-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:47:11.657523 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-f7fe0f88-a566-471d-a72d-386add0cba62 tempest-TestShelveInstance-546397589 tempest-TestShelveInstance-546397589-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:47:11.810490 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.policy [None req-f7fe0f88-a566-471d-a72d-386add0cba62 tempest-TestShelveInstance-546397589 tempest-TestShelveInstance-546397589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d9bf2dcfce24386a1aaf9709d88da45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1f2f503ef674a4b97f848b69f8b63c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129321) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:47:11.819261 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: INFO nova.api.openstack.requestlog [None req-f7fe0f88-a566-471d-a72d-386add0cba62 tempest-TestShelveInstance-546397589 tempest-TestShelveInstance-546397589-project] 10.222.0.75 "GET /compute/v2.1/servers/05cf529d-df00-4ff9-b0d2-0e27563d2861" status: 200 len: 1562 microversion: 2.1 time: 0.176411 May 26 12:47:11.819867 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: [pid: 129321|app: 0|req: 439/900] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 26 12:47:11 2022] GET /compute/v2.1/servers/05cf529d-df00-4ff9-b0d2-0e27563d2861 => generated 1562 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:47:12.225278 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi [None req-391ab4eb-da67-49ee-b210-32f62a3fc32c tempest-TestMinimumBasicScenario-102576986 tempest-TestMinimumBasicScenario-102576986-project] Calling method '>' {{(pid=129322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:47:12.225855 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.compute.api [None req-391ab4eb-da67-49ee-b210-32f62a3fc32c tempest-TestMinimumBasicScenario-102576986 tempest-TestMinimumBasicScenario-102576986-project] [instance: 76661008-e6d3-4646-a9ba-d5d0e83a4b65] Fetching instance by UUID {{(pid=129322) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:47:12.232127 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-391ab4eb-da67-49ee-b210-32f62a3fc32c tempest-TestMinimumBasicScenario-102576986 tempest-TestMinimumBasicScenario-102576986-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:47:12.232992 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-391ab4eb-da67-49ee-b210-32f62a3fc32c tempest-TestMinimumBasicScenario-102576986 tempest-TestMinimumBasicScenario-102576986-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:47:12.233808 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-391ab4eb-da67-49ee-b210-32f62a3fc32c tempest-TestMinimumBasicScenario-102576986 tempest-TestMinimumBasicScenario-102576986-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:47:12.234389 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-391ab4eb-da67-49ee-b210-32f62a3fc32c tempest-TestMinimumBasicScenario-102576986 tempest-TestMinimumBasicScenario-102576986-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:47:12.335285 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.objects.instance [None req-391ab4eb-da67-49ee-b210-32f62a3fc32c tempest-TestMinimumBasicScenario-102576986 tempest-TestMinimumBasicScenario-102576986-project] Lazy-loading 'services' on Instance uuid 76661008-e6d3-4646-a9ba-d5d0e83a4b65 {{(pid=129322) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 26 12:47:12.413858 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: INFO nova.api.openstack.requestlog [None req-391ab4eb-da67-49ee-b210-32f62a3fc32c tempest-TestMinimumBasicScenario-102576986 tempest-TestMinimumBasicScenario-102576986-project] 10.222.0.75 "DELETE /compute/v2.1/servers/76661008-e6d3-4646-a9ba-d5d0e83a4b65/os-volume_attachments/abf921a4-40ef-4fd1-97e5-c25de2c53323" status: 202 len: 0 microversion: 2.1 time: 0.193097 May 26 12:47:12.415024 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: [pid: 129322|app: 0|req: 462/901] 10.222.0.75 () {58 vars in 1415 bytes} [Thu May 26 12:47:12 2022] DELETE /compute/v2.1/servers/76661008-e6d3-4646-a9ba-d5d0e83a4b65/os-volume_attachments/abf921a4-40ef-4fd1-97e5-c25de2c53323 => generated 0 bytes in 195 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 26 12:47:12.431665 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi [None req-2b910b7a-3ac6-476b-ae18-79b24ca2c8f8 tempest-TestMinimumBasicScenario-102576986 tempest-TestMinimumBasicScenario-102576986-project] Calling method '>' {{(pid=129321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:47:12.436263 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.compute.api [None req-2b910b7a-3ac6-476b-ae18-79b24ca2c8f8 tempest-TestMinimumBasicScenario-102576986 tempest-TestMinimumBasicScenario-102576986-project] [instance: 76661008-e6d3-4646-a9ba-d5d0e83a4b65] Fetching instance by UUID {{(pid=129321) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:47:12.450546 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-2b910b7a-3ac6-476b-ae18-79b24ca2c8f8 tempest-TestMinimumBasicScenario-102576986 tempest-TestMinimumBasicScenario-102576986-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:47:12.451281 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-2b910b7a-3ac6-476b-ae18-79b24ca2c8f8 tempest-TestMinimumBasicScenario-102576986 tempest-TestMinimumBasicScenario-102576986-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:47:12.452263 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-2b910b7a-3ac6-476b-ae18-79b24ca2c8f8 tempest-TestMinimumBasicScenario-102576986 tempest-TestMinimumBasicScenario-102576986-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:47:12.452839 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-2b910b7a-3ac6-476b-ae18-79b24ca2c8f8 tempest-TestMinimumBasicScenario-102576986 tempest-TestMinimumBasicScenario-102576986-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:47:12.493838 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: INFO nova.api.openstack.requestlog [None req-2b910b7a-3ac6-476b-ae18-79b24ca2c8f8 tempest-TestMinimumBasicScenario-102576986 tempest-TestMinimumBasicScenario-102576986-project] 10.222.0.75 "GET /compute/v2.1/servers/76661008-e6d3-4646-a9ba-d5d0e83a4b65/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.074215 May 26 12:47:12.498141 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: [pid: 129321|app: 0|req: 440/902] 10.222.0.75 () {58 vars in 1301 bytes} [Thu May 26 12:47:12 2022] GET /compute/v2.1/servers/76661008-e6d3-4646-a9ba-d5d0e83a4b65/os-volume_attachments => generated 197 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 12:47:12.562858 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi [None req-0072591d-e736-4859-b6ca-d71018a5ab91 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Calling method '>' {{(pid=129322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:47:12.564674 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.compute.api [None req-0072591d-e736-4859-b6ca-d71018a5ab91 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] [instance: 605b9171-aa87-432a-b179-c552640e73dd] Fetching instance by UUID {{(pid=129322) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:47:12.572314 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-0072591d-e736-4859-b6ca-d71018a5ab91 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:47:12.573139 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-0072591d-e736-4859-b6ca-d71018a5ab91 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:47:12.574045 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-0072591d-e736-4859-b6ca-d71018a5ab91 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:47:12.574575 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-0072591d-e736-4859-b6ca-d71018a5ab91 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:47:12.646800 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.policy [None req-0072591d-e736-4859-b6ca-d71018a5ab91 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0431b1f25497443ba483b3c440669080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e36ab03283d4ce6a2fed5e111e03d34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129322) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:47:12.655494 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: INFO nova.api.openstack.requestlog [None req-0072591d-e736-4859-b6ca-d71018a5ab91 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] 10.222.0.75 "GET /compute/v2.1/servers/605b9171-aa87-432a-b179-c552640e73dd" status: 200 len: 1466 microversion: 2.1 time: 0.097543 May 26 12:47:12.656381 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: [pid: 129322|app: 0|req: 463/903] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 26 12:47:12 2022] GET /compute/v2.1/servers/605b9171-aa87-432a-b179-c552640e73dd => generated 1466 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:47:12.829202 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi [req-6993e521-52ac-4878-87b0-6c8e8f2c8934 req-c76616d2-53aa-482f-963c-157ab821ad3a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "605b9171-aa87-432a-b179-c552640e73dd", "name": "network-vif-deleted", "tag": "58cde015-97f9-4885-b302-d0f8a82a584c"}]} {{(pid=129321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 12:47:12.838262 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [req-6993e521-52ac-4878-87b0-6c8e8f2c8934 req-c76616d2-53aa-482f-963c-157ab821ad3a service nova] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:47:12.838717 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [req-6993e521-52ac-4878-87b0-6c8e8f2c8934 req-c76616d2-53aa-482f-963c-157ab821ad3a service nova] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:47:12.851171 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: INFO nova.api.openstack.compute.server_external_events [req-6993e521-52ac-4878-87b0-6c8e8f2c8934 req-c76616d2-53aa-482f-963c-157ab821ad3a service nova] Creating event network-vif-deleted:58cde015-97f9-4885-b302-d0f8a82a584c for instance 605b9171-aa87-432a-b179-c552640e73dd on hv-cinder-81966 May 26 12:47:12.856328 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: INFO nova.api.openstack.requestlog [req-6993e521-52ac-4878-87b0-6c8e8f2c8934 req-c76616d2-53aa-482f-963c-157ab821ad3a service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030907 May 26 12:47:12.857160 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: [pid: 129321|app: 0|req: 441/904] 10.222.0.75 () {64 vars in 1317 bytes} [Thu May 26 12:47:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 12:47:13.070373 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi [req-87c4487d-482b-4676-9c98-86be96b7cd8d req-8f2313a9-49ac-4233-a9c3-aaef5eedc9e5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "76661008-e6d3-4646-a9ba-d5d0e83a4b65", "tag": "4aebdf54-88c1-42d5-a224-778a4410cff0"}]} {{(pid=129322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 12:47:13.101305 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [req-87c4487d-482b-4676-9c98-86be96b7cd8d req-8f2313a9-49ac-4233-a9c3-aaef5eedc9e5 service nova] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:47:13.101973 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [req-87c4487d-482b-4676-9c98-86be96b7cd8d req-8f2313a9-49ac-4233-a9c3-aaef5eedc9e5 service nova] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:47:13.117822 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: INFO nova.api.openstack.compute.server_external_events [req-87c4487d-482b-4676-9c98-86be96b7cd8d req-8f2313a9-49ac-4233-a9c3-aaef5eedc9e5 service nova] Creating event network-changed:4aebdf54-88c1-42d5-a224-778a4410cff0 for instance 76661008-e6d3-4646-a9ba-d5d0e83a4b65 on hv-cinder-81966 May 26 12:47:13.123640 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: INFO nova.api.openstack.requestlog [req-87c4487d-482b-4676-9c98-86be96b7cd8d req-8f2313a9-49ac-4233-a9c3-aaef5eedc9e5 service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057427 May 26 12:47:13.124603 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: [pid: 129322|app: 0|req: 464/905] 10.222.0.75 () {64 vars in 1317 bytes} [Thu May 26 12:47:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 12:47:13.507362 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi [None req-135a64c5-2339-4af1-8fc8-db0a4e30a70d tempest-TestMinimumBasicScenario-102576986 tempest-TestMinimumBasicScenario-102576986-project] Calling method '>' {{(pid=129321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:47:13.508464 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.compute.api [None req-135a64c5-2339-4af1-8fc8-db0a4e30a70d tempest-TestMinimumBasicScenario-102576986 tempest-TestMinimumBasicScenario-102576986-project] [instance: 76661008-e6d3-4646-a9ba-d5d0e83a4b65] Fetching instance by UUID {{(pid=129321) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:47:13.517079 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-135a64c5-2339-4af1-8fc8-db0a4e30a70d tempest-TestMinimumBasicScenario-102576986 tempest-TestMinimumBasicScenario-102576986-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:47:13.518261 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-135a64c5-2339-4af1-8fc8-db0a4e30a70d tempest-TestMinimumBasicScenario-102576986 tempest-TestMinimumBasicScenario-102576986-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:47:13.519520 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-135a64c5-2339-4af1-8fc8-db0a4e30a70d tempest-TestMinimumBasicScenario-102576986 tempest-TestMinimumBasicScenario-102576986-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:47:13.520658 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-135a64c5-2339-4af1-8fc8-db0a4e30a70d tempest-TestMinimumBasicScenario-102576986 tempest-TestMinimumBasicScenario-102576986-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:47:13.566661 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: INFO nova.api.openstack.requestlog [None req-135a64c5-2339-4af1-8fc8-db0a4e30a70d tempest-TestMinimumBasicScenario-102576986 tempest-TestMinimumBasicScenario-102576986-project] 10.222.0.75 "GET /compute/v2.1/servers/76661008-e6d3-4646-a9ba-d5d0e83a4b65/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.063841 May 26 12:47:13.567619 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: [pid: 129321|app: 0|req: 442/906] 10.222.0.75 () {58 vars in 1301 bytes} [Thu May 26 12:47:13 2022] GET /compute/v2.1/servers/76661008-e6d3-4646-a9ba-d5d0e83a4b65/os-volume_attachments => generated 197 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 12:47:13.675465 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi [None req-c2be4632-bc24-4dda-9a31-55d80a4a1a1e tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Calling method '>' {{(pid=129322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:47:13.677979 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.compute.api [None req-c2be4632-bc24-4dda-9a31-55d80a4a1a1e tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] [instance: 605b9171-aa87-432a-b179-c552640e73dd] Fetching instance by UUID {{(pid=129322) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:47:13.695067 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-c2be4632-bc24-4dda-9a31-55d80a4a1a1e tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:47:13.695503 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-c2be4632-bc24-4dda-9a31-55d80a4a1a1e tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:47:13.696296 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-c2be4632-bc24-4dda-9a31-55d80a4a1a1e tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:47:13.696723 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-c2be4632-bc24-4dda-9a31-55d80a4a1a1e tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:47:13.730997 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-c2be4632-bc24-4dda-9a31-55d80a4a1a1e tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:47:13.731441 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-c2be4632-bc24-4dda-9a31-55d80a4a1a1e tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:47:13.731916 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.objects.instance [None req-c2be4632-bc24-4dda-9a31-55d80a4a1a1e tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lazy-loading 'fault' on Instance uuid 605b9171-aa87-432a-b179-c552640e73dd {{(pid=129322) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 26 12:47:13.784618 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.policy [None req-c2be4632-bc24-4dda-9a31-55d80a4a1a1e tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0431b1f25497443ba483b3c440669080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e36ab03283d4ce6a2fed5e111e03d34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129322) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:47:13.798615 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: INFO nova.api.openstack.requestlog [None req-c2be4632-bc24-4dda-9a31-55d80a4a1a1e tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] 10.222.0.75 "GET /compute/v2.1/servers/605b9171-aa87-432a-b179-c552640e73dd" status: 200 len: 1312 microversion: 2.1 time: 0.128882 May 26 12:47:13.799750 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: [pid: 129322|app: 0|req: 465/907] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 26 12:47:13 2022] GET /compute/v2.1/servers/605b9171-aa87-432a-b179-c552640e73dd => generated 1312 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:47:14.580423 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi [None req-9bc8b754-06c3-42b5-9590-b9233128071d tempest-TestMinimumBasicScenario-102576986 tempest-TestMinimumBasicScenario-102576986-project] Calling method '>' {{(pid=129321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:47:14.581405 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.compute.api [None req-9bc8b754-06c3-42b5-9590-b9233128071d tempest-TestMinimumBasicScenario-102576986 tempest-TestMinimumBasicScenario-102576986-project] [instance: 76661008-e6d3-4646-a9ba-d5d0e83a4b65] Fetching instance by UUID {{(pid=129321) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:47:14.588724 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-9bc8b754-06c3-42b5-9590-b9233128071d tempest-TestMinimumBasicScenario-102576986 tempest-TestMinimumBasicScenario-102576986-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:47:14.589166 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-9bc8b754-06c3-42b5-9590-b9233128071d tempest-TestMinimumBasicScenario-102576986 tempest-TestMinimumBasicScenario-102576986-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:47:14.589934 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-9bc8b754-06c3-42b5-9590-b9233128071d tempest-TestMinimumBasicScenario-102576986 tempest-TestMinimumBasicScenario-102576986-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:47:14.590342 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-9bc8b754-06c3-42b5-9590-b9233128071d tempest-TestMinimumBasicScenario-102576986 tempest-TestMinimumBasicScenario-102576986-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:47:14.621520 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: INFO nova.api.openstack.requestlog [None req-9bc8b754-06c3-42b5-9590-b9233128071d tempest-TestMinimumBasicScenario-102576986 tempest-TestMinimumBasicScenario-102576986-project] 10.222.0.75 "GET /compute/v2.1/servers/76661008-e6d3-4646-a9ba-d5d0e83a4b65/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045411 May 26 12:47:14.622077 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: [pid: 129321|app: 0|req: 443/908] 10.222.0.75 () {58 vars in 1301 bytes} [Thu May 26 12:47:14 2022] GET /compute/v2.1/servers/76661008-e6d3-4646-a9ba-d5d0e83a4b65/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 26 12:47:14.636779 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi [None req-958c93ac-f0e2-4053-b1bf-3df931f4bb7b tempest-TestMinimumBasicScenario-102576986 tempest-TestMinimumBasicScenario-102576986-project] Calling method '>' {{(pid=129322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:47:14.638217 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.compute.api [None req-958c93ac-f0e2-4053-b1bf-3df931f4bb7b tempest-TestMinimumBasicScenario-102576986 tempest-TestMinimumBasicScenario-102576986-project] [instance: 76661008-e6d3-4646-a9ba-d5d0e83a4b65] Fetching instance by UUID {{(pid=129322) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:47:14.651105 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-958c93ac-f0e2-4053-b1bf-3df931f4bb7b tempest-TestMinimumBasicScenario-102576986 tempest-TestMinimumBasicScenario-102576986-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:47:14.651939 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-958c93ac-f0e2-4053-b1bf-3df931f4bb7b tempest-TestMinimumBasicScenario-102576986 tempest-TestMinimumBasicScenario-102576986-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:47:14.653210 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-958c93ac-f0e2-4053-b1bf-3df931f4bb7b tempest-TestMinimumBasicScenario-102576986 tempest-TestMinimumBasicScenario-102576986-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:47:14.653894 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-958c93ac-f0e2-4053-b1bf-3df931f4bb7b tempest-TestMinimumBasicScenario-102576986 tempest-TestMinimumBasicScenario-102576986-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:47:14.737200 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: INFO nova.api.openstack.wsgi [None req-958c93ac-f0e2-4053-b1bf-3df931f4bb7b tempest-TestMinimumBasicScenario-102576986 tempest-TestMinimumBasicScenario-102576986-project] HTTP exception thrown: Instance 76661008-e6d3-4646-a9ba-d5d0e83a4b65 is not attached to volume abf921a4-40ef-4fd1-97e5-c25de2c53323 May 26 12:47:14.750733 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi [None req-958c93ac-f0e2-4053-b1bf-3df931f4bb7b tempest-TestMinimumBasicScenario-102576986 tempest-TestMinimumBasicScenario-102576986-project] Request method failure captured: May 26 12:47:14.750733 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: request: DELETE /compute/v2.1/servers/76661008-e6d3-4646-a9ba-d5d0e83a4b65/os-volume_attachments/abf921a4-40ef-4fd1-97e5-c25de2c53323 HTTP/1.1 May 26 12:47:14.750733 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: Accept: application/json May 26 12:47:14.750733 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: Accept-Encoding: identity May 26 12:47:14.750733 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: Connection: close May 26 12:47:14.750733 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: Content-Length: 0 May 26 12:47:14.750733 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: Content-Type: application/json May 26 12:47:14.750733 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: Host: 10.222.0.75 May 26 12:47:14.750733 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: Openstack-System-Scope: None May 26 12:47:14.750733 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: User-Agent: python-urllib3/1.26.9 May 26 12:47:14.750733 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: X-Auth-Token: gAAAAABij3WBHouzcOIM3ueZjIeZZ9kZi7UXbNh_q_jHqlSEbtFe7RKyDYU6B57ljz2gIzJBSmEJOF5ufGfyuWg7EFSs4TUvdbSabIsvVGadhqAzFTn1dEn7w8jA2ntILCJXMzI5HctVENQGhLCzTTCTTbp__zwT7Rfxq55WJJd-oGAHjRTk_PU May 26 12:47:14.750733 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: X-Domain-Id: None May 26 12:47:14.750733 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: X-Domain-Name: None May 26 12:47:14.750733 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: X-Identity-Status: Confirmed May 26 12:47:14.750733 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: X-Is-Admin-Project: True May 26 12:47:14.750733 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: X-Project-Domain-Id: default May 26 12:47:14.750733 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: X-Project-Domain-Name: Default May 26 12:47:14.750733 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: X-Project-Id: 2fa2c4d6423444e487d259062656129b May 26 12:47:14.750733 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: X-Project-Name: tempest-TestMinimumBasicScenario-102576986 May 26 12:47:14.750733 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: X-Role: member,reader May 26 12:47:14.750733 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: X-Roles: member,reader May 26 12:47:14.752292 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/2fa2c4d6423444e487d259062656129b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.75:8080", "publicURL": "http://10.222.0.75:8080/v1/AUTH_2fa2c4d6423444e487d259062656129b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2/2fa2c4d6423444e487d259062656129b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/2fa2c4d6423444e487d259062656129b"}]}] May 26 12:47:14.752292 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: X-Tenant: tempest-TestMinimumBasicScenario-102576986 May 26 12:47:14.752292 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: X-Tenant-Id: 2fa2c4d6423444e487d259062656129b May 26 12:47:14.752292 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: X-Tenant-Name: tempest-TestMinimumBasicScenario-102576986 May 26 12:47:14.752292 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: X-User: tempest-TestMinimumBasicScenario-102576986-project May 26 12:47:14.752292 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: X-User-Domain-Id: default May 26 12:47:14.752292 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: X-User-Domain-Name: Default May 26 12:47:14.752292 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: X-User-Id: 0352a80bdc174b9a9df4eca60b81eba4 May 26 12:47:14.752292 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: X-User-Name: tempest-TestMinimumBasicScenario-102576986-project May 26 12:47:14.752292 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: method: > May 26 12:47:14.752292 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: exception: Instance 76661008-e6d3-4646-a9ba-d5d0e83a4b65 is not attached to volume abf921a4-40ef-4fd1-97e5-c25de2c53323 May 26 12:47:14.753227 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: action_args: {'server_id': '76661008-e6d3-4646-a9ba-d5d0e83a4b65', 'id': 'abf921a4-40ef-4fd1-97e5-c25de2c53323'} May 26 12:47:14.753227 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: {{(pid=129322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 12:47:14.753227 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 12:47:14.753227 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete May 26 12:47:14.753227 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( May 26 12:47:14.753227 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 26 12:47:14.753227 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 26 12:47:14.753227 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 281, in get_by_volume_and_instance May 26 12:47:14.753227 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) May 26 12:47:14.753227 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id abf921a4-40ef-4fd1-97e5-c25de2c53323. May 26 12:47:14.753227 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi May 26 12:47:14.753227 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 12:47:14.753227 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi May 26 12:47:14.753227 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 12:47:14.753227 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 12:47:14.753227 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 12:47:14.753227 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 12:47:14.753227 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 12:47:14.753227 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 12:47:14.755053 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 12:47:14.755053 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete May 26 12:47:14.755053 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) May 26 12:47:14.755053 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 76661008-e6d3-4646-a9ba-d5d0e83a4b65 is not attached to volume abf921a4-40ef-4fd1-97e5-c25de2c53323 May 26 12:47:14.755053 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi May 26 12:47:14.755053 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 12:47:14.755053 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi May 26 12:47:14.755053 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 12:47:14.755053 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 12:47:14.755053 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 12:47:14.755053 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 12:47:14.755053 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 12:47:14.755053 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 76661008-e6d3-4646-a9ba-d5d0e83a4b65 is not attached to volume abf921a4-40ef-4fd1-97e5-c25de2c53323 May 26 12:47:14.755053 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi May 26 12:47:14.755053 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi [None req-958c93ac-f0e2-4053-b1bf-3df931f4bb7b tempest-TestMinimumBasicScenario-102576986 tempest-TestMinimumBasicScenario-102576986-project] Returning 404 to user: Instance 76661008-e6d3-4646-a9ba-d5d0e83a4b65 is not attached to volume abf921a4-40ef-4fd1-97e5-c25de2c53323 {{(pid=129322) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 12:47:14.756501 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: INFO nova.api.openstack.requestlog [None req-958c93ac-f0e2-4053-b1bf-3df931f4bb7b tempest-TestMinimumBasicScenario-102576986 tempest-TestMinimumBasicScenario-102576986-project] 10.222.0.75 "DELETE /compute/v2.1/servers/76661008-e6d3-4646-a9ba-d5d0e83a4b65/os-volume_attachments/abf921a4-40ef-4fd1-97e5-c25de2c53323" status: 404 len: 154 microversion: 2.1 time: 0.124145 May 26 12:47:14.756501 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: [pid: 129322|app: 0|req: 466/909] 10.222.0.75 () {58 vars in 1415 bytes} [Thu May 26 12:47:14 2022] DELETE /compute/v2.1/servers/76661008-e6d3-4646-a9ba-d5d0e83a4b65/os-volume_attachments/abf921a4-40ef-4fd1-97e5-c25de2c53323 => generated 154 bytes in 125 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 26 12:47:14.817179 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi [None req-f98b8c33-7e58-4acd-8e1f-e566f0e2dce0 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Calling method '>' {{(pid=129321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:47:14.817801 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.compute.api [None req-f98b8c33-7e58-4acd-8e1f-e566f0e2dce0 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] [instance: 605b9171-aa87-432a-b179-c552640e73dd] Fetching instance by UUID {{(pid=129321) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:47:14.824074 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-f98b8c33-7e58-4acd-8e1f-e566f0e2dce0 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:47:14.824516 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-f98b8c33-7e58-4acd-8e1f-e566f0e2dce0 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:47:14.825282 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-f98b8c33-7e58-4acd-8e1f-e566f0e2dce0 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:47:14.826052 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-f98b8c33-7e58-4acd-8e1f-e566f0e2dce0 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:47:14.842626 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: INFO nova.api.openstack.wsgi [None req-f98b8c33-7e58-4acd-8e1f-e566f0e2dce0 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] HTTP exception thrown: Instance 605b9171-aa87-432a-b179-c552640e73dd could not be found. May 26 12:47:14.843760 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi [None req-f98b8c33-7e58-4acd-8e1f-e566f0e2dce0 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Request method failure captured: May 26 12:47:14.843760 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: request: GET /compute/v2.1/servers/605b9171-aa87-432a-b179-c552640e73dd HTTP/1.1 May 26 12:47:14.843760 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: Accept: application/json May 26 12:47:14.843760 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: Accept-Encoding: identity May 26 12:47:14.843760 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: Connection: close May 26 12:47:14.843760 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: Content-Length: 0 May 26 12:47:14.843760 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: Content-Type: application/json May 26 12:47:14.843760 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: Host: 10.222.0.75 May 26 12:47:14.843760 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: Openstack-System-Scope: None May 26 12:47:14.843760 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: User-Agent: python-urllib3/1.26.9 May 26 12:47:14.843760 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: X-Auth-Token: gAAAAABij3S0WbtMcFtLpl5UW4FUUirUww6kWxRFtP_FyC7fCIkKgIa10qp1d64SXO8XGZoWAnH5qdlCU3B3TdVumzT0bkV7P07uLiWhB_0UPHRg81du51UJgft-JAW7F3hpRjJiDiRCUUj2q5hZ29CV8Ux0gDDTwJGidVvj6aJ5fGBZ3S5YWD8 May 26 12:47:14.843760 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: X-Domain-Id: None May 26 12:47:14.843760 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: X-Domain-Name: None May 26 12:47:14.843760 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: X-Identity-Status: Confirmed May 26 12:47:14.843760 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: X-Is-Admin-Project: True May 26 12:47:14.843760 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: X-Project-Domain-Id: default May 26 12:47:14.843760 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: X-Project-Domain-Name: Default May 26 12:47:14.843760 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: X-Project-Id: 9e36ab03283d4ce6a2fed5e111e03d34 May 26 12:47:14.843760 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-547315860 May 26 12:47:14.843760 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: X-Role: member,reader May 26 12:47:14.843760 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: X-Roles: member,reader May 26 12:47:14.854764 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/9e36ab03283d4ce6a2fed5e111e03d34"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.75:8080", "publicURL": "http://10.222.0.75:8080/v1/AUTH_9e36ab03283d4ce6a2fed5e111e03d34"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2/9e36ab03283d4ce6a2fed5e111e03d34"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/9e36ab03283d4ce6a2fed5e111e03d34"}]}] May 26 12:47:14.854764 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: X-Tenant: tempest-ServerRescueNegativeTestJSON-547315860 May 26 12:47:14.854764 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: X-Tenant-Id: 9e36ab03283d4ce6a2fed5e111e03d34 May 26 12:47:14.854764 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-547315860 May 26 12:47:14.854764 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: X-User: tempest-ServerRescueNegativeTestJSON-547315860-project May 26 12:47:14.854764 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: X-User-Domain-Id: default May 26 12:47:14.854764 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: X-User-Domain-Name: Default May 26 12:47:14.854764 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: X-User-Id: 0431b1f25497443ba483b3c440669080 May 26 12:47:14.854764 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: X-User-Name: tempest-ServerRescueNegativeTestJSON-547315860-project May 26 12:47:14.854764 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: method: > May 26 12:47:14.854764 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: exception: Instance 605b9171-aa87-432a-b179-c552640e73dd could not be found. May 26 12:47:14.854764 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: action_args: {'id': '605b9171-aa87-432a-b179-c552640e73dd'} May 26 12:47:14.856216 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: {{(pid=129321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 12:47:14.856216 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 12:47:14.856216 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 26 12:47:14.856216 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 26 12:47:14.856216 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 26 12:47:14.856216 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 26 12:47:14.856216 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 26 12:47:14.856216 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 26 12:47:14.856216 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 26 12:47:14.856216 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 26 12:47:14.856216 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 605b9171-aa87-432a-b179-c552640e73dd could not be found. May 26 12:47:14.856216 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi May 26 12:47:14.856216 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 12:47:14.856216 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi May 26 12:47:14.856216 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 12:47:14.856216 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 12:47:14.856216 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 12:47:14.856216 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 12:47:14.856216 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 12:47:14.856216 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 12:47:14.858903 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 12:47:14.858903 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 26 12:47:14.858903 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 26 12:47:14.858903 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 26 12:47:14.858903 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 26 12:47:14.858903 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 26 12:47:14.858903 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 12:47:14.858903 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 605b9171-aa87-432a-b179-c552640e73dd could not be found. May 26 12:47:14.858903 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi May 26 12:47:14.858903 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 12:47:14.858903 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi May 26 12:47:14.858903 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 12:47:14.858903 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 12:47:14.858903 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 12:47:14.858903 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 12:47:14.858903 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 12:47:14.858903 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 605b9171-aa87-432a-b179-c552640e73dd could not be found. May 26 12:47:14.858903 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi May 26 12:47:14.861136 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi [None req-f98b8c33-7e58-4acd-8e1f-e566f0e2dce0 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Returning 404 to user: Instance 605b9171-aa87-432a-b179-c552640e73dd could not be found. {{(pid=129321) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 12:47:14.861136 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: INFO nova.api.openstack.requestlog [None req-f98b8c33-7e58-4acd-8e1f-e566f0e2dce0 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] 10.222.0.75 "GET /compute/v2.1/servers/605b9171-aa87-432a-b179-c552640e73dd" status: 404 len: 111 microversion: 2.1 time: 0.032376 May 26 12:47:14.861136 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: [pid: 129321|app: 0|req: 444/910] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 26 12:47:14 2022] GET /compute/v2.1/servers/605b9171-aa87-432a-b179-c552640e73dd => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 26 12:47:14.861386 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi [None req-4ca6754e-dd77-4115-ba6d-c9fbf452ba29 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Calling method '>' {{(pid=129322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:47:14.861386 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.compute.api [None req-4ca6754e-dd77-4115-ba6d-c9fbf452ba29 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] [instance: f9200aab-6f49-4e6f-812b-93b2f3e1edd9] Fetching instance by UUID {{(pid=129322) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:47:14.863868 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-4ca6754e-dd77-4115-ba6d-c9fbf452ba29 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:47:14.864784 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-4ca6754e-dd77-4115-ba6d-c9fbf452ba29 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:47:14.865504 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-4ca6754e-dd77-4115-ba6d-c9fbf452ba29 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:47:14.865967 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-4ca6754e-dd77-4115-ba6d-c9fbf452ba29 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:47:14.894003 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.compute.api [None req-4ca6754e-dd77-4115-ba6d-c9fbf452ba29 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] [instance: f9200aab-6f49-4e6f-812b-93b2f3e1edd9] Going to try to terminate instance {{(pid=129322) delete /opt/stack/nova/nova/compute/api.py:2664}} May 26 12:47:14.919439 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG dbcounter [-] [129322] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=129322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:47:15.007371 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: INFO nova.api.openstack.requestlog [None req-4ca6754e-dd77-4115-ba6d-c9fbf452ba29 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] 10.222.0.75 "DELETE /compute/v2.1/servers/f9200aab-6f49-4e6f-812b-93b2f3e1edd9" status: 204 len: 0 microversion: 2.1 time: 0.155450 May 26 12:47:15.010417 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: [pid: 129322|app: 0|req: 467/911] 10.222.0.75 () {58 vars in 1238 bytes} [Thu May 26 12:47:14 2022] DELETE /compute/v2.1/servers/f9200aab-6f49-4e6f-812b-93b2f3e1edd9 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 26 12:47:15.021447 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi [None req-36b15481-15ee-49b6-b3e4-4856bd42e4b6 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Calling method '>' {{(pid=129321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:47:15.022938 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.compute.api [None req-36b15481-15ee-49b6-b3e4-4856bd42e4b6 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] [instance: f9200aab-6f49-4e6f-812b-93b2f3e1edd9] Fetching instance by UUID {{(pid=129321) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:47:15.035215 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-36b15481-15ee-49b6-b3e4-4856bd42e4b6 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:47:15.035980 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-36b15481-15ee-49b6-b3e4-4856bd42e4b6 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:47:15.037439 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-36b15481-15ee-49b6-b3e4-4856bd42e4b6 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:47:15.037894 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-36b15481-15ee-49b6-b3e4-4856bd42e4b6 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:47:15.191229 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.policy [None req-36b15481-15ee-49b6-b3e4-4856bd42e4b6 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0431b1f25497443ba483b3c440669080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e36ab03283d4ce6a2fed5e111e03d34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129321) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:47:15.199752 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: INFO nova.api.openstack.requestlog [None req-36b15481-15ee-49b6-b3e4-4856bd42e4b6 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] 10.222.0.75 "GET /compute/v2.1/servers/f9200aab-6f49-4e6f-812b-93b2f3e1edd9" status: 200 len: 1521 microversion: 2.1 time: 0.185319 May 26 12:47:15.200343 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: [pid: 129321|app: 0|req: 445/912] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 26 12:47:15 2022] GET /compute/v2.1/servers/f9200aab-6f49-4e6f-812b-93b2f3e1edd9 => generated 1521 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:47:15.920390 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi [None req-13ef848e-4294-4338-a6a2-f669af472980 tempest-TestMinimumBasicScenario-102576986 tempest-TestMinimumBasicScenario-102576986-project] Calling method '>' {{(pid=129322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:47:15.920984 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.compute.api [None req-13ef848e-4294-4338-a6a2-f669af472980 tempest-TestMinimumBasicScenario-102576986 tempest-TestMinimumBasicScenario-102576986-project] [instance: 76661008-e6d3-4646-a9ba-d5d0e83a4b65] Fetching instance by UUID {{(pid=129322) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:47:15.928388 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-13ef848e-4294-4338-a6a2-f669af472980 tempest-TestMinimumBasicScenario-102576986 tempest-TestMinimumBasicScenario-102576986-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:47:15.928832 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-13ef848e-4294-4338-a6a2-f669af472980 tempest-TestMinimumBasicScenario-102576986 tempest-TestMinimumBasicScenario-102576986-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:47:15.929601 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-13ef848e-4294-4338-a6a2-f669af472980 tempest-TestMinimumBasicScenario-102576986 tempest-TestMinimumBasicScenario-102576986-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:47:15.930025 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-13ef848e-4294-4338-a6a2-f669af472980 tempest-TestMinimumBasicScenario-102576986 tempest-TestMinimumBasicScenario-102576986-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:47:15.955918 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.compute.api [None req-13ef848e-4294-4338-a6a2-f669af472980 tempest-TestMinimumBasicScenario-102576986 tempest-TestMinimumBasicScenario-102576986-project] [instance: 76661008-e6d3-4646-a9ba-d5d0e83a4b65] Going to try to terminate instance {{(pid=129322) delete /opt/stack/nova/nova/compute/api.py:2664}} May 26 12:47:16.049009 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: INFO nova.api.openstack.requestlog [None req-13ef848e-4294-4338-a6a2-f669af472980 tempest-TestMinimumBasicScenario-102576986 tempest-TestMinimumBasicScenario-102576986-project] 10.222.0.75 "DELETE /compute/v2.1/servers/76661008-e6d3-4646-a9ba-d5d0e83a4b65" status: 204 len: 0 microversion: 2.1 time: 0.132526 May 26 12:47:16.049638 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: [pid: 129322|app: 0|req: 468/913] 10.222.0.75 () {58 vars in 1238 bytes} [Thu May 26 12:47:15 2022] DELETE /compute/v2.1/servers/76661008-e6d3-4646-a9ba-d5d0e83a4b65 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 26 12:47:16.058066 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi [None req-4c0bd3fb-2c77-4df7-b7d5-1a00a0ec3a6b tempest-TestMinimumBasicScenario-102576986 tempest-TestMinimumBasicScenario-102576986-project] Calling method '>' {{(pid=129321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:47:16.058647 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.compute.api [None req-4c0bd3fb-2c77-4df7-b7d5-1a00a0ec3a6b tempest-TestMinimumBasicScenario-102576986 tempest-TestMinimumBasicScenario-102576986-project] [instance: 76661008-e6d3-4646-a9ba-d5d0e83a4b65] Fetching instance by UUID {{(pid=129321) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:47:16.065135 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-4c0bd3fb-2c77-4df7-b7d5-1a00a0ec3a6b tempest-TestMinimumBasicScenario-102576986 tempest-TestMinimumBasicScenario-102576986-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:47:16.065608 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-4c0bd3fb-2c77-4df7-b7d5-1a00a0ec3a6b tempest-TestMinimumBasicScenario-102576986 tempest-TestMinimumBasicScenario-102576986-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:47:16.066471 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-4c0bd3fb-2c77-4df7-b7d5-1a00a0ec3a6b tempest-TestMinimumBasicScenario-102576986 tempest-TestMinimumBasicScenario-102576986-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:47:16.067130 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-4c0bd3fb-2c77-4df7-b7d5-1a00a0ec3a6b tempest-TestMinimumBasicScenario-102576986 tempest-TestMinimumBasicScenario-102576986-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:47:16.086866 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG dbcounter [-] [129321] Writing DB stats nova_cell1:SELECT=100 {{(pid=129321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:47:16.218698 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi [None req-e1a37887-d673-48ee-a5d7-b1f7a90167f1 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Calling method '>' {{(pid=129322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:47:16.219406 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.compute.api [None req-e1a37887-d673-48ee-a5d7-b1f7a90167f1 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] [instance: f9200aab-6f49-4e6f-812b-93b2f3e1edd9] Fetching instance by UUID {{(pid=129322) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:47:16.231230 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-e1a37887-d673-48ee-a5d7-b1f7a90167f1 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:47:16.231672 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-e1a37887-d673-48ee-a5d7-b1f7a90167f1 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:47:16.232470 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-e1a37887-d673-48ee-a5d7-b1f7a90167f1 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:47:16.232908 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-e1a37887-d673-48ee-a5d7-b1f7a90167f1 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:47:16.266624 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.policy [None req-4c0bd3fb-2c77-4df7-b7d5-1a00a0ec3a6b tempest-TestMinimumBasicScenario-102576986 tempest-TestMinimumBasicScenario-102576986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0352a80bdc174b9a9df4eca60b81eba4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fa2c4d6423444e487d259062656129b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129321) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:47:16.275968 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: INFO nova.api.openstack.requestlog [None req-4c0bd3fb-2c77-4df7-b7d5-1a00a0ec3a6b tempest-TestMinimumBasicScenario-102576986 tempest-TestMinimumBasicScenario-102576986-project] 10.222.0.75 "GET /compute/v2.1/servers/76661008-e6d3-4646-a9ba-d5d0e83a4b65" status: 200 len: 1553 microversion: 2.1 time: 0.221220 May 26 12:47:16.276615 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: [pid: 129321|app: 0|req: 446/914] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 26 12:47:16 2022] GET /compute/v2.1/servers/76661008-e6d3-4646-a9ba-d5d0e83a4b65 => generated 1553 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:47:16.408247 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.policy [None req-e1a37887-d673-48ee-a5d7-b1f7a90167f1 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0431b1f25497443ba483b3c440669080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e36ab03283d4ce6a2fed5e111e03d34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129322) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:47:16.417343 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: INFO nova.api.openstack.requestlog [None req-e1a37887-d673-48ee-a5d7-b1f7a90167f1 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] 10.222.0.75 "GET /compute/v2.1/servers/f9200aab-6f49-4e6f-812b-93b2f3e1edd9" status: 200 len: 1521 microversion: 2.1 time: 0.203173 May 26 12:47:16.417936 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: [pid: 129322|app: 0|req: 469/915] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 26 12:47:16 2022] GET /compute/v2.1/servers/f9200aab-6f49-4e6f-812b-93b2f3e1edd9 => generated 1521 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:47:16.518051 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi [req-a66556c7-d4da-44d6-a210-f7dabaf6bc5e req-525064d6-18c6-4d7d-a992-0615b78c9904 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f9200aab-6f49-4e6f-812b-93b2f3e1edd9", "name": "network-vif-deleted", "tag": "246aaf0a-ebde-48cf-83fe-af3c152e1f14"}]} {{(pid=129321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 12:47:16.527402 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [req-a66556c7-d4da-44d6-a210-f7dabaf6bc5e req-525064d6-18c6-4d7d-a992-0615b78c9904 service nova] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:47:16.527863 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [req-a66556c7-d4da-44d6-a210-f7dabaf6bc5e req-525064d6-18c6-4d7d-a992-0615b78c9904 service nova] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:47:16.540107 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: INFO nova.api.openstack.compute.server_external_events [req-a66556c7-d4da-44d6-a210-f7dabaf6bc5e req-525064d6-18c6-4d7d-a992-0615b78c9904 service nova] Creating event network-vif-deleted:246aaf0a-ebde-48cf-83fe-af3c152e1f14 for instance f9200aab-6f49-4e6f-812b-93b2f3e1edd9 on hv-cinder-81966 May 26 12:47:16.545309 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: INFO nova.api.openstack.requestlog [req-a66556c7-d4da-44d6-a210-f7dabaf6bc5e req-525064d6-18c6-4d7d-a992-0615b78c9904 service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030978 May 26 12:47:16.545934 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: [pid: 129321|app: 0|req: 447/916] 10.222.0.75 () {64 vars in 1317 bytes} [Thu May 26 12:47:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 12:47:17.294401 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi [None req-ebb61119-6fed-48ae-afb7-d8c2c0fb94e5 tempest-TestMinimumBasicScenario-102576986 tempest-TestMinimumBasicScenario-102576986-project] Calling method '>' {{(pid=129322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:47:17.294992 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.compute.api [None req-ebb61119-6fed-48ae-afb7-d8c2c0fb94e5 tempest-TestMinimumBasicScenario-102576986 tempest-TestMinimumBasicScenario-102576986-project] [instance: 76661008-e6d3-4646-a9ba-d5d0e83a4b65] Fetching instance by UUID {{(pid=129322) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:47:17.302611 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-ebb61119-6fed-48ae-afb7-d8c2c0fb94e5 tempest-TestMinimumBasicScenario-102576986 tempest-TestMinimumBasicScenario-102576986-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:47:17.303062 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-ebb61119-6fed-48ae-afb7-d8c2c0fb94e5 tempest-TestMinimumBasicScenario-102576986 tempest-TestMinimumBasicScenario-102576986-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:47:17.303876 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-ebb61119-6fed-48ae-afb7-d8c2c0fb94e5 tempest-TestMinimumBasicScenario-102576986 tempest-TestMinimumBasicScenario-102576986-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:47:17.304300 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-ebb61119-6fed-48ae-afb7-d8c2c0fb94e5 tempest-TestMinimumBasicScenario-102576986 tempest-TestMinimumBasicScenario-102576986-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:47:17.442586 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi [None req-93f8f595-73cc-4ee8-a941-841f58951702 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Calling method '>' {{(pid=129321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:47:17.443435 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.compute.api [None req-93f8f595-73cc-4ee8-a941-841f58951702 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] [instance: f9200aab-6f49-4e6f-812b-93b2f3e1edd9] Fetching instance by UUID {{(pid=129321) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:47:17.451407 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.policy [None req-ebb61119-6fed-48ae-afb7-d8c2c0fb94e5 tempest-TestMinimumBasicScenario-102576986 tempest-TestMinimumBasicScenario-102576986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0352a80bdc174b9a9df4eca60b81eba4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fa2c4d6423444e487d259062656129b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129322) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:47:17.452203 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-93f8f595-73cc-4ee8-a941-841f58951702 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:47:17.452904 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-93f8f595-73cc-4ee8-a941-841f58951702 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:47:17.454145 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-93f8f595-73cc-4ee8-a941-841f58951702 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:47:17.454848 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-93f8f595-73cc-4ee8-a941-841f58951702 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:47:17.463397 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: INFO nova.api.openstack.requestlog [None req-ebb61119-6fed-48ae-afb7-d8c2c0fb94e5 tempest-TestMinimumBasicScenario-102576986 tempest-TestMinimumBasicScenario-102576986-project] 10.222.0.75 "GET /compute/v2.1/servers/76661008-e6d3-4646-a9ba-d5d0e83a4b65" status: 200 len: 1553 microversion: 2.1 time: 0.172679 May 26 12:47:17.464379 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: [pid: 129322|app: 0|req: 470/917] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 26 12:47:17 2022] GET /compute/v2.1/servers/76661008-e6d3-4646-a9ba-d5d0e83a4b65 => generated 1553 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:47:17.526227 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.policy [None req-93f8f595-73cc-4ee8-a941-841f58951702 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0431b1f25497443ba483b3c440669080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e36ab03283d4ce6a2fed5e111e03d34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129321) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:47:17.534192 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: INFO nova.api.openstack.requestlog [None req-93f8f595-73cc-4ee8-a941-841f58951702 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] 10.222.0.75 "GET /compute/v2.1/servers/f9200aab-6f49-4e6f-812b-93b2f3e1edd9" status: 200 len: 1479 microversion: 2.1 time: 0.096724 May 26 12:47:17.534765 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: [pid: 129321|app: 0|req: 448/918] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 26 12:47:17 2022] GET /compute/v2.1/servers/f9200aab-6f49-4e6f-812b-93b2f3e1edd9 => generated 1479 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 12:47:18.482544 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi [None req-8f10312e-420f-4652-bbc7-d3747df4a157 tempest-TestMinimumBasicScenario-102576986 tempest-TestMinimumBasicScenario-102576986-project] Calling method '>' {{(pid=129322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:47:18.483236 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.compute.api [None req-8f10312e-420f-4652-bbc7-d3747df4a157 tempest-TestMinimumBasicScenario-102576986 tempest-TestMinimumBasicScenario-102576986-project] [instance: 76661008-e6d3-4646-a9ba-d5d0e83a4b65] Fetching instance by UUID {{(pid=129322) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:47:18.498480 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-8f10312e-420f-4652-bbc7-d3747df4a157 tempest-TestMinimumBasicScenario-102576986 tempest-TestMinimumBasicScenario-102576986-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:47:18.498910 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-8f10312e-420f-4652-bbc7-d3747df4a157 tempest-TestMinimumBasicScenario-102576986 tempest-TestMinimumBasicScenario-102576986-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:47:18.500154 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-8f10312e-420f-4652-bbc7-d3747df4a157 tempest-TestMinimumBasicScenario-102576986 tempest-TestMinimumBasicScenario-102576986-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:47:18.500808 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-8f10312e-420f-4652-bbc7-d3747df4a157 tempest-TestMinimumBasicScenario-102576986 tempest-TestMinimumBasicScenario-102576986-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:47:18.551650 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi [None req-efca115e-b30c-4849-9878-9ede5b668038 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Calling method '>' {{(pid=129321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:47:18.552412 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.compute.api [None req-efca115e-b30c-4849-9878-9ede5b668038 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] [instance: f9200aab-6f49-4e6f-812b-93b2f3e1edd9] Fetching instance by UUID {{(pid=129321) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:47:18.559374 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-efca115e-b30c-4849-9878-9ede5b668038 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:47:18.560321 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-efca115e-b30c-4849-9878-9ede5b668038 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:47:18.561273 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-efca115e-b30c-4849-9878-9ede5b668038 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:47:18.561870 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-efca115e-b30c-4849-9878-9ede5b668038 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:47:18.579812 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: INFO nova.api.openstack.wsgi [None req-efca115e-b30c-4849-9878-9ede5b668038 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] HTTP exception thrown: Instance f9200aab-6f49-4e6f-812b-93b2f3e1edd9 could not be found. May 26 12:47:18.581965 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi [None req-efca115e-b30c-4849-9878-9ede5b668038 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Request method failure captured: May 26 12:47:18.581965 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: request: GET /compute/v2.1/servers/f9200aab-6f49-4e6f-812b-93b2f3e1edd9 HTTP/1.1 May 26 12:47:18.581965 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: Accept: application/json May 26 12:47:18.581965 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: Accept-Encoding: identity May 26 12:47:18.581965 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: Connection: close May 26 12:47:18.581965 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: Content-Length: 0 May 26 12:47:18.581965 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: Content-Type: application/json May 26 12:47:18.581965 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: Host: 10.222.0.75 May 26 12:47:18.581965 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: Openstack-System-Scope: None May 26 12:47:18.581965 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: User-Agent: python-urllib3/1.26.9 May 26 12:47:18.581965 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: X-Auth-Token: gAAAAABij3S0WbtMcFtLpl5UW4FUUirUww6kWxRFtP_FyC7fCIkKgIa10qp1d64SXO8XGZoWAnH5qdlCU3B3TdVumzT0bkV7P07uLiWhB_0UPHRg81du51UJgft-JAW7F3hpRjJiDiRCUUj2q5hZ29CV8Ux0gDDTwJGidVvj6aJ5fGBZ3S5YWD8 May 26 12:47:18.581965 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: X-Domain-Id: None May 26 12:47:18.581965 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: X-Domain-Name: None May 26 12:47:18.581965 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: X-Identity-Status: Confirmed May 26 12:47:18.581965 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: X-Is-Admin-Project: True May 26 12:47:18.581965 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: X-Project-Domain-Id: default May 26 12:47:18.581965 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: X-Project-Domain-Name: Default May 26 12:47:18.581965 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: X-Project-Id: 9e36ab03283d4ce6a2fed5e111e03d34 May 26 12:47:18.581965 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-547315860 May 26 12:47:18.581965 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: X-Role: member,reader May 26 12:47:18.581965 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: X-Roles: member,reader May 26 12:47:18.584192 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/9e36ab03283d4ce6a2fed5e111e03d34"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.75:8080", "publicURL": "http://10.222.0.75:8080/v1/AUTH_9e36ab03283d4ce6a2fed5e111e03d34"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2/9e36ab03283d4ce6a2fed5e111e03d34"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/9e36ab03283d4ce6a2fed5e111e03d34"}]}] May 26 12:47:18.584192 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: X-Tenant: tempest-ServerRescueNegativeTestJSON-547315860 May 26 12:47:18.584192 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: X-Tenant-Id: 9e36ab03283d4ce6a2fed5e111e03d34 May 26 12:47:18.584192 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-547315860 May 26 12:47:18.584192 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: X-User: tempest-ServerRescueNegativeTestJSON-547315860-project May 26 12:47:18.584192 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: X-User-Domain-Id: default May 26 12:47:18.584192 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: X-User-Domain-Name: Default May 26 12:47:18.584192 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: X-User-Id: 0431b1f25497443ba483b3c440669080 May 26 12:47:18.584192 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: X-User-Name: tempest-ServerRescueNegativeTestJSON-547315860-project May 26 12:47:18.584192 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: method: > May 26 12:47:18.584192 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: exception: Instance f9200aab-6f49-4e6f-812b-93b2f3e1edd9 could not be found. May 26 12:47:18.584192 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: action_args: {'id': 'f9200aab-6f49-4e6f-812b-93b2f3e1edd9'} May 26 12:47:18.585057 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: {{(pid=129321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 12:47:18.585057 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 12:47:18.585057 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 26 12:47:18.585057 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 26 12:47:18.585057 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 26 12:47:18.585057 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 26 12:47:18.585057 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 26 12:47:18.585057 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 26 12:47:18.585057 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 26 12:47:18.585057 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 26 12:47:18.585057 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f9200aab-6f49-4e6f-812b-93b2f3e1edd9 could not be found. May 26 12:47:18.585057 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi May 26 12:47:18.585057 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 12:47:18.585057 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi May 26 12:47:18.585057 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 12:47:18.585057 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 12:47:18.585057 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 12:47:18.585057 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 12:47:18.585057 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 12:47:18.585057 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 12:47:18.586622 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 12:47:18.586622 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 26 12:47:18.586622 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 26 12:47:18.586622 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 26 12:47:18.586622 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 26 12:47:18.586622 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 26 12:47:18.586622 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 12:47:18.586622 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f9200aab-6f49-4e6f-812b-93b2f3e1edd9 could not be found. May 26 12:47:18.586622 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi May 26 12:47:18.586622 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 12:47:18.586622 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi May 26 12:47:18.586622 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 12:47:18.586622 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 12:47:18.586622 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 12:47:18.586622 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 12:47:18.586622 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 12:47:18.586622 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f9200aab-6f49-4e6f-812b-93b2f3e1edd9 could not be found. May 26 12:47:18.586622 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi May 26 12:47:18.588356 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi [None req-efca115e-b30c-4849-9878-9ede5b668038 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] Returning 404 to user: Instance f9200aab-6f49-4e6f-812b-93b2f3e1edd9 could not be found. {{(pid=129321) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 12:47:18.588356 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: INFO nova.api.openstack.requestlog [None req-efca115e-b30c-4849-9878-9ede5b668038 tempest-ServerRescueNegativeTestJSON-547315860 tempest-ServerRescueNegativeTestJSON-547315860-project] 10.222.0.75 "GET /compute/v2.1/servers/f9200aab-6f49-4e6f-812b-93b2f3e1edd9" status: 404 len: 111 microversion: 2.1 time: 0.036015 May 26 12:47:18.588356 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: [pid: 129321|app: 0|req: 449/919] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 26 12:47:18 2022] GET /compute/v2.1/servers/f9200aab-6f49-4e6f-812b-93b2f3e1edd9 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 26 12:47:18.678850 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.policy [None req-8f10312e-420f-4652-bbc7-d3747df4a157 tempest-TestMinimumBasicScenario-102576986 tempest-TestMinimumBasicScenario-102576986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0352a80bdc174b9a9df4eca60b81eba4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fa2c4d6423444e487d259062656129b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129322) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:47:18.689045 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: INFO nova.api.openstack.requestlog [None req-8f10312e-420f-4652-bbc7-d3747df4a157 tempest-TestMinimumBasicScenario-102576986 tempest-TestMinimumBasicScenario-102576986-project] 10.222.0.75 "GET /compute/v2.1/servers/76661008-e6d3-4646-a9ba-d5d0e83a4b65" status: 200 len: 1553 microversion: 2.1 time: 0.210857 May 26 12:47:18.689902 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: [pid: 129322|app: 0|req: 471/920] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 26 12:47:18 2022] GET /compute/v2.1/servers/76661008-e6d3-4646-a9ba-d5d0e83a4b65 => generated 1553 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:47:19.613578 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi [req-6aaf5700-5d26-4276-9e56-c1b3eadf80e3 req-fe04aa73-7cdd-4201-b6fc-fa9265e2b407 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "76661008-e6d3-4646-a9ba-d5d0e83a4b65", "name": "network-vif-deleted", "tag": "4aebdf54-88c1-42d5-a224-778a4410cff0"}]} {{(pid=129321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 12:47:19.623299 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [req-6aaf5700-5d26-4276-9e56-c1b3eadf80e3 req-fe04aa73-7cdd-4201-b6fc-fa9265e2b407 service nova] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:47:19.623769 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [req-6aaf5700-5d26-4276-9e56-c1b3eadf80e3 req-fe04aa73-7cdd-4201-b6fc-fa9265e2b407 service nova] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:47:19.637468 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: INFO nova.api.openstack.compute.server_external_events [req-6aaf5700-5d26-4276-9e56-c1b3eadf80e3 req-fe04aa73-7cdd-4201-b6fc-fa9265e2b407 service nova] Creating event network-vif-deleted:4aebdf54-88c1-42d5-a224-778a4410cff0 for instance 76661008-e6d3-4646-a9ba-d5d0e83a4b65 on hv-cinder-81966 May 26 12:47:19.653599 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: INFO nova.api.openstack.requestlog [req-6aaf5700-5d26-4276-9e56-c1b3eadf80e3 req-fe04aa73-7cdd-4201-b6fc-fa9265e2b407 service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044252 May 26 12:47:19.654978 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: [pid: 129321|app: 0|req: 450/921] 10.222.0.75 () {64 vars in 1317 bytes} [Thu May 26 12:47:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 12:47:19.708625 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi [None req-9cc672ef-49ad-4eb4-800c-c208b7629c2d tempest-TestMinimumBasicScenario-102576986 tempest-TestMinimumBasicScenario-102576986-project] Calling method '>' {{(pid=129322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:47:19.709571 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.compute.api [None req-9cc672ef-49ad-4eb4-800c-c208b7629c2d tempest-TestMinimumBasicScenario-102576986 tempest-TestMinimumBasicScenario-102576986-project] [instance: 76661008-e6d3-4646-a9ba-d5d0e83a4b65] Fetching instance by UUID {{(pid=129322) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:47:19.716508 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-9cc672ef-49ad-4eb4-800c-c208b7629c2d tempest-TestMinimumBasicScenario-102576986 tempest-TestMinimumBasicScenario-102576986-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:47:19.716955 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-9cc672ef-49ad-4eb4-800c-c208b7629c2d tempest-TestMinimumBasicScenario-102576986 tempest-TestMinimumBasicScenario-102576986-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:47:19.717781 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-9cc672ef-49ad-4eb4-800c-c208b7629c2d tempest-TestMinimumBasicScenario-102576986 tempest-TestMinimumBasicScenario-102576986-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:47:19.718403 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-9cc672ef-49ad-4eb4-800c-c208b7629c2d tempest-TestMinimumBasicScenario-102576986 tempest-TestMinimumBasicScenario-102576986-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:47:19.787120 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.policy [None req-9cc672ef-49ad-4eb4-800c-c208b7629c2d tempest-TestMinimumBasicScenario-102576986 tempest-TestMinimumBasicScenario-102576986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0352a80bdc174b9a9df4eca60b81eba4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fa2c4d6423444e487d259062656129b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129322) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:47:19.795513 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: INFO nova.api.openstack.requestlog [None req-9cc672ef-49ad-4eb4-800c-c208b7629c2d tempest-TestMinimumBasicScenario-102576986 tempest-TestMinimumBasicScenario-102576986-project] 10.222.0.75 "GET /compute/v2.1/servers/76661008-e6d3-4646-a9ba-d5d0e83a4b65" status: 200 len: 1342 microversion: 2.1 time: 0.090764 May 26 12:47:19.796184 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: [pid: 129322|app: 0|req: 472/922] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 26 12:47:19 2022] GET /compute/v2.1/servers/76661008-e6d3-4646-a9ba-d5d0e83a4b65 => generated 1342 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:47:20.814669 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi [None req-868207cd-4391-4f4a-8c6d-515ead35af18 tempest-TestMinimumBasicScenario-102576986 tempest-TestMinimumBasicScenario-102576986-project] Calling method '>' {{(pid=129321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:47:20.815362 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.compute.api [None req-868207cd-4391-4f4a-8c6d-515ead35af18 tempest-TestMinimumBasicScenario-102576986 tempest-TestMinimumBasicScenario-102576986-project] [instance: 76661008-e6d3-4646-a9ba-d5d0e83a4b65] Fetching instance by UUID {{(pid=129321) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:47:20.822518 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-868207cd-4391-4f4a-8c6d-515ead35af18 tempest-TestMinimumBasicScenario-102576986 tempest-TestMinimumBasicScenario-102576986-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:47:20.822978 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-868207cd-4391-4f4a-8c6d-515ead35af18 tempest-TestMinimumBasicScenario-102576986 tempest-TestMinimumBasicScenario-102576986-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:47:20.823773 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-868207cd-4391-4f4a-8c6d-515ead35af18 tempest-TestMinimumBasicScenario-102576986 tempest-TestMinimumBasicScenario-102576986-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:47:20.824221 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-868207cd-4391-4f4a-8c6d-515ead35af18 tempest-TestMinimumBasicScenario-102576986 tempest-TestMinimumBasicScenario-102576986-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:47:20.840766 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: INFO nova.api.openstack.wsgi [None req-868207cd-4391-4f4a-8c6d-515ead35af18 tempest-TestMinimumBasicScenario-102576986 tempest-TestMinimumBasicScenario-102576986-project] HTTP exception thrown: Instance 76661008-e6d3-4646-a9ba-d5d0e83a4b65 could not be found. May 26 12:47:20.843056 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi [None req-868207cd-4391-4f4a-8c6d-515ead35af18 tempest-TestMinimumBasicScenario-102576986 tempest-TestMinimumBasicScenario-102576986-project] Request method failure captured: May 26 12:47:20.843056 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: request: GET /compute/v2.1/servers/76661008-e6d3-4646-a9ba-d5d0e83a4b65 HTTP/1.1 May 26 12:47:20.843056 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: Accept: application/json May 26 12:47:20.843056 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: Accept-Encoding: identity May 26 12:47:20.843056 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: Connection: close May 26 12:47:20.843056 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: Content-Length: 0 May 26 12:47:20.843056 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: Content-Type: application/json May 26 12:47:20.843056 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: Host: 10.222.0.75 May 26 12:47:20.843056 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: Openstack-System-Scope: None May 26 12:47:20.843056 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: User-Agent: python-urllib3/1.26.9 May 26 12:47:20.843056 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: X-Auth-Token: gAAAAABij3WBHouzcOIM3ueZjIeZZ9kZi7UXbNh_q_jHqlSEbtFe7RKyDYU6B57ljz2gIzJBSmEJOF5ufGfyuWg7EFSs4TUvdbSabIsvVGadhqAzFTn1dEn7w8jA2ntILCJXMzI5HctVENQGhLCzTTCTTbp__zwT7Rfxq55WJJd-oGAHjRTk_PU May 26 12:47:20.843056 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: X-Domain-Id: None May 26 12:47:20.843056 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: X-Domain-Name: None May 26 12:47:20.843056 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: X-Identity-Status: Confirmed May 26 12:47:20.843056 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: X-Is-Admin-Project: True May 26 12:47:20.843056 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: X-Project-Domain-Id: default May 26 12:47:20.843056 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: X-Project-Domain-Name: Default May 26 12:47:20.843056 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: X-Project-Id: 2fa2c4d6423444e487d259062656129b May 26 12:47:20.843056 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: X-Project-Name: tempest-TestMinimumBasicScenario-102576986 May 26 12:47:20.843056 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: X-Role: member,reader May 26 12:47:20.843056 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: X-Roles: member,reader May 26 12:47:20.844382 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/2fa2c4d6423444e487d259062656129b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.75:8080", "publicURL": "http://10.222.0.75:8080/v1/AUTH_2fa2c4d6423444e487d259062656129b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2/2fa2c4d6423444e487d259062656129b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/2fa2c4d6423444e487d259062656129b"}]}] May 26 12:47:20.844382 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: X-Tenant: tempest-TestMinimumBasicScenario-102576986 May 26 12:47:20.844382 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: X-Tenant-Id: 2fa2c4d6423444e487d259062656129b May 26 12:47:20.844382 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: X-Tenant-Name: tempest-TestMinimumBasicScenario-102576986 May 26 12:47:20.844382 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: X-User: tempest-TestMinimumBasicScenario-102576986-project May 26 12:47:20.844382 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: X-User-Domain-Id: default May 26 12:47:20.844382 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: X-User-Domain-Name: Default May 26 12:47:20.844382 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: X-User-Id: 0352a80bdc174b9a9df4eca60b81eba4 May 26 12:47:20.844382 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: X-User-Name: tempest-TestMinimumBasicScenario-102576986-project May 26 12:47:20.844382 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: method: > May 26 12:47:20.844382 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: exception: Instance 76661008-e6d3-4646-a9ba-d5d0e83a4b65 could not be found. May 26 12:47:20.844382 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: action_args: {'id': '76661008-e6d3-4646-a9ba-d5d0e83a4b65'} May 26 12:47:20.845104 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: {{(pid=129321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 12:47:20.845104 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 12:47:20.845104 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 26 12:47:20.845104 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 26 12:47:20.845104 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 26 12:47:20.845104 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 26 12:47:20.845104 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 26 12:47:20.845104 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 26 12:47:20.845104 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 26 12:47:20.845104 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 26 12:47:20.845104 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 76661008-e6d3-4646-a9ba-d5d0e83a4b65 could not be found. May 26 12:47:20.845104 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi May 26 12:47:20.845104 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 12:47:20.845104 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi May 26 12:47:20.845104 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 12:47:20.845104 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 12:47:20.845104 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 12:47:20.845104 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 12:47:20.845104 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 12:47:20.845104 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 12:47:20.847368 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 12:47:20.847368 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 26 12:47:20.847368 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 26 12:47:20.847368 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 26 12:47:20.847368 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 26 12:47:20.847368 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 26 12:47:20.847368 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 12:47:20.847368 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 76661008-e6d3-4646-a9ba-d5d0e83a4b65 could not be found. May 26 12:47:20.847368 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi May 26 12:47:20.847368 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 12:47:20.847368 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi May 26 12:47:20.847368 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 12:47:20.847368 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 12:47:20.847368 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 12:47:20.847368 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 12:47:20.847368 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 12:47:20.847368 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 76661008-e6d3-4646-a9ba-d5d0e83a4b65 could not be found. May 26 12:47:20.847368 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi May 26 12:47:20.848471 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi [None req-868207cd-4391-4f4a-8c6d-515ead35af18 tempest-TestMinimumBasicScenario-102576986 tempest-TestMinimumBasicScenario-102576986-project] Returning 404 to user: Instance 76661008-e6d3-4646-a9ba-d5d0e83a4b65 could not be found. {{(pid=129321) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 12:47:20.848471 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: INFO nova.api.openstack.requestlog [None req-868207cd-4391-4f4a-8c6d-515ead35af18 tempest-TestMinimumBasicScenario-102576986 tempest-TestMinimumBasicScenario-102576986-project] 10.222.0.75 "GET /compute/v2.1/servers/76661008-e6d3-4646-a9ba-d5d0e83a4b65" status: 404 len: 111 microversion: 2.1 time: 0.035069 May 26 12:47:20.848471 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: [pid: 129321|app: 0|req: 451/923] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 26 12:47:20 2022] GET /compute/v2.1/servers/76661008-e6d3-4646-a9ba-d5d0e83a4b65 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 26 12:47:20.856100 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi [None req-210ebf6e-cde2-4b7c-925c-2040684f38b7 tempest-TestMinimumBasicScenario-102576986 tempest-TestMinimumBasicScenario-102576986-project] Calling method '.version_select at 0x7f83083a4820>' {{(pid=129322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:47:20.878354 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: INFO nova.api.openstack.requestlog [None req-210ebf6e-cde2-4b7c-925c-2040684f38b7 tempest-TestMinimumBasicScenario-102576986 tempest-TestMinimumBasicScenario-102576986-project] 10.222.0.75 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-711313202" status: 202 len: 0 microversion: 2.1 time: 0.027071 May 26 12:47:20.879120 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: [pid: 129322|app: 0|req: 473/924] 10.222.0.75 () {58 vars in 1268 bytes} [Thu May 26 12:47:20 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-711313202 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 26 12:47:30.439055 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi [None req-772f47a4-cdfd-437c-bb39-80ac7ca1e279 tempest-AttachVolumeTestJSON-1454716698 tempest-AttachVolumeTestJSON-1454716698-project] Action: 'create', calling method: .version_select at 0x7f82fbf4fdc0>, body: {"keypair": {"name": "tempest-keypair-66458007", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMBOVjCXxUJIN6kDySs2KzMqT3hVCVeBtborCjoC6+VlMm5W9G2VgOqgGn/eAdCMT2/2Nm/wcmTSBrXfOzC9KWhpu9QiCVu0ZeJw/XzzFuvtyTP0hTXxWfQZ1YEG8Y7sbQ=="}} {{(pid=129321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 12:47:30.457951 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.quota [None req-772f47a4-cdfd-437c-bb39-80ac7ca1e279 tempest-AttachVolumeTestJSON-1454716698 tempest-AttachVolumeTestJSON-1454716698-project] Getting quotas for project a9f9a22ad1e74798b9b2f7d85f89a4b6. Resources: {'key_pairs'} {{(pid=129321) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 26 12:47:30.464842 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.quota [None req-772f47a4-cdfd-437c-bb39-80ac7ca1e279 tempest-AttachVolumeTestJSON-1454716698 tempest-AttachVolumeTestJSON-1454716698-project] Getting quotas for user 4e987a71a29243dbac6c23e337765508 and project a9f9a22ad1e74798b9b2f7d85f89a4b6. Resources: {'key_pairs'} {{(pid=129321) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 26 12:47:30.498595 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: INFO nova.api.openstack.requestlog [None req-772f47a4-cdfd-437c-bb39-80ac7ca1e279 tempest-AttachVolumeTestJSON-1454716698 tempest-AttachVolumeTestJSON-1454716698-project] 10.222.0.75 "POST /compute/v2.1/os-keypairs" status: 200 len: 384 microversion: 2.1 time: 0.229520 May 26 12:47:30.503075 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: [pid: 129321|app: 0|req: 452/925] 10.222.0.75 () {60 vars in 1158 bytes} [Thu May 26 12:47:30 2022] POST /compute/v2.1/os-keypairs => generated 384 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 12:47:32.254795 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG dbcounter [-] [129322] Writing DB stats nova_cell1:SELECT=44,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=129322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:47:32.256144 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG dbcounter [-] [129322] Writing DB stats nova_api:SELECT=49,nova_api:UPDATE=3,nova_api:DELETE=1 {{(pid=129322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:47:32.263680 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi [None req-0b07a1bd-2204-41cb-97e3-6a927a2933fe tempest-AttachVolumeTestJSON-1454716698 tempest-AttachVolumeTestJSON-1454716698-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-2045822783", "imageRef": "1e3c323d-d797-4e6d-bd9a-482d90084b0c", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "cb7a4ed5-5abd-45e0-aef5-449f084fc9b8"}], "security_groups": [{"name": "tempest-securitygroup--872962728"}], "key_name": "tempest-keypair-66458007", "user_data": "}} {{(pid=129322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 12:47:32.393938 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.network.neutron [None req-0b07a1bd-2204-41cb-97e3-6a927a2933fe tempest-AttachVolumeTestJSON-1454716698 tempest-AttachVolumeTestJSON-1454716698-project] validate_networks() for [('cb7a4ed5-5abd-45e0-aef5-449f084fc9b8', None, None, None, None, None)] {{(pid=129322) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 26 12:47:32.983243 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.virt.hardware [None req-0b07a1bd-2204-41cb-97e3-6a927a2933fe tempest-AttachVolumeTestJSON-1454716698 tempest-AttachVolumeTestJSON-1454716698-project] Flavor limits 0:0:0 {{(pid=129322) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 26 12:47:32.983983 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.virt.hardware [None req-0b07a1bd-2204-41cb-97e3-6a927a2933fe tempest-AttachVolumeTestJSON-1454716698 tempest-AttachVolumeTestJSON-1454716698-project] Image limits 0:0:0 {{(pid=129322) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 26 12:47:32.984846 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.virt.hardware [None req-0b07a1bd-2204-41cb-97e3-6a927a2933fe tempest-AttachVolumeTestJSON-1454716698 tempest-AttachVolumeTestJSON-1454716698-project] Flavor pref 0:0:0 {{(pid=129322) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 26 12:47:32.985421 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.virt.hardware [None req-0b07a1bd-2204-41cb-97e3-6a927a2933fe tempest-AttachVolumeTestJSON-1454716698 tempest-AttachVolumeTestJSON-1454716698-project] Image pref 0:0:0 {{(pid=129322) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 26 12:47:32.986012 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.virt.hardware [None req-0b07a1bd-2204-41cb-97e3-6a927a2933fe tempest-AttachVolumeTestJSON-1454716698 tempest-AttachVolumeTestJSON-1454716698-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129322) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 26 12:47:32.996418 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-0b07a1bd-2204-41cb-97e3-6a927a2933fe tempest-AttachVolumeTestJSON-1454716698 tempest-AttachVolumeTestJSON-1454716698-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:47:32.996930 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-0b07a1bd-2204-41cb-97e3-6a927a2933fe tempest-AttachVolumeTestJSON-1454716698 tempest-AttachVolumeTestJSON-1454716698-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:47:32.997755 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-0b07a1bd-2204-41cb-97e3-6a927a2933fe tempest-AttachVolumeTestJSON-1454716698 tempest-AttachVolumeTestJSON-1454716698-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:47:32.998212 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-0b07a1bd-2204-41cb-97e3-6a927a2933fe tempest-AttachVolumeTestJSON-1454716698 tempest-AttachVolumeTestJSON-1454716698-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:47:33.025097 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.quota [None req-0b07a1bd-2204-41cb-97e3-6a927a2933fe tempest-AttachVolumeTestJSON-1454716698 tempest-AttachVolumeTestJSON-1454716698-project] Getting quotas for project a9f9a22ad1e74798b9b2f7d85f89a4b6. Resources: {'instances', 'cores', 'ram'} {{(pid=129322) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 26 12:47:33.029986 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.quota [None req-0b07a1bd-2204-41cb-97e3-6a927a2933fe tempest-AttachVolumeTestJSON-1454716698 tempest-AttachVolumeTestJSON-1454716698-project] Getting quotas for user 4e987a71a29243dbac6c23e337765508 and project a9f9a22ad1e74798b9b2f7d85f89a4b6. Resources: {'instances', 'cores', 'ram'} {{(pid=129322) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 26 12:47:33.046800 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.compute.api [None req-0b07a1bd-2204-41cb-97e3-6a927a2933fe tempest-AttachVolumeTestJSON-1454716698 tempest-AttachVolumeTestJSON-1454716698-project] Going to run 1 instances... {{(pid=129322) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 26 12:47:33.050415 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.compute.api [None req-0b07a1bd-2204-41cb-97e3-6a927a2933fe tempest-AttachVolumeTestJSON-1454716698 tempest-AttachVolumeTestJSON-1454716698-project] [instance: 51b4bd5b-19a0-4b50-804d-aff4216e854c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1e3c323d-d797-4e6d-bd9a-482d90084b0c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129322) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 26 12:47:33.116346 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR oslo.messaging._drivers.impl_rabbit [None req-0b07a1bd-2204-41cb-97e3-6a927a2933fe tempest-AttachVolumeTestJSON-1454716698 tempest-AttachVolumeTestJSON-1454716698-project] [dc6c39f0-c3aa-412a-b1d9-5030a30687b7] AMQP server on 10.222.0.75:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer May 26 12:47:34.125163 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: INFO oslo.messaging._drivers.impl_rabbit [None req-0b07a1bd-2204-41cb-97e3-6a927a2933fe tempest-AttachVolumeTestJSON-1454716698 tempest-AttachVolumeTestJSON-1454716698-project] [dc6c39f0-c3aa-412a-b1d9-5030a30687b7] Reconnected to AMQP server on 10.222.0.75:5672 via [amqp] client with port 35136. May 26 12:47:34.129794 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: INFO nova.api.openstack.requestlog [None req-0b07a1bd-2204-41cb-97e3-6a927a2933fe tempest-AttachVolumeTestJSON-1454716698 tempest-AttachVolumeTestJSON-1454716698-project] 10.222.0.75 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 1.877914 May 26 12:47:34.130992 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: [pid: 129322|app: 0|req: 474/926] 10.222.0.75 () {60 vars in 1146 bytes} [Thu May 26 12:47:32 2022] POST /compute/v2.1/servers => generated 401 bytes in 1880 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 26 12:47:34.138267 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG dbcounter [-] [129321] Writing DB stats nova_cell1:SELECT=16 {{(pid=129321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:47:34.144072 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi [None req-651e5aa4-08ca-4fab-9909-890ca86ed69f tempest-AttachVolumeTestJSON-1454716698 tempest-AttachVolumeTestJSON-1454716698-project] Calling method '>' {{(pid=129321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:47:34.144739 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.compute.api [None req-651e5aa4-08ca-4fab-9909-890ca86ed69f tempest-AttachVolumeTestJSON-1454716698 tempest-AttachVolumeTestJSON-1454716698-project] [instance: 51b4bd5b-19a0-4b50-804d-aff4216e854c] Fetching instance by UUID {{(pid=129321) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:47:34.218276 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.policy [None req-651e5aa4-08ca-4fab-9909-890ca86ed69f tempest-AttachVolumeTestJSON-1454716698 tempest-AttachVolumeTestJSON-1454716698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e987a71a29243dbac6c23e337765508', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9f9a22ad1e74798b9b2f7d85f89a4b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129321) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:47:34.225455 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: INFO nova.api.openstack.requestlog [None req-651e5aa4-08ca-4fab-9909-890ca86ed69f tempest-AttachVolumeTestJSON-1454716698 tempest-AttachVolumeTestJSON-1454716698-project] 10.222.0.75 "GET /compute/v2.1/servers/51b4bd5b-19a0-4b50-804d-aff4216e854c" status: 200 len: 1236 microversion: 2.1 time: 0.088040 May 26 12:47:34.226046 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: [pid: 129321|app: 0|req: 453/927] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 26 12:47:34 2022] GET /compute/v2.1/servers/51b4bd5b-19a0-4b50-804d-aff4216e854c => generated 1236 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:47:35.251851 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi [None req-0f1abec0-63ba-4c52-b385-ded3bc9524b6 tempest-AttachVolumeTestJSON-1454716698 tempest-AttachVolumeTestJSON-1454716698-project] Calling method '>' {{(pid=129322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:47:35.255643 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.compute.api [None req-0f1abec0-63ba-4c52-b385-ded3bc9524b6 tempest-AttachVolumeTestJSON-1454716698 tempest-AttachVolumeTestJSON-1454716698-project] [instance: 51b4bd5b-19a0-4b50-804d-aff4216e854c] Fetching instance by UUID {{(pid=129322) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:47:35.273953 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-0f1abec0-63ba-4c52-b385-ded3bc9524b6 tempest-AttachVolumeTestJSON-1454716698 tempest-AttachVolumeTestJSON-1454716698-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:47:35.275100 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-0f1abec0-63ba-4c52-b385-ded3bc9524b6 tempest-AttachVolumeTestJSON-1454716698 tempest-AttachVolumeTestJSON-1454716698-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:47:35.276292 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-0f1abec0-63ba-4c52-b385-ded3bc9524b6 tempest-AttachVolumeTestJSON-1454716698 tempest-AttachVolumeTestJSON-1454716698-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:47:35.276767 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-0f1abec0-63ba-4c52-b385-ded3bc9524b6 tempest-AttachVolumeTestJSON-1454716698 tempest-AttachVolumeTestJSON-1454716698-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:47:35.575169 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.policy [None req-0f1abec0-63ba-4c52-b385-ded3bc9524b6 tempest-AttachVolumeTestJSON-1454716698 tempest-AttachVolumeTestJSON-1454716698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e987a71a29243dbac6c23e337765508', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9f9a22ad1e74798b9b2f7d85f89a4b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129322) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:47:35.584806 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: INFO nova.api.openstack.requestlog [None req-0f1abec0-63ba-4c52-b385-ded3bc9524b6 tempest-AttachVolumeTestJSON-1454716698 tempest-AttachVolumeTestJSON-1454716698-project] 10.222.0.75 "GET /compute/v2.1/servers/51b4bd5b-19a0-4b50-804d-aff4216e854c" status: 200 len: 1296 microversion: 2.1 time: 0.341798 May 26 12:47:35.585476 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: [pid: 129322|app: 0|req: 475/928] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 26 12:47:35 2022] GET /compute/v2.1/servers/51b4bd5b-19a0-4b50-804d-aff4216e854c => generated 1296 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:47:36.601955 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi [None req-29135e5f-eb22-446d-b94a-eba8f1e434b3 tempest-AttachVolumeTestJSON-1454716698 tempest-AttachVolumeTestJSON-1454716698-project] Calling method '>' {{(pid=129321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:47:36.602551 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.compute.api [None req-29135e5f-eb22-446d-b94a-eba8f1e434b3 tempest-AttachVolumeTestJSON-1454716698 tempest-AttachVolumeTestJSON-1454716698-project] [instance: 51b4bd5b-19a0-4b50-804d-aff4216e854c] Fetching instance by UUID {{(pid=129321) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:47:36.609775 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-29135e5f-eb22-446d-b94a-eba8f1e434b3 tempest-AttachVolumeTestJSON-1454716698 tempest-AttachVolumeTestJSON-1454716698-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:47:36.610224 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-29135e5f-eb22-446d-b94a-eba8f1e434b3 tempest-AttachVolumeTestJSON-1454716698 tempest-AttachVolumeTestJSON-1454716698-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:47:36.610990 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-29135e5f-eb22-446d-b94a-eba8f1e434b3 tempest-AttachVolumeTestJSON-1454716698 tempest-AttachVolumeTestJSON-1454716698-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:47:36.611590 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-29135e5f-eb22-446d-b94a-eba8f1e434b3 tempest-AttachVolumeTestJSON-1454716698 tempest-AttachVolumeTestJSON-1454716698-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:47:36.849204 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.policy [None req-29135e5f-eb22-446d-b94a-eba8f1e434b3 tempest-AttachVolumeTestJSON-1454716698 tempest-AttachVolumeTestJSON-1454716698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e987a71a29243dbac6c23e337765508', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9f9a22ad1e74798b9b2f7d85f89a4b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129321) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:47:36.857733 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: INFO nova.api.openstack.requestlog [None req-29135e5f-eb22-446d-b94a-eba8f1e434b3 tempest-AttachVolumeTestJSON-1454716698 tempest-AttachVolumeTestJSON-1454716698-project] 10.222.0.75 "GET /compute/v2.1/servers/51b4bd5b-19a0-4b50-804d-aff4216e854c" status: 200 len: 1361 microversion: 2.1 time: 0.259931 May 26 12:47:36.858238 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: [pid: 129321|app: 0|req: 454/929] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 26 12:47:36 2022] GET /compute/v2.1/servers/51b4bd5b-19a0-4b50-804d-aff4216e854c => generated 1361 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:47:37.260516 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi [req-ad2d6916-d690-4707-a7e2-d22818fb7cad req-653be25f-7abd-4ab4-8101-b36ce4b778fe service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "51b4bd5b-19a0-4b50-804d-aff4216e854c", "tag": "c8eb9be5-5a23-4ce3-91ab-0a8c5ead259d"}]} {{(pid=129322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 12:47:37.282014 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [req-ad2d6916-d690-4707-a7e2-d22818fb7cad req-653be25f-7abd-4ab4-8101-b36ce4b778fe service nova] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:47:37.282669 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [req-ad2d6916-d690-4707-a7e2-d22818fb7cad req-653be25f-7abd-4ab4-8101-b36ce4b778fe service nova] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:47:37.300731 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: INFO nova.api.openstack.compute.server_external_events [req-ad2d6916-d690-4707-a7e2-d22818fb7cad req-653be25f-7abd-4ab4-8101-b36ce4b778fe service nova] Creating event network-changed:c8eb9be5-5a23-4ce3-91ab-0a8c5ead259d for instance 51b4bd5b-19a0-4b50-804d-aff4216e854c on hv-cinder-81966 May 26 12:47:37.307727 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: INFO nova.api.openstack.requestlog [req-ad2d6916-d690-4707-a7e2-d22818fb7cad req-653be25f-7abd-4ab4-8101-b36ce4b778fe service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059319 May 26 12:47:37.308656 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: [pid: 129322|app: 0|req: 476/930] 10.222.0.75 () {64 vars in 1317 bytes} [Thu May 26 12:47:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 12:47:37.874594 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi [None req-32d92612-fd93-4679-81ad-2c8a107d05b4 tempest-AttachVolumeTestJSON-1454716698 tempest-AttachVolumeTestJSON-1454716698-project] Calling method '>' {{(pid=129321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:47:37.875229 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.compute.api [None req-32d92612-fd93-4679-81ad-2c8a107d05b4 tempest-AttachVolumeTestJSON-1454716698 tempest-AttachVolumeTestJSON-1454716698-project] [instance: 51b4bd5b-19a0-4b50-804d-aff4216e854c] Fetching instance by UUID {{(pid=129321) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:47:37.882269 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-32d92612-fd93-4679-81ad-2c8a107d05b4 tempest-AttachVolumeTestJSON-1454716698 tempest-AttachVolumeTestJSON-1454716698-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:47:37.882688 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-32d92612-fd93-4679-81ad-2c8a107d05b4 tempest-AttachVolumeTestJSON-1454716698 tempest-AttachVolumeTestJSON-1454716698-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:47:37.883512 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-32d92612-fd93-4679-81ad-2c8a107d05b4 tempest-AttachVolumeTestJSON-1454716698 tempest-AttachVolumeTestJSON-1454716698-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:47:37.883984 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-32d92612-fd93-4679-81ad-2c8a107d05b4 tempest-AttachVolumeTestJSON-1454716698 tempest-AttachVolumeTestJSON-1454716698-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:47:38.019265 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.policy [None req-32d92612-fd93-4679-81ad-2c8a107d05b4 tempest-AttachVolumeTestJSON-1454716698 tempest-AttachVolumeTestJSON-1454716698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e987a71a29243dbac6c23e337765508', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9f9a22ad1e74798b9b2f7d85f89a4b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129321) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:47:38.028174 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: INFO nova.api.openstack.requestlog [None req-32d92612-fd93-4679-81ad-2c8a107d05b4 tempest-AttachVolumeTestJSON-1454716698 tempest-AttachVolumeTestJSON-1454716698-project] 10.222.0.75 "GET /compute/v2.1/servers/51b4bd5b-19a0-4b50-804d-aff4216e854c" status: 200 len: 1361 microversion: 2.1 time: 0.157476 May 26 12:47:38.028751 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: [pid: 129321|app: 0|req: 455/931] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 26 12:47:37 2022] GET /compute/v2.1/servers/51b4bd5b-19a0-4b50-804d-aff4216e854c => generated 1361 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:47:39.049192 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi [None req-5292469d-ee4f-4aa8-8d63-4486cf0e21b8 tempest-AttachVolumeTestJSON-1454716698 tempest-AttachVolumeTestJSON-1454716698-project] Calling method '>' {{(pid=129322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:47:39.050347 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.compute.api [None req-5292469d-ee4f-4aa8-8d63-4486cf0e21b8 tempest-AttachVolumeTestJSON-1454716698 tempest-AttachVolumeTestJSON-1454716698-project] [instance: 51b4bd5b-19a0-4b50-804d-aff4216e854c] Fetching instance by UUID {{(pid=129322) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:47:39.060268 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-5292469d-ee4f-4aa8-8d63-4486cf0e21b8 tempest-AttachVolumeTestJSON-1454716698 tempest-AttachVolumeTestJSON-1454716698-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:47:39.061017 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-5292469d-ee4f-4aa8-8d63-4486cf0e21b8 tempest-AttachVolumeTestJSON-1454716698 tempest-AttachVolumeTestJSON-1454716698-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:47:39.062292 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-5292469d-ee4f-4aa8-8d63-4486cf0e21b8 tempest-AttachVolumeTestJSON-1454716698 tempest-AttachVolumeTestJSON-1454716698-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:47:39.063016 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-5292469d-ee4f-4aa8-8d63-4486cf0e21b8 tempest-AttachVolumeTestJSON-1454716698 tempest-AttachVolumeTestJSON-1454716698-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:47:39.205324 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.policy [None req-5292469d-ee4f-4aa8-8d63-4486cf0e21b8 tempest-AttachVolumeTestJSON-1454716698 tempest-AttachVolumeTestJSON-1454716698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e987a71a29243dbac6c23e337765508', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9f9a22ad1e74798b9b2f7d85f89a4b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129322) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:47:39.214457 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: INFO nova.api.openstack.requestlog [None req-5292469d-ee4f-4aa8-8d63-4486cf0e21b8 tempest-AttachVolumeTestJSON-1454716698 tempest-AttachVolumeTestJSON-1454716698-project] 10.222.0.75 "GET /compute/v2.1/servers/51b4bd5b-19a0-4b50-804d-aff4216e854c" status: 200 len: 1361 microversion: 2.1 time: 0.172482 May 26 12:47:39.215041 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: [pid: 129322|app: 0|req: 477/932] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 26 12:47:39 2022] GET /compute/v2.1/servers/51b4bd5b-19a0-4b50-804d-aff4216e854c => generated 1361 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:47:40.231561 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi [None req-eec24c71-5aa4-47b5-a694-3b8a6cbf269c tempest-AttachVolumeTestJSON-1454716698 tempest-AttachVolumeTestJSON-1454716698-project] Calling method '>' {{(pid=129321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:47:40.232206 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.compute.api [None req-eec24c71-5aa4-47b5-a694-3b8a6cbf269c tempest-AttachVolumeTestJSON-1454716698 tempest-AttachVolumeTestJSON-1454716698-project] [instance: 51b4bd5b-19a0-4b50-804d-aff4216e854c] Fetching instance by UUID {{(pid=129321) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:47:40.234684 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG dbcounter [-] [129321] Writing DB stats nova_api:SELECT=53,nova_api:INSERT=1 {{(pid=129321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:47:40.240746 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-eec24c71-5aa4-47b5-a694-3b8a6cbf269c tempest-AttachVolumeTestJSON-1454716698 tempest-AttachVolumeTestJSON-1454716698-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:47:40.241120 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-eec24c71-5aa4-47b5-a694-3b8a6cbf269c tempest-AttachVolumeTestJSON-1454716698 tempest-AttachVolumeTestJSON-1454716698-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:47:40.241902 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-eec24c71-5aa4-47b5-a694-3b8a6cbf269c tempest-AttachVolumeTestJSON-1454716698 tempest-AttachVolumeTestJSON-1454716698-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:47:40.244579 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-eec24c71-5aa4-47b5-a694-3b8a6cbf269c tempest-AttachVolumeTestJSON-1454716698 tempest-AttachVolumeTestJSON-1454716698-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:47:40.469977 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.policy [None req-eec24c71-5aa4-47b5-a694-3b8a6cbf269c tempest-AttachVolumeTestJSON-1454716698 tempest-AttachVolumeTestJSON-1454716698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e987a71a29243dbac6c23e337765508', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9f9a22ad1e74798b9b2f7d85f89a4b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129321) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:47:40.478182 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: INFO nova.api.openstack.requestlog [None req-eec24c71-5aa4-47b5-a694-3b8a6cbf269c tempest-AttachVolumeTestJSON-1454716698 tempest-AttachVolumeTestJSON-1454716698-project] 10.222.0.75 "GET /compute/v2.1/servers/51b4bd5b-19a0-4b50-804d-aff4216e854c" status: 200 len: 1361 microversion: 2.1 time: 0.250539 May 26 12:47:40.478780 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: [pid: 129321|app: 0|req: 456/933] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 26 12:47:40 2022] GET /compute/v2.1/servers/51b4bd5b-19a0-4b50-804d-aff4216e854c => generated 1361 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:47:41.495489 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi [None req-5b96460b-a170-4ed5-ab95-89aa021102ee tempest-AttachVolumeTestJSON-1454716698 tempest-AttachVolumeTestJSON-1454716698-project] Calling method '>' {{(pid=129322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:47:41.496294 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.compute.api [None req-5b96460b-a170-4ed5-ab95-89aa021102ee tempest-AttachVolumeTestJSON-1454716698 tempest-AttachVolumeTestJSON-1454716698-project] [instance: 51b4bd5b-19a0-4b50-804d-aff4216e854c] Fetching instance by UUID {{(pid=129322) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:47:41.503520 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-5b96460b-a170-4ed5-ab95-89aa021102ee tempest-AttachVolumeTestJSON-1454716698 tempest-AttachVolumeTestJSON-1454716698-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:47:41.504062 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-5b96460b-a170-4ed5-ab95-89aa021102ee tempest-AttachVolumeTestJSON-1454716698 tempest-AttachVolumeTestJSON-1454716698-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:47:41.504851 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-5b96460b-a170-4ed5-ab95-89aa021102ee tempest-AttachVolumeTestJSON-1454716698 tempest-AttachVolumeTestJSON-1454716698-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:47:41.505277 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-5b96460b-a170-4ed5-ab95-89aa021102ee tempest-AttachVolumeTestJSON-1454716698 tempest-AttachVolumeTestJSON-1454716698-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:47:41.652921 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.policy [None req-5b96460b-a170-4ed5-ab95-89aa021102ee tempest-AttachVolumeTestJSON-1454716698 tempest-AttachVolumeTestJSON-1454716698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e987a71a29243dbac6c23e337765508', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9f9a22ad1e74798b9b2f7d85f89a4b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129322) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:47:41.661114 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: INFO nova.api.openstack.requestlog [None req-5b96460b-a170-4ed5-ab95-89aa021102ee tempest-AttachVolumeTestJSON-1454716698 tempest-AttachVolumeTestJSON-1454716698-project] 10.222.0.75 "GET /compute/v2.1/servers/51b4bd5b-19a0-4b50-804d-aff4216e854c" status: 200 len: 1361 microversion: 2.1 time: 0.169619 May 26 12:47:41.661704 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: [pid: 129322|app: 0|req: 478/934] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 26 12:47:41 2022] GET /compute/v2.1/servers/51b4bd5b-19a0-4b50-804d-aff4216e854c => generated 1361 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:47:42.682490 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi [None req-74ac0808-9f01-4d7e-8e95-12c22b652085 tempest-AttachVolumeTestJSON-1454716698 tempest-AttachVolumeTestJSON-1454716698-project] Calling method '>' {{(pid=129321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:47:42.683141 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.compute.api [None req-74ac0808-9f01-4d7e-8e95-12c22b652085 tempest-AttachVolumeTestJSON-1454716698 tempest-AttachVolumeTestJSON-1454716698-project] [instance: 51b4bd5b-19a0-4b50-804d-aff4216e854c] Fetching instance by UUID {{(pid=129321) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:47:42.690535 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-74ac0808-9f01-4d7e-8e95-12c22b652085 tempest-AttachVolumeTestJSON-1454716698 tempest-AttachVolumeTestJSON-1454716698-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:47:42.691002 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-74ac0808-9f01-4d7e-8e95-12c22b652085 tempest-AttachVolumeTestJSON-1454716698 tempest-AttachVolumeTestJSON-1454716698-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:47:42.691856 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-74ac0808-9f01-4d7e-8e95-12c22b652085 tempest-AttachVolumeTestJSON-1454716698 tempest-AttachVolumeTestJSON-1454716698-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:47:42.692272 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-74ac0808-9f01-4d7e-8e95-12c22b652085 tempest-AttachVolumeTestJSON-1454716698 tempest-AttachVolumeTestJSON-1454716698-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:47:42.830004 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.policy [None req-74ac0808-9f01-4d7e-8e95-12c22b652085 tempest-AttachVolumeTestJSON-1454716698 tempest-AttachVolumeTestJSON-1454716698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e987a71a29243dbac6c23e337765508', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9f9a22ad1e74798b9b2f7d85f89a4b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129321) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:47:42.838214 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: INFO nova.api.openstack.requestlog [None req-74ac0808-9f01-4d7e-8e95-12c22b652085 tempest-AttachVolumeTestJSON-1454716698 tempest-AttachVolumeTestJSON-1454716698-project] 10.222.0.75 "GET /compute/v2.1/servers/51b4bd5b-19a0-4b50-804d-aff4216e854c" status: 200 len: 1361 microversion: 2.1 time: 0.159693 May 26 12:47:42.838787 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: [pid: 129321|app: 0|req: 457/935] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 26 12:47:42 2022] GET /compute/v2.1/servers/51b4bd5b-19a0-4b50-804d-aff4216e854c => generated 1361 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 12:47:43.233705 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi [req-039c7e96-e5e1-46ba-b3d6-7d5fabb764d6 req-50ade40f-48c5-45b4-b173-b5cf0c902c01 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "51b4bd5b-19a0-4b50-804d-aff4216e854c", "name": "network-vif-plugged", "status": "completed", "tag": "c8eb9be5-5a23-4ce3-91ab-0a8c5ead259d"}]} {{(pid=129322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 12:47:43.238209 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG dbcounter [-] [129322] Writing DB stats nova_cell0:SELECT=2 {{(pid=129322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:47:43.238938 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG dbcounter [-] [129322] Writing DB stats nova_cell0:SELECT=6 {{(pid=129322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:47:43.247931 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [req-039c7e96-e5e1-46ba-b3d6-7d5fabb764d6 req-50ade40f-48c5-45b4-b173-b5cf0c902c01 service nova] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:47:43.248380 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [req-039c7e96-e5e1-46ba-b3d6-7d5fabb764d6 req-50ade40f-48c5-45b4-b173-b5cf0c902c01 service nova] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:47:43.261177 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: INFO nova.api.openstack.compute.server_external_events [req-039c7e96-e5e1-46ba-b3d6-7d5fabb764d6 req-50ade40f-48c5-45b4-b173-b5cf0c902c01 service nova] Creating event network-vif-plugged:c8eb9be5-5a23-4ce3-91ab-0a8c5ead259d for instance 51b4bd5b-19a0-4b50-804d-aff4216e854c on hv-cinder-81966 May 26 12:47:43.267263 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: INFO nova.api.openstack.requestlog [req-039c7e96-e5e1-46ba-b3d6-7d5fabb764d6 req-50ade40f-48c5-45b4-b173-b5cf0c902c01 service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037386 May 26 12:47:43.268180 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: [pid: 129322|app: 0|req: 479/936] 10.222.0.75 () {64 vars in 1317 bytes} [Thu May 26 12:47:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 12:47:43.855522 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi [None req-be1795ff-893b-4964-b6a2-8b78551e072e tempest-AttachVolumeTestJSON-1454716698 tempest-AttachVolumeTestJSON-1454716698-project] Calling method '>' {{(pid=129321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:47:43.856155 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.compute.api [None req-be1795ff-893b-4964-b6a2-8b78551e072e tempest-AttachVolumeTestJSON-1454716698 tempest-AttachVolumeTestJSON-1454716698-project] [instance: 51b4bd5b-19a0-4b50-804d-aff4216e854c] Fetching instance by UUID {{(pid=129321) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:47:43.863287 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-be1795ff-893b-4964-b6a2-8b78551e072e tempest-AttachVolumeTestJSON-1454716698 tempest-AttachVolumeTestJSON-1454716698-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:47:43.863778 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-be1795ff-893b-4964-b6a2-8b78551e072e tempest-AttachVolumeTestJSON-1454716698 tempest-AttachVolumeTestJSON-1454716698-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:47:43.864541 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-be1795ff-893b-4964-b6a2-8b78551e072e tempest-AttachVolumeTestJSON-1454716698 tempest-AttachVolumeTestJSON-1454716698-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:47:43.864991 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-be1795ff-893b-4964-b6a2-8b78551e072e tempest-AttachVolumeTestJSON-1454716698 tempest-AttachVolumeTestJSON-1454716698-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:47:44.014037 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.policy [None req-be1795ff-893b-4964-b6a2-8b78551e072e tempest-AttachVolumeTestJSON-1454716698 tempest-AttachVolumeTestJSON-1454716698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e987a71a29243dbac6c23e337765508', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9f9a22ad1e74798b9b2f7d85f89a4b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129321) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:47:44.022281 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: INFO nova.api.openstack.requestlog [None req-be1795ff-893b-4964-b6a2-8b78551e072e tempest-AttachVolumeTestJSON-1454716698 tempest-AttachVolumeTestJSON-1454716698-project] 10.222.0.75 "GET /compute/v2.1/servers/51b4bd5b-19a0-4b50-804d-aff4216e854c" status: 200 len: 1361 microversion: 2.1 time: 0.170722 May 26 12:47:44.022892 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: [pid: 129321|app: 0|req: 458/937] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 26 12:47:43 2022] GET /compute/v2.1/servers/51b4bd5b-19a0-4b50-804d-aff4216e854c => generated 1361 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:47:45.040698 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi [None req-93b0ac16-b089-49f5-867d-b2c58c4e7e1a tempest-AttachVolumeTestJSON-1454716698 tempest-AttachVolumeTestJSON-1454716698-project] Calling method '>' {{(pid=129322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:47:45.042590 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.compute.api [None req-93b0ac16-b089-49f5-867d-b2c58c4e7e1a tempest-AttachVolumeTestJSON-1454716698 tempest-AttachVolumeTestJSON-1454716698-project] [instance: 51b4bd5b-19a0-4b50-804d-aff4216e854c] Fetching instance by UUID {{(pid=129322) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:47:45.049829 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-93b0ac16-b089-49f5-867d-b2c58c4e7e1a tempest-AttachVolumeTestJSON-1454716698 tempest-AttachVolumeTestJSON-1454716698-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:47:45.050272 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-93b0ac16-b089-49f5-867d-b2c58c4e7e1a tempest-AttachVolumeTestJSON-1454716698 tempest-AttachVolumeTestJSON-1454716698-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:47:45.051060 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-93b0ac16-b089-49f5-867d-b2c58c4e7e1a tempest-AttachVolumeTestJSON-1454716698 tempest-AttachVolumeTestJSON-1454716698-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:47:45.051496 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-93b0ac16-b089-49f5-867d-b2c58c4e7e1a tempest-AttachVolumeTestJSON-1454716698 tempest-AttachVolumeTestJSON-1454716698-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:47:45.191561 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.policy [None req-93b0ac16-b089-49f5-867d-b2c58c4e7e1a tempest-AttachVolumeTestJSON-1454716698 tempest-AttachVolumeTestJSON-1454716698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e987a71a29243dbac6c23e337765508', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9f9a22ad1e74798b9b2f7d85f89a4b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129322) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:47:45.200128 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: INFO nova.api.openstack.requestlog [None req-93b0ac16-b089-49f5-867d-b2c58c4e7e1a tempest-AttachVolumeTestJSON-1454716698 tempest-AttachVolumeTestJSON-1454716698-project] 10.222.0.75 "GET /compute/v2.1/servers/51b4bd5b-19a0-4b50-804d-aff4216e854c" status: 200 len: 1547 microversion: 2.1 time: 0.163739 May 26 12:47:45.200710 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: [pid: 129322|app: 0|req: 480/938] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 26 12:47:45 2022] GET /compute/v2.1/servers/51b4bd5b-19a0-4b50-804d-aff4216e854c => generated 1547 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 12:47:45.210160 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi [None req-558ddeb2-52a1-4b1f-ae69-87baeaa4376b tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Calling method '>' {{(pid=129321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:47:45.211399 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.compute.api [None req-558ddeb2-52a1-4b1f-ae69-87baeaa4376b tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] [instance: f44f180b-9143-43d6-b9cd-ced0c42fd928] Fetching instance by UUID {{(pid=129321) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:47:45.213569 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG dbcounter [-] [129321] Writing DB stats nova_cell0:SELECT=6 {{(pid=129321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:47:45.217268 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi [None req-e1d7c385-4425-4a57-b3cb-ac818017501d tempest-AttachVolumeTestJSON-1454716698 tempest-AttachVolumeTestJSON-1454716698-project] Calling method '>' {{(pid=129322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:47:45.217881 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.compute.api [None req-e1d7c385-4425-4a57-b3cb-ac818017501d tempest-AttachVolumeTestJSON-1454716698 tempest-AttachVolumeTestJSON-1454716698-project] [instance: 51b4bd5b-19a0-4b50-804d-aff4216e854c] Fetching instance by UUID {{(pid=129322) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:47:45.219742 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-558ddeb2-52a1-4b1f-ae69-87baeaa4376b tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:47:45.220188 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-558ddeb2-52a1-4b1f-ae69-87baeaa4376b tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:47:45.220964 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-558ddeb2-52a1-4b1f-ae69-87baeaa4376b tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:47:45.221393 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-558ddeb2-52a1-4b1f-ae69-87baeaa4376b tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:47:45.224366 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-e1d7c385-4425-4a57-b3cb-ac818017501d tempest-AttachVolumeTestJSON-1454716698 tempest-AttachVolumeTestJSON-1454716698-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:47:45.225507 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-e1d7c385-4425-4a57-b3cb-ac818017501d tempest-AttachVolumeTestJSON-1454716698 tempest-AttachVolumeTestJSON-1454716698-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:47:45.226292 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-e1d7c385-4425-4a57-b3cb-ac818017501d tempest-AttachVolumeTestJSON-1454716698 tempest-AttachVolumeTestJSON-1454716698-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:47:45.226736 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-e1d7c385-4425-4a57-b3cb-ac818017501d tempest-AttachVolumeTestJSON-1454716698 tempest-AttachVolumeTestJSON-1454716698-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:47:45.246679 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: INFO nova.api.openstack.requestlog [None req-558ddeb2-52a1-4b1f-ae69-87baeaa4376b tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] 10.222.0.75 "GET /compute/v2.1/servers/f44f180b-9143-43d6-b9cd-ced0c42fd928/ips" status: 200 len: 152 microversion: 2.20 time: 0.040084 May 26 12:47:45.246679 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: [pid: 129321|app: 0|req: 459/939] 10.222.0.75 () {60 vars in 1288 bytes} [Thu May 26 12:47:45 2022] GET /compute/v2.1/servers/f44f180b-9143-43d6-b9cd-ced0c42fd928/ips => generated 152 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 26 12:47:45.310760 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: INFO nova.api.openstack.requestlog [None req-e1d7c385-4425-4a57-b3cb-ac818017501d tempest-AttachVolumeTestJSON-1454716698 tempest-AttachVolumeTestJSON-1454716698-project] 10.222.0.75 "GET /compute/v2.1/servers/51b4bd5b-19a0-4b50-804d-aff4216e854c/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.097894 May 26 12:47:45.311386 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: [pid: 129322|app: 0|req: 481/940] 10.222.0.75 () {58 vars in 1274 bytes} [Thu May 26 12:47:45 2022] GET /compute/v2.1/servers/51b4bd5b-19a0-4b50-804d-aff4216e854c/os-interface => generated 285 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 12:47:46.342305 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi [req-76b280a7-6367-4208-8726-20a275d3b387 req-0ac37d10-5d01-4fe1-958b-b0a9cd6cfca9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "51b4bd5b-19a0-4b50-804d-aff4216e854c", "tag": "c8eb9be5-5a23-4ce3-91ab-0a8c5ead259d"}]} {{(pid=129321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 12:47:46.351286 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [req-76b280a7-6367-4208-8726-20a275d3b387 req-0ac37d10-5d01-4fe1-958b-b0a9cd6cfca9 service nova] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:47:46.351747 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [req-76b280a7-6367-4208-8726-20a275d3b387 req-0ac37d10-5d01-4fe1-958b-b0a9cd6cfca9 service nova] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:47:46.362965 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: INFO nova.api.openstack.compute.server_external_events [req-76b280a7-6367-4208-8726-20a275d3b387 req-0ac37d10-5d01-4fe1-958b-b0a9cd6cfca9 service nova] Creating event network-changed:c8eb9be5-5a23-4ce3-91ab-0a8c5ead259d for instance 51b4bd5b-19a0-4b50-804d-aff4216e854c on hv-cinder-81966 May 26 12:47:46.368276 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: INFO nova.api.openstack.requestlog [req-76b280a7-6367-4208-8726-20a275d3b387 req-0ac37d10-5d01-4fe1-958b-b0a9cd6cfca9 service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029567 May 26 12:47:46.368939 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: [pid: 129321|app: 0|req: 460/941] 10.222.0.75 () {64 vars in 1317 bytes} [Thu May 26 12:47:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 12:47:47.070739 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi [None req-a35ce427-562e-4da8-ab3d-83aca5de61e1 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=129322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 12:47:47.071185 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.compute.api [None req-a35ce427-562e-4da8-ab3d-83aca5de61e1 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] [instance: f44f180b-9143-43d6-b9cd-ced0c42fd928] Fetching instance by UUID {{(pid=129322) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:47:47.077729 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-a35ce427-562e-4da8-ab3d-83aca5de61e1 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:47:47.078502 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-a35ce427-562e-4da8-ab3d-83aca5de61e1 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:47:47.079305 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-a35ce427-562e-4da8-ab3d-83aca5de61e1 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:47:47.079789 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-a35ce427-562e-4da8-ab3d-83aca5de61e1 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:47:47.104492 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.objects.instance [None req-a35ce427-562e-4da8-ab3d-83aca5de61e1 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lazy-loading 'flavor' on Instance uuid f44f180b-9143-43d6-b9cd-ced0c42fd928 {{(pid=129322) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 26 12:47:47.379031 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: INFO nova.api.openstack.requestlog [None req-a35ce427-562e-4da8-ab3d-83aca5de61e1 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] 10.222.0.75 "POST /compute/v2.1/servers/f44f180b-9143-43d6-b9cd-ced0c42fd928/action" status: 202 len: 0 microversion: 2.20 time: 0.313271 May 26 12:47:47.383306 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: [pid: 129322|app: 0|req: 482/942] 10.222.0.75 () {62 vars in 1318 bytes} [Thu May 26 12:47:47 2022] POST /compute/v2.1/servers/f44f180b-9143-43d6-b9cd-ced0c42fd928/action => generated 0 bytes in 315 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) May 26 12:47:47.392406 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi [None req-8dc12a13-5f7b-4533-8258-90f4e67dfd12 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Calling method '>' {{(pid=129321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:47:47.393101 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.compute.api [None req-8dc12a13-5f7b-4533-8258-90f4e67dfd12 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] [instance: f44f180b-9143-43d6-b9cd-ced0c42fd928] Fetching instance by UUID {{(pid=129321) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:47:47.400707 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-8dc12a13-5f7b-4533-8258-90f4e67dfd12 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:47:47.401235 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-8dc12a13-5f7b-4533-8258-90f4e67dfd12 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:47:47.401906 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-8dc12a13-5f7b-4533-8258-90f4e67dfd12 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:47:47.402336 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-8dc12a13-5f7b-4533-8258-90f4e67dfd12 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:47:47.541844 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.policy [None req-8dc12a13-5f7b-4533-8258-90f4e67dfd12 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e811736979c44b02b14fecb74c6bd7ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675272fb40d4847819f83ec04afecef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129321) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:47:47.550183 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.policy [None req-8dc12a13-5f7b-4533-8258-90f4e67dfd12 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e811736979c44b02b14fecb74c6bd7ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675272fb40d4847819f83ec04afecef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129321) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:47:47.551691 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.policy [None req-8dc12a13-5f7b-4533-8258-90f4e67dfd12 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e811736979c44b02b14fecb74c6bd7ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675272fb40d4847819f83ec04afecef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129321) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:47:47.552945 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: INFO nova.api.openstack.requestlog [None req-8dc12a13-5f7b-4533-8258-90f4e67dfd12 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] 10.222.0.75 "GET /compute/v2.1/servers/f44f180b-9143-43d6-b9cd-ced0c42fd928" status: 200 len: 1725 microversion: 2.20 time: 0.168098 May 26 12:47:47.553508 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: [pid: 129321|app: 0|req: 461/943] 10.222.0.75 () {60 vars in 1276 bytes} [Thu May 26 12:47:47 2022] GET /compute/v2.1/servers/f44f180b-9143-43d6-b9cd-ced0c42fd928 => generated 1725 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 12:47:48.573535 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi [None req-96b0b849-18bc-4028-bbcf-74d182555a95 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Calling method '>' {{(pid=129322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:47:48.574091 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.compute.api [None req-96b0b849-18bc-4028-bbcf-74d182555a95 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] [instance: f44f180b-9143-43d6-b9cd-ced0c42fd928] Fetching instance by UUID {{(pid=129322) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:47:48.581223 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-96b0b849-18bc-4028-bbcf-74d182555a95 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:47:48.581664 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-96b0b849-18bc-4028-bbcf-74d182555a95 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:47:48.582420 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-96b0b849-18bc-4028-bbcf-74d182555a95 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:47:48.582851 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-96b0b849-18bc-4028-bbcf-74d182555a95 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:47:48.716196 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.policy [None req-96b0b849-18bc-4028-bbcf-74d182555a95 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e811736979c44b02b14fecb74c6bd7ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675272fb40d4847819f83ec04afecef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129322) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:47:48.724894 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.policy [None req-96b0b849-18bc-4028-bbcf-74d182555a95 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e811736979c44b02b14fecb74c6bd7ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675272fb40d4847819f83ec04afecef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129322) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:47:48.726405 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.policy [None req-96b0b849-18bc-4028-bbcf-74d182555a95 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e811736979c44b02b14fecb74c6bd7ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675272fb40d4847819f83ec04afecef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129322) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:47:48.727602 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: INFO nova.api.openstack.requestlog [None req-96b0b849-18bc-4028-bbcf-74d182555a95 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] 10.222.0.75 "GET /compute/v2.1/servers/f44f180b-9143-43d6-b9cd-ced0c42fd928" status: 200 len: 1725 microversion: 2.20 time: 0.159150 May 26 12:47:48.728196 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: [pid: 129322|app: 0|req: 483/944] 10.222.0.75 () {60 vars in 1276 bytes} [Thu May 26 12:47:48 2022] GET /compute/v2.1/servers/f44f180b-9143-43d6-b9cd-ced0c42fd928 => generated 1725 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 12:47:49.746414 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi [None req-fcc8c44a-ce67-4a66-9975-68b8b6a8ece5 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Calling method '>' {{(pid=129321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:47:49.747048 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.compute.api [None req-fcc8c44a-ce67-4a66-9975-68b8b6a8ece5 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] [instance: f44f180b-9143-43d6-b9cd-ced0c42fd928] Fetching instance by UUID {{(pid=129321) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:47:49.753466 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-fcc8c44a-ce67-4a66-9975-68b8b6a8ece5 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:47:49.753915 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-fcc8c44a-ce67-4a66-9975-68b8b6a8ece5 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:47:49.754675 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-fcc8c44a-ce67-4a66-9975-68b8b6a8ece5 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:47:49.755184 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-fcc8c44a-ce67-4a66-9975-68b8b6a8ece5 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:47:49.890285 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.policy [None req-fcc8c44a-ce67-4a66-9975-68b8b6a8ece5 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e811736979c44b02b14fecb74c6bd7ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675272fb40d4847819f83ec04afecef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129321) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:47:49.899320 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.policy [None req-fcc8c44a-ce67-4a66-9975-68b8b6a8ece5 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e811736979c44b02b14fecb74c6bd7ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675272fb40d4847819f83ec04afecef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129321) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:47:49.900865 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.policy [None req-fcc8c44a-ce67-4a66-9975-68b8b6a8ece5 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e811736979c44b02b14fecb74c6bd7ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675272fb40d4847819f83ec04afecef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129321) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:47:49.902036 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: INFO nova.api.openstack.requestlog [None req-fcc8c44a-ce67-4a66-9975-68b8b6a8ece5 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] 10.222.0.75 "GET /compute/v2.1/servers/f44f180b-9143-43d6-b9cd-ced0c42fd928" status: 200 len: 1725 microversion: 2.20 time: 0.159946 May 26 12:47:49.902677 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: [pid: 129321|app: 0|req: 462/945] 10.222.0.75 () {60 vars in 1276 bytes} [Thu May 26 12:47:49 2022] GET /compute/v2.1/servers/f44f180b-9143-43d6-b9cd-ced0c42fd928 => generated 1725 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 12:47:50.920852 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi [None req-b24fc5d5-c9ac-4dff-8892-a9cffc90ba03 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Calling method '>' {{(pid=129322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:47:50.921452 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.compute.api [None req-b24fc5d5-c9ac-4dff-8892-a9cffc90ba03 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] [instance: f44f180b-9143-43d6-b9cd-ced0c42fd928] Fetching instance by UUID {{(pid=129322) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:47:50.929106 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-b24fc5d5-c9ac-4dff-8892-a9cffc90ba03 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:47:50.929554 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-b24fc5d5-c9ac-4dff-8892-a9cffc90ba03 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:47:50.930331 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-b24fc5d5-c9ac-4dff-8892-a9cffc90ba03 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:47:50.930767 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-b24fc5d5-c9ac-4dff-8892-a9cffc90ba03 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:47:51.071065 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.policy [None req-b24fc5d5-c9ac-4dff-8892-a9cffc90ba03 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e811736979c44b02b14fecb74c6bd7ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675272fb40d4847819f83ec04afecef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129322) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:47:51.079599 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.policy [None req-b24fc5d5-c9ac-4dff-8892-a9cffc90ba03 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e811736979c44b02b14fecb74c6bd7ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675272fb40d4847819f83ec04afecef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129322) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:47:51.081111 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.policy [None req-b24fc5d5-c9ac-4dff-8892-a9cffc90ba03 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e811736979c44b02b14fecb74c6bd7ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675272fb40d4847819f83ec04afecef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129322) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:47:51.082295 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: INFO nova.api.openstack.requestlog [None req-b24fc5d5-c9ac-4dff-8892-a9cffc90ba03 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] 10.222.0.75 "GET /compute/v2.1/servers/f44f180b-9143-43d6-b9cd-ced0c42fd928" status: 200 len: 1725 microversion: 2.20 time: 0.165541 May 26 12:47:51.082908 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: [pid: 129322|app: 0|req: 484/946] 10.222.0.75 () {60 vars in 1276 bytes} [Thu May 26 12:47:50 2022] GET /compute/v2.1/servers/f44f180b-9143-43d6-b9cd-ced0c42fd928 => generated 1725 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 12:47:52.100871 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi [None req-978291a2-14e6-409c-9a76-1c52bfbcb1f3 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Calling method '>' {{(pid=129321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:47:52.101452 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.compute.api [None req-978291a2-14e6-409c-9a76-1c52bfbcb1f3 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] [instance: f44f180b-9143-43d6-b9cd-ced0c42fd928] Fetching instance by UUID {{(pid=129321) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:47:52.108322 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-978291a2-14e6-409c-9a76-1c52bfbcb1f3 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:47:52.108783 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-978291a2-14e6-409c-9a76-1c52bfbcb1f3 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:47:52.109540 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-978291a2-14e6-409c-9a76-1c52bfbcb1f3 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:47:52.109966 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-978291a2-14e6-409c-9a76-1c52bfbcb1f3 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:47:52.243186 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.policy [None req-978291a2-14e6-409c-9a76-1c52bfbcb1f3 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e811736979c44b02b14fecb74c6bd7ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675272fb40d4847819f83ec04afecef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129321) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:47:52.251702 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.policy [None req-978291a2-14e6-409c-9a76-1c52bfbcb1f3 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e811736979c44b02b14fecb74c6bd7ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675272fb40d4847819f83ec04afecef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129321) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:47:52.253226 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.policy [None req-978291a2-14e6-409c-9a76-1c52bfbcb1f3 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e811736979c44b02b14fecb74c6bd7ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675272fb40d4847819f83ec04afecef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129321) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:47:52.254391 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: INFO nova.api.openstack.requestlog [None req-978291a2-14e6-409c-9a76-1c52bfbcb1f3 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] 10.222.0.75 "GET /compute/v2.1/servers/f44f180b-9143-43d6-b9cd-ced0c42fd928" status: 200 len: 1725 microversion: 2.20 time: 0.157916 May 26 12:47:52.255068 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: [pid: 129321|app: 0|req: 463/947] 10.222.0.75 () {60 vars in 1276 bytes} [Thu May 26 12:47:52 2022] GET /compute/v2.1/servers/f44f180b-9143-43d6-b9cd-ced0c42fd928 => generated 1725 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 12:47:53.273785 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi [None req-665944d8-abb9-4e22-ba46-bc2823e4ed84 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Calling method '>' {{(pid=129322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:47:53.274396 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.compute.api [None req-665944d8-abb9-4e22-ba46-bc2823e4ed84 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] [instance: f44f180b-9143-43d6-b9cd-ced0c42fd928] Fetching instance by UUID {{(pid=129322) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:47:53.283054 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-665944d8-abb9-4e22-ba46-bc2823e4ed84 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:47:53.283503 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-665944d8-abb9-4e22-ba46-bc2823e4ed84 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:47:53.284316 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-665944d8-abb9-4e22-ba46-bc2823e4ed84 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:47:53.284751 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-665944d8-abb9-4e22-ba46-bc2823e4ed84 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:47:53.421248 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.policy [None req-665944d8-abb9-4e22-ba46-bc2823e4ed84 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e811736979c44b02b14fecb74c6bd7ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675272fb40d4847819f83ec04afecef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129322) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:47:53.429880 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.policy [None req-665944d8-abb9-4e22-ba46-bc2823e4ed84 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e811736979c44b02b14fecb74c6bd7ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675272fb40d4847819f83ec04afecef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129322) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:47:53.431402 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.policy [None req-665944d8-abb9-4e22-ba46-bc2823e4ed84 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e811736979c44b02b14fecb74c6bd7ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675272fb40d4847819f83ec04afecef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129322) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:47:53.432651 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: INFO nova.api.openstack.requestlog [None req-665944d8-abb9-4e22-ba46-bc2823e4ed84 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] 10.222.0.75 "GET /compute/v2.1/servers/f44f180b-9143-43d6-b9cd-ced0c42fd928" status: 200 len: 1725 microversion: 2.20 time: 0.163237 May 26 12:47:53.433212 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: [pid: 129322|app: 0|req: 485/948] 10.222.0.75 () {60 vars in 1276 bytes} [Thu May 26 12:47:53 2022] GET /compute/v2.1/servers/f44f180b-9143-43d6-b9cd-ced0c42fd928 => generated 1725 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 12:47:54.450974 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi [None req-02a44c58-a5ba-4dc1-82ed-c8cdaf9eb66d tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Calling method '>' {{(pid=129321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:47:54.451595 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.compute.api [None req-02a44c58-a5ba-4dc1-82ed-c8cdaf9eb66d tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] [instance: f44f180b-9143-43d6-b9cd-ced0c42fd928] Fetching instance by UUID {{(pid=129321) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:47:54.458644 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-02a44c58-a5ba-4dc1-82ed-c8cdaf9eb66d tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:47:54.459215 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-02a44c58-a5ba-4dc1-82ed-c8cdaf9eb66d tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:47:54.460197 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-02a44c58-a5ba-4dc1-82ed-c8cdaf9eb66d tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:47:54.460657 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-02a44c58-a5ba-4dc1-82ed-c8cdaf9eb66d tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:47:54.599515 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.policy [None req-02a44c58-a5ba-4dc1-82ed-c8cdaf9eb66d tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e811736979c44b02b14fecb74c6bd7ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675272fb40d4847819f83ec04afecef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129321) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:47:54.607662 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.policy [None req-02a44c58-a5ba-4dc1-82ed-c8cdaf9eb66d tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e811736979c44b02b14fecb74c6bd7ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675272fb40d4847819f83ec04afecef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129321) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:47:54.609143 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.policy [None req-02a44c58-a5ba-4dc1-82ed-c8cdaf9eb66d tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e811736979c44b02b14fecb74c6bd7ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675272fb40d4847819f83ec04afecef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129321) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:47:54.610309 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: INFO nova.api.openstack.requestlog [None req-02a44c58-a5ba-4dc1-82ed-c8cdaf9eb66d tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] 10.222.0.75 "GET /compute/v2.1/servers/f44f180b-9143-43d6-b9cd-ced0c42fd928" status: 200 len: 1725 microversion: 2.20 time: 0.163407 May 26 12:47:54.610878 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: [pid: 129321|app: 0|req: 464/949] 10.222.0.75 () {60 vars in 1276 bytes} [Thu May 26 12:47:54 2022] GET /compute/v2.1/servers/f44f180b-9143-43d6-b9cd-ced0c42fd928 => generated 1725 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 12:47:55.632826 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi [None req-765d4f2f-91c6-4e21-a789-ab956a46a9e6 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Calling method '>' {{(pid=129322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:47:55.633758 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.compute.api [None req-765d4f2f-91c6-4e21-a789-ab956a46a9e6 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] [instance: f44f180b-9143-43d6-b9cd-ced0c42fd928] Fetching instance by UUID {{(pid=129322) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:47:55.645235 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-765d4f2f-91c6-4e21-a789-ab956a46a9e6 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:47:55.645974 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-765d4f2f-91c6-4e21-a789-ab956a46a9e6 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:47:55.647283 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-765d4f2f-91c6-4e21-a789-ab956a46a9e6 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:47:55.648397 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-765d4f2f-91c6-4e21-a789-ab956a46a9e6 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:47:55.794689 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.policy [None req-765d4f2f-91c6-4e21-a789-ab956a46a9e6 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e811736979c44b02b14fecb74c6bd7ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675272fb40d4847819f83ec04afecef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129322) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:47:55.803060 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.policy [None req-765d4f2f-91c6-4e21-a789-ab956a46a9e6 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e811736979c44b02b14fecb74c6bd7ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675272fb40d4847819f83ec04afecef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129322) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:47:55.804600 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.policy [None req-765d4f2f-91c6-4e21-a789-ab956a46a9e6 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e811736979c44b02b14fecb74c6bd7ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675272fb40d4847819f83ec04afecef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129322) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:47:55.805769 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: INFO nova.api.openstack.requestlog [None req-765d4f2f-91c6-4e21-a789-ab956a46a9e6 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] 10.222.0.75 "GET /compute/v2.1/servers/f44f180b-9143-43d6-b9cd-ced0c42fd928" status: 200 len: 1725 microversion: 2.20 time: 0.179555 May 26 12:47:55.806337 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: [pid: 129322|app: 0|req: 486/950] 10.222.0.75 () {60 vars in 1276 bytes} [Thu May 26 12:47:55 2022] GET /compute/v2.1/servers/f44f180b-9143-43d6-b9cd-ced0c42fd928 => generated 1725 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 12:47:56.824813 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi [None req-0e7fc188-a0d4-4e82-83bb-3e759252cc37 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Calling method '>' {{(pid=129321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:47:56.825380 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.compute.api [None req-0e7fc188-a0d4-4e82-83bb-3e759252cc37 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] [instance: f44f180b-9143-43d6-b9cd-ced0c42fd928] Fetching instance by UUID {{(pid=129321) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:47:56.832463 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-0e7fc188-a0d4-4e82-83bb-3e759252cc37 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:47:56.832907 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-0e7fc188-a0d4-4e82-83bb-3e759252cc37 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:47:56.833661 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-0e7fc188-a0d4-4e82-83bb-3e759252cc37 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:47:56.834084 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-0e7fc188-a0d4-4e82-83bb-3e759252cc37 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:47:56.970281 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.policy [None req-0e7fc188-a0d4-4e82-83bb-3e759252cc37 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e811736979c44b02b14fecb74c6bd7ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675272fb40d4847819f83ec04afecef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129321) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:47:56.979074 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.policy [None req-0e7fc188-a0d4-4e82-83bb-3e759252cc37 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e811736979c44b02b14fecb74c6bd7ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675272fb40d4847819f83ec04afecef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129321) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:47:56.980765 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.policy [None req-0e7fc188-a0d4-4e82-83bb-3e759252cc37 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e811736979c44b02b14fecb74c6bd7ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675272fb40d4847819f83ec04afecef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129321) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:47:56.981931 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: INFO nova.api.openstack.requestlog [None req-0e7fc188-a0d4-4e82-83bb-3e759252cc37 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] 10.222.0.75 "GET /compute/v2.1/servers/f44f180b-9143-43d6-b9cd-ced0c42fd928" status: 200 len: 1725 microversion: 2.20 time: 0.161391 May 26 12:47:56.982506 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: [pid: 129321|app: 0|req: 465/951] 10.222.0.75 () {60 vars in 1276 bytes} [Thu May 26 12:47:56 2022] GET /compute/v2.1/servers/f44f180b-9143-43d6-b9cd-ced0c42fd928 => generated 1725 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 12:47:58.000928 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi [None req-a594190d-47c7-46ba-b200-90d2a561acf4 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Calling method '>' {{(pid=129322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:47:58.001626 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.compute.api [None req-a594190d-47c7-46ba-b200-90d2a561acf4 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] [instance: f44f180b-9143-43d6-b9cd-ced0c42fd928] Fetching instance by UUID {{(pid=129322) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:47:58.008669 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-a594190d-47c7-46ba-b200-90d2a561acf4 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:47:58.009120 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-a594190d-47c7-46ba-b200-90d2a561acf4 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:47:58.009887 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-a594190d-47c7-46ba-b200-90d2a561acf4 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:47:58.010323 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-a594190d-47c7-46ba-b200-90d2a561acf4 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:47:58.144904 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.policy [None req-a594190d-47c7-46ba-b200-90d2a561acf4 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e811736979c44b02b14fecb74c6bd7ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675272fb40d4847819f83ec04afecef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129322) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:47:58.153626 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.policy [None req-a594190d-47c7-46ba-b200-90d2a561acf4 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e811736979c44b02b14fecb74c6bd7ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675272fb40d4847819f83ec04afecef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129322) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:47:58.155103 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.policy [None req-a594190d-47c7-46ba-b200-90d2a561acf4 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e811736979c44b02b14fecb74c6bd7ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675272fb40d4847819f83ec04afecef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129322) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:47:58.156295 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: INFO nova.api.openstack.requestlog [None req-a594190d-47c7-46ba-b200-90d2a561acf4 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] 10.222.0.75 "GET /compute/v2.1/servers/f44f180b-9143-43d6-b9cd-ced0c42fd928" status: 200 len: 1725 microversion: 2.20 time: 0.159397 May 26 12:47:58.156866 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: [pid: 129322|app: 0|req: 487/952] 10.222.0.75 () {60 vars in 1276 bytes} [Thu May 26 12:47:57 2022] GET /compute/v2.1/servers/f44f180b-9143-43d6-b9cd-ced0c42fd928 => generated 1725 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 12:47:59.176149 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi [None req-cb5bd97a-1bc5-47a8-b78a-489d829937fc tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Calling method '>' {{(pid=129321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:47:59.176845 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.compute.api [None req-cb5bd97a-1bc5-47a8-b78a-489d829937fc tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] [instance: f44f180b-9143-43d6-b9cd-ced0c42fd928] Fetching instance by UUID {{(pid=129321) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:47:59.184215 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-cb5bd97a-1bc5-47a8-b78a-489d829937fc tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:47:59.184649 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-cb5bd97a-1bc5-47a8-b78a-489d829937fc tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:47:59.185410 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-cb5bd97a-1bc5-47a8-b78a-489d829937fc tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:47:59.185832 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-cb5bd97a-1bc5-47a8-b78a-489d829937fc tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:47:59.328350 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.policy [None req-cb5bd97a-1bc5-47a8-b78a-489d829937fc tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e811736979c44b02b14fecb74c6bd7ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675272fb40d4847819f83ec04afecef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129321) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:47:59.338959 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.policy [None req-cb5bd97a-1bc5-47a8-b78a-489d829937fc tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e811736979c44b02b14fecb74c6bd7ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675272fb40d4847819f83ec04afecef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129321) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:47:59.340607 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.policy [None req-cb5bd97a-1bc5-47a8-b78a-489d829937fc tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e811736979c44b02b14fecb74c6bd7ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675272fb40d4847819f83ec04afecef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129321) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:47:59.341778 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: INFO nova.api.openstack.requestlog [None req-cb5bd97a-1bc5-47a8-b78a-489d829937fc tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] 10.222.0.75 "GET /compute/v2.1/servers/f44f180b-9143-43d6-b9cd-ced0c42fd928" status: 200 len: 1746 microversion: 2.20 time: 0.170838 May 26 12:47:59.342345 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: [pid: 129321|app: 0|req: 466/953] 10.222.0.75 () {60 vars in 1276 bytes} [Thu May 26 12:47:59 2022] GET /compute/v2.1/servers/f44f180b-9143-43d6-b9cd-ced0c42fd928 => generated 1746 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 12:48:00.363889 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi [None req-b554776a-2cc6-46eb-af56-f181ae4ca3ba tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Calling method '>' {{(pid=129322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:48:00.364494 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.compute.api [None req-b554776a-2cc6-46eb-af56-f181ae4ca3ba tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] [instance: f44f180b-9143-43d6-b9cd-ced0c42fd928] Fetching instance by UUID {{(pid=129322) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:48:00.371411 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-b554776a-2cc6-46eb-af56-f181ae4ca3ba tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:48:00.371890 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-b554776a-2cc6-46eb-af56-f181ae4ca3ba tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:48:00.380582 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-b554776a-2cc6-46eb-af56-f181ae4ca3ba tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:48:00.380582 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-b554776a-2cc6-46eb-af56-f181ae4ca3ba tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:48:00.524346 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.policy [None req-b554776a-2cc6-46eb-af56-f181ae4ca3ba tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e811736979c44b02b14fecb74c6bd7ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675272fb40d4847819f83ec04afecef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129322) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:48:00.532982 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.policy [None req-b554776a-2cc6-46eb-af56-f181ae4ca3ba tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e811736979c44b02b14fecb74c6bd7ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675272fb40d4847819f83ec04afecef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129322) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:48:00.534479 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.policy [None req-b554776a-2cc6-46eb-af56-f181ae4ca3ba tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e811736979c44b02b14fecb74c6bd7ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675272fb40d4847819f83ec04afecef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129322) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:48:00.535688 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: INFO nova.api.openstack.requestlog [None req-b554776a-2cc6-46eb-af56-f181ae4ca3ba tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] 10.222.0.75 "GET /compute/v2.1/servers/f44f180b-9143-43d6-b9cd-ced0c42fd928" status: 200 len: 1746 microversion: 2.20 time: 0.175963 May 26 12:48:00.536235 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: [pid: 129322|app: 0|req: 488/954] 10.222.0.75 () {60 vars in 1276 bytes} [Thu May 26 12:48:00 2022] GET /compute/v2.1/servers/f44f180b-9143-43d6-b9cd-ced0c42fd928 => generated 1746 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 12:48:01.558878 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi [None req-6c49dc25-4b7c-44db-a586-f2eda7083ca5 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Calling method '>' {{(pid=129321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:48:01.559515 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.compute.api [None req-6c49dc25-4b7c-44db-a586-f2eda7083ca5 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] [instance: f44f180b-9143-43d6-b9cd-ced0c42fd928] Fetching instance by UUID {{(pid=129321) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:48:01.566810 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-6c49dc25-4b7c-44db-a586-f2eda7083ca5 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:48:01.567273 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-6c49dc25-4b7c-44db-a586-f2eda7083ca5 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:48:01.568148 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-6c49dc25-4b7c-44db-a586-f2eda7083ca5 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:48:01.568553 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-6c49dc25-4b7c-44db-a586-f2eda7083ca5 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:48:01.721115 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.policy [None req-6c49dc25-4b7c-44db-a586-f2eda7083ca5 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e811736979c44b02b14fecb74c6bd7ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675272fb40d4847819f83ec04afecef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129321) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:48:01.729776 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.policy [None req-6c49dc25-4b7c-44db-a586-f2eda7083ca5 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e811736979c44b02b14fecb74c6bd7ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675272fb40d4847819f83ec04afecef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129321) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:48:01.731363 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.policy [None req-6c49dc25-4b7c-44db-a586-f2eda7083ca5 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e811736979c44b02b14fecb74c6bd7ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675272fb40d4847819f83ec04afecef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129321) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:48:01.732912 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: INFO nova.api.openstack.requestlog [None req-6c49dc25-4b7c-44db-a586-f2eda7083ca5 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] 10.222.0.75 "GET /compute/v2.1/servers/f44f180b-9143-43d6-b9cd-ced0c42fd928" status: 200 len: 1746 microversion: 2.20 time: 0.179043 May 26 12:48:01.733606 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: [pid: 129321|app: 0|req: 467/955] 10.222.0.75 () {60 vars in 1276 bytes} [Thu May 26 12:48:01 2022] GET /compute/v2.1/servers/f44f180b-9143-43d6-b9cd-ced0c42fd928 => generated 1746 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 12:48:02.752981 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi [None req-852e3afc-2549-4446-b57c-e229d2f11b68 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Calling method '>' {{(pid=129322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:48:02.753797 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.compute.api [None req-852e3afc-2549-4446-b57c-e229d2f11b68 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] [instance: f44f180b-9143-43d6-b9cd-ced0c42fd928] Fetching instance by UUID {{(pid=129322) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:48:02.756222 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG dbcounter [-] [129322] Writing DB stats nova_api:SELECT=44,nova_api:INSERT=3 {{(pid=129322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:48:02.763443 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-852e3afc-2549-4446-b57c-e229d2f11b68 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:48:02.763946 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-852e3afc-2549-4446-b57c-e229d2f11b68 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:48:02.764750 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-852e3afc-2549-4446-b57c-e229d2f11b68 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:48:02.765246 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-852e3afc-2549-4446-b57c-e229d2f11b68 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:48:02.768631 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG dbcounter [-] [129322] Writing DB stats nova_cell1:SELECT=86,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=129322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:48:02.913873 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.policy [None req-852e3afc-2549-4446-b57c-e229d2f11b68 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e811736979c44b02b14fecb74c6bd7ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675272fb40d4847819f83ec04afecef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129322) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:48:02.923179 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.policy [None req-852e3afc-2549-4446-b57c-e229d2f11b68 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e811736979c44b02b14fecb74c6bd7ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675272fb40d4847819f83ec04afecef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129322) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:48:02.924729 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.policy [None req-852e3afc-2549-4446-b57c-e229d2f11b68 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e811736979c44b02b14fecb74c6bd7ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675272fb40d4847819f83ec04afecef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129322) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:48:02.926238 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: INFO nova.api.openstack.requestlog [None req-852e3afc-2549-4446-b57c-e229d2f11b68 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] 10.222.0.75 "GET /compute/v2.1/servers/f44f180b-9143-43d6-b9cd-ced0c42fd928" status: 200 len: 1746 microversion: 2.20 time: 0.177216 May 26 12:48:02.927037 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: [pid: 129322|app: 0|req: 489/956] 10.222.0.75 () {60 vars in 1276 bytes} [Thu May 26 12:48:02 2022] GET /compute/v2.1/servers/f44f180b-9143-43d6-b9cd-ced0c42fd928 => generated 1746 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 12:48:03.347009 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi [req-1081956e-fc50-4f55-8557-2e7fb76961c3 req-6ac2ec2f-f1eb-4cb1-9c6c-989779a99bf6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f44f180b-9143-43d6-b9cd-ced0c42fd928", "name": "network-vif-plugged", "status": "completed", "tag": "f9559056-2d17-4245-b9b6-e29db32c9ee2"}]} {{(pid=129321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 12:48:03.358921 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [req-1081956e-fc50-4f55-8557-2e7fb76961c3 req-6ac2ec2f-f1eb-4cb1-9c6c-989779a99bf6 service nova] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:48:03.359506 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [req-1081956e-fc50-4f55-8557-2e7fb76961c3 req-6ac2ec2f-f1eb-4cb1-9c6c-989779a99bf6 service nova] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:48:03.373087 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: INFO nova.api.openstack.compute.server_external_events [req-1081956e-fc50-4f55-8557-2e7fb76961c3 req-6ac2ec2f-f1eb-4cb1-9c6c-989779a99bf6 service nova] Creating event network-vif-plugged:f9559056-2d17-4245-b9b6-e29db32c9ee2 for instance f44f180b-9143-43d6-b9cd-ced0c42fd928 on hv-cinder-81966 May 26 12:48:03.379483 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: INFO nova.api.openstack.requestlog [req-1081956e-fc50-4f55-8557-2e7fb76961c3 req-6ac2ec2f-f1eb-4cb1-9c6c-989779a99bf6 service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036652 May 26 12:48:03.380133 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: [pid: 129321|app: 0|req: 468/957] 10.222.0.75 () {64 vars in 1317 bytes} [Thu May 26 12:48:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 12:48:03.952280 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi [None req-852834f7-0df0-4748-9327-d296ce21151a tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Calling method '>' {{(pid=129322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:48:03.952928 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.compute.api [None req-852834f7-0df0-4748-9327-d296ce21151a tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] [instance: f44f180b-9143-43d6-b9cd-ced0c42fd928] Fetching instance by UUID {{(pid=129322) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:48:03.960109 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-852834f7-0df0-4748-9327-d296ce21151a tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:48:03.960552 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-852834f7-0df0-4748-9327-d296ce21151a tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:48:03.961312 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-852834f7-0df0-4748-9327-d296ce21151a tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:48:03.961742 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-852834f7-0df0-4748-9327-d296ce21151a tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:48:04.210661 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.policy [None req-852834f7-0df0-4748-9327-d296ce21151a tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e811736979c44b02b14fecb74c6bd7ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675272fb40d4847819f83ec04afecef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129322) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:48:04.219287 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.policy [None req-852834f7-0df0-4748-9327-d296ce21151a tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e811736979c44b02b14fecb74c6bd7ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675272fb40d4847819f83ec04afecef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129322) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:48:04.220826 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.policy [None req-852834f7-0df0-4748-9327-d296ce21151a tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e811736979c44b02b14fecb74c6bd7ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675272fb40d4847819f83ec04afecef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129322) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:48:04.221996 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: INFO nova.api.openstack.requestlog [None req-852834f7-0df0-4748-9327-d296ce21151a tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] 10.222.0.75 "GET /compute/v2.1/servers/f44f180b-9143-43d6-b9cd-ced0c42fd928" status: 200 len: 1746 microversion: 2.20 time: 0.274931 May 26 12:48:04.222560 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: [pid: 129322|app: 0|req: 490/958] 10.222.0.75 () {60 vars in 1276 bytes} [Thu May 26 12:48:03 2022] GET /compute/v2.1/servers/f44f180b-9143-43d6-b9cd-ced0c42fd928 => generated 1746 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 26 12:48:05.245614 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi [None req-b8225fc2-1534-4901-b75a-f39e158bb0a7 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Calling method '>' {{(pid=129321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:48:05.247217 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.compute.api [None req-b8225fc2-1534-4901-b75a-f39e158bb0a7 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] [instance: f44f180b-9143-43d6-b9cd-ced0c42fd928] Fetching instance by UUID {{(pid=129321) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:48:05.257379 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-b8225fc2-1534-4901-b75a-f39e158bb0a7 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:48:05.257998 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-b8225fc2-1534-4901-b75a-f39e158bb0a7 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:48:05.258890 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-b8225fc2-1534-4901-b75a-f39e158bb0a7 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:48:05.259326 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-b8225fc2-1534-4901-b75a-f39e158bb0a7 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:48:05.262948 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG dbcounter [-] [129321] Writing DB stats nova_cell1:SELECT=81 {{(pid=129321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:48:05.562786 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.policy [None req-b8225fc2-1534-4901-b75a-f39e158bb0a7 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e811736979c44b02b14fecb74c6bd7ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675272fb40d4847819f83ec04afecef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129321) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:48:05.577447 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.policy [None req-b8225fc2-1534-4901-b75a-f39e158bb0a7 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e811736979c44b02b14fecb74c6bd7ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675272fb40d4847819f83ec04afecef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129321) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:48:05.580644 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.policy [None req-b8225fc2-1534-4901-b75a-f39e158bb0a7 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e811736979c44b02b14fecb74c6bd7ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675272fb40d4847819f83ec04afecef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129321) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:48:05.582653 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: INFO nova.api.openstack.requestlog [None req-b8225fc2-1534-4901-b75a-f39e158bb0a7 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] 10.222.0.75 "GET /compute/v2.1/servers/f44f180b-9143-43d6-b9cd-ced0c42fd928" status: 200 len: 1741 microversion: 2.20 time: 0.344947 May 26 12:48:05.583361 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: [pid: 129321|app: 0|req: 469/959] 10.222.0.75 () {60 vars in 1276 bytes} [Thu May 26 12:48:05 2022] GET /compute/v2.1/servers/f44f180b-9143-43d6-b9cd-ced0c42fd928 => generated 1741 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 12:48:06.603984 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi [None req-aef7d0ad-1327-406c-b44c-9410b9cf041c tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Calling method '>' {{(pid=129322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:48:06.605278 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.compute.api [None req-aef7d0ad-1327-406c-b44c-9410b9cf041c tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] [instance: f44f180b-9143-43d6-b9cd-ced0c42fd928] Fetching instance by UUID {{(pid=129322) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:48:06.623724 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-aef7d0ad-1327-406c-b44c-9410b9cf041c tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:48:06.624183 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-aef7d0ad-1327-406c-b44c-9410b9cf041c tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:48:06.624989 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-aef7d0ad-1327-406c-b44c-9410b9cf041c tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:48:06.625411 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-aef7d0ad-1327-406c-b44c-9410b9cf041c tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:48:06.856331 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.policy [None req-aef7d0ad-1327-406c-b44c-9410b9cf041c tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e811736979c44b02b14fecb74c6bd7ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675272fb40d4847819f83ec04afecef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129322) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:48:06.867719 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.policy [None req-aef7d0ad-1327-406c-b44c-9410b9cf041c tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e811736979c44b02b14fecb74c6bd7ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675272fb40d4847819f83ec04afecef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129322) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:48:06.869767 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.policy [None req-aef7d0ad-1327-406c-b44c-9410b9cf041c tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e811736979c44b02b14fecb74c6bd7ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675272fb40d4847819f83ec04afecef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129322) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:48:06.871667 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: INFO nova.api.openstack.requestlog [None req-aef7d0ad-1327-406c-b44c-9410b9cf041c tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] 10.222.0.75 "GET /compute/v2.1/servers/f44f180b-9143-43d6-b9cd-ced0c42fd928" status: 200 len: 1741 microversion: 2.20 time: 0.272050 May 26 12:48:06.872777 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: [pid: 129322|app: 0|req: 491/960] 10.222.0.75 () {60 vars in 1276 bytes} [Thu May 26 12:48:06 2022] GET /compute/v2.1/servers/f44f180b-9143-43d6-b9cd-ced0c42fd928 => generated 1741 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 12:48:07.892350 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi [None req-ce7668ff-03bf-42cb-b3cc-5d9cdf2097e4 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Calling method '>' {{(pid=129321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:48:07.893902 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.compute.api [None req-ce7668ff-03bf-42cb-b3cc-5d9cdf2097e4 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] [instance: f44f180b-9143-43d6-b9cd-ced0c42fd928] Fetching instance by UUID {{(pid=129321) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:48:07.902587 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-ce7668ff-03bf-42cb-b3cc-5d9cdf2097e4 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:48:07.903131 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-ce7668ff-03bf-42cb-b3cc-5d9cdf2097e4 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:48:07.904340 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-ce7668ff-03bf-42cb-b3cc-5d9cdf2097e4 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:48:07.904999 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-ce7668ff-03bf-42cb-b3cc-5d9cdf2097e4 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:48:08.051883 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.policy [None req-ce7668ff-03bf-42cb-b3cc-5d9cdf2097e4 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e811736979c44b02b14fecb74c6bd7ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675272fb40d4847819f83ec04afecef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129321) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:48:08.060934 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.policy [None req-ce7668ff-03bf-42cb-b3cc-5d9cdf2097e4 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e811736979c44b02b14fecb74c6bd7ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675272fb40d4847819f83ec04afecef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129321) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:48:08.062592 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.policy [None req-ce7668ff-03bf-42cb-b3cc-5d9cdf2097e4 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e811736979c44b02b14fecb74c6bd7ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675272fb40d4847819f83ec04afecef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129321) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:48:08.063935 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: INFO nova.api.openstack.requestlog [None req-ce7668ff-03bf-42cb-b3cc-5d9cdf2097e4 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] 10.222.0.75 "GET /compute/v2.1/servers/f44f180b-9143-43d6-b9cd-ced0c42fd928" status: 200 len: 1741 microversion: 2.20 time: 0.175515 May 26 12:48:08.064377 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: [pid: 129321|app: 0|req: 470/961] 10.222.0.75 () {60 vars in 1276 bytes} [Thu May 26 12:48:07 2022] GET /compute/v2.1/servers/f44f180b-9143-43d6-b9cd-ced0c42fd928 => generated 1741 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 12:48:09.082634 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi [None req-63ea7e7b-5137-430d-8dd4-6a1f15f64afc tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Calling method '>' {{(pid=129322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:48:09.083261 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.compute.api [None req-63ea7e7b-5137-430d-8dd4-6a1f15f64afc tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] [instance: f44f180b-9143-43d6-b9cd-ced0c42fd928] Fetching instance by UUID {{(pid=129322) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:48:09.091575 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-63ea7e7b-5137-430d-8dd4-6a1f15f64afc tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:48:09.092106 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-63ea7e7b-5137-430d-8dd4-6a1f15f64afc tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:48:09.092902 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-63ea7e7b-5137-430d-8dd4-6a1f15f64afc tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:48:09.093341 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-63ea7e7b-5137-430d-8dd4-6a1f15f64afc tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:48:09.248398 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.policy [None req-63ea7e7b-5137-430d-8dd4-6a1f15f64afc tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e811736979c44b02b14fecb74c6bd7ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675272fb40d4847819f83ec04afecef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129322) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:48:09.258107 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.policy [None req-63ea7e7b-5137-430d-8dd4-6a1f15f64afc tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e811736979c44b02b14fecb74c6bd7ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675272fb40d4847819f83ec04afecef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129322) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:48:09.259563 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.policy [None req-63ea7e7b-5137-430d-8dd4-6a1f15f64afc tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e811736979c44b02b14fecb74c6bd7ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675272fb40d4847819f83ec04afecef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129322) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:48:09.260886 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: INFO nova.api.openstack.requestlog [None req-63ea7e7b-5137-430d-8dd4-6a1f15f64afc tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] 10.222.0.75 "GET /compute/v2.1/servers/f44f180b-9143-43d6-b9cd-ced0c42fd928" status: 200 len: 1741 microversion: 2.20 time: 0.182504 May 26 12:48:09.261455 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: [pid: 129322|app: 0|req: 492/962] 10.222.0.75 () {60 vars in 1276 bytes} [Thu May 26 12:48:09 2022] GET /compute/v2.1/servers/f44f180b-9143-43d6-b9cd-ced0c42fd928 => generated 1741 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 12:48:10.280414 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi [None req-99fa2624-683a-4950-8ad7-8241335cfef1 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Calling method '>' {{(pid=129321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:48:10.282013 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.compute.api [None req-99fa2624-683a-4950-8ad7-8241335cfef1 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] [instance: f44f180b-9143-43d6-b9cd-ced0c42fd928] Fetching instance by UUID {{(pid=129321) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:48:10.284401 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG dbcounter [-] [129321] Writing DB stats nova_api:SELECT=30 {{(pid=129321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:48:10.291121 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-99fa2624-683a-4950-8ad7-8241335cfef1 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:48:10.291884 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-99fa2624-683a-4950-8ad7-8241335cfef1 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:48:10.292681 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-99fa2624-683a-4950-8ad7-8241335cfef1 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:48:10.293102 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-99fa2624-683a-4950-8ad7-8241335cfef1 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:48:10.441911 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.policy [None req-99fa2624-683a-4950-8ad7-8241335cfef1 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e811736979c44b02b14fecb74c6bd7ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675272fb40d4847819f83ec04afecef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129321) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:48:10.456866 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.policy [None req-99fa2624-683a-4950-8ad7-8241335cfef1 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e811736979c44b02b14fecb74c6bd7ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675272fb40d4847819f83ec04afecef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129321) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:48:10.463162 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.policy [None req-99fa2624-683a-4950-8ad7-8241335cfef1 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e811736979c44b02b14fecb74c6bd7ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675272fb40d4847819f83ec04afecef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129321) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:48:10.464846 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: INFO nova.api.openstack.requestlog [None req-99fa2624-683a-4950-8ad7-8241335cfef1 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] 10.222.0.75 "GET /compute/v2.1/servers/f44f180b-9143-43d6-b9cd-ced0c42fd928" status: 200 len: 1741 microversion: 2.20 time: 0.189660 May 26 12:48:10.465441 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: [pid: 129321|app: 0|req: 471/963] 10.222.0.75 () {60 vars in 1276 bytes} [Thu May 26 12:48:10 2022] GET /compute/v2.1/servers/f44f180b-9143-43d6-b9cd-ced0c42fd928 => generated 1741 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 12:48:11.655390 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi [None req-521eb0c0-922e-453e-bffa-3600550c31f2 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Calling method '>' {{(pid=129322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:48:11.656060 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.compute.api [None req-521eb0c0-922e-453e-bffa-3600550c31f2 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] [instance: f44f180b-9143-43d6-b9cd-ced0c42fd928] Fetching instance by UUID {{(pid=129322) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:48:11.663876 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-521eb0c0-922e-453e-bffa-3600550c31f2 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:48:11.664542 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-521eb0c0-922e-453e-bffa-3600550c31f2 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:48:11.666668 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-521eb0c0-922e-453e-bffa-3600550c31f2 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:48:11.668817 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-521eb0c0-922e-453e-bffa-3600550c31f2 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:48:11.861428 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.policy [None req-521eb0c0-922e-453e-bffa-3600550c31f2 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e811736979c44b02b14fecb74c6bd7ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675272fb40d4847819f83ec04afecef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129322) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:48:11.870995 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.policy [None req-521eb0c0-922e-453e-bffa-3600550c31f2 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e811736979c44b02b14fecb74c6bd7ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675272fb40d4847819f83ec04afecef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129322) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:48:11.872735 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.policy [None req-521eb0c0-922e-453e-bffa-3600550c31f2 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e811736979c44b02b14fecb74c6bd7ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675272fb40d4847819f83ec04afecef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129322) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:48:11.873993 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: INFO nova.api.openstack.requestlog [None req-521eb0c0-922e-453e-bffa-3600550c31f2 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] 10.222.0.75 "GET /compute/v2.1/servers/f44f180b-9143-43d6-b9cd-ced0c42fd928" status: 200 len: 1741 microversion: 2.20 time: 0.390952 May 26 12:48:11.874810 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: [pid: 129322|app: 0|req: 493/964] 10.222.0.75 () {60 vars in 1276 bytes} [Thu May 26 12:48:11 2022] GET /compute/v2.1/servers/f44f180b-9143-43d6-b9cd-ced0c42fd928 => generated 1741 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 12:48:12.893639 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi [None req-38fb9e39-7685-4ceb-93e9-fd3e60670107 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Calling method '>' {{(pid=129321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:48:12.894256 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.compute.api [None req-38fb9e39-7685-4ceb-93e9-fd3e60670107 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] [instance: f44f180b-9143-43d6-b9cd-ced0c42fd928] Fetching instance by UUID {{(pid=129321) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:48:12.903845 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-38fb9e39-7685-4ceb-93e9-fd3e60670107 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:48:12.904405 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-38fb9e39-7685-4ceb-93e9-fd3e60670107 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:48:12.905278 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-38fb9e39-7685-4ceb-93e9-fd3e60670107 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:48:12.905783 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-38fb9e39-7685-4ceb-93e9-fd3e60670107 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:48:13.081937 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.policy [None req-38fb9e39-7685-4ceb-93e9-fd3e60670107 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e811736979c44b02b14fecb74c6bd7ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675272fb40d4847819f83ec04afecef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129321) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:48:13.091347 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.policy [None req-38fb9e39-7685-4ceb-93e9-fd3e60670107 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e811736979c44b02b14fecb74c6bd7ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675272fb40d4847819f83ec04afecef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129321) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:48:13.092999 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.policy [None req-38fb9e39-7685-4ceb-93e9-fd3e60670107 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e811736979c44b02b14fecb74c6bd7ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675272fb40d4847819f83ec04afecef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129321) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:48:13.094262 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: INFO nova.api.openstack.requestlog [None req-38fb9e39-7685-4ceb-93e9-fd3e60670107 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] 10.222.0.75 "GET /compute/v2.1/servers/f44f180b-9143-43d6-b9cd-ced0c42fd928" status: 200 len: 1741 microversion: 2.20 time: 0.205314 May 26 12:48:13.094841 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: [pid: 129321|app: 0|req: 472/965] 10.222.0.75 () {60 vars in 1276 bytes} [Thu May 26 12:48:12 2022] GET /compute/v2.1/servers/f44f180b-9143-43d6-b9cd-ced0c42fd928 => generated 1741 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 12:48:14.113833 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi [None req-df0bdd46-5665-46be-80fe-c9837dc0db73 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Calling method '>' {{(pid=129322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:48:14.115159 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.compute.api [None req-df0bdd46-5665-46be-80fe-c9837dc0db73 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] [instance: f44f180b-9143-43d6-b9cd-ced0c42fd928] Fetching instance by UUID {{(pid=129322) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:48:14.122466 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-df0bdd46-5665-46be-80fe-c9837dc0db73 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:48:14.122909 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-df0bdd46-5665-46be-80fe-c9837dc0db73 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:48:14.123706 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-df0bdd46-5665-46be-80fe-c9837dc0db73 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:48:14.124142 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-df0bdd46-5665-46be-80fe-c9837dc0db73 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:48:14.276370 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.policy [None req-df0bdd46-5665-46be-80fe-c9837dc0db73 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e811736979c44b02b14fecb74c6bd7ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675272fb40d4847819f83ec04afecef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129322) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:48:14.284855 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.policy [None req-df0bdd46-5665-46be-80fe-c9837dc0db73 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e811736979c44b02b14fecb74c6bd7ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675272fb40d4847819f83ec04afecef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129322) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:48:14.286345 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.policy [None req-df0bdd46-5665-46be-80fe-c9837dc0db73 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e811736979c44b02b14fecb74c6bd7ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675272fb40d4847819f83ec04afecef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129322) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:48:14.287776 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: INFO nova.api.openstack.requestlog [None req-df0bdd46-5665-46be-80fe-c9837dc0db73 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] 10.222.0.75 "GET /compute/v2.1/servers/f44f180b-9143-43d6-b9cd-ced0c42fd928" status: 200 len: 1741 microversion: 2.20 time: 0.177879 May 26 12:48:14.288344 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: [pid: 129322|app: 0|req: 494/966] 10.222.0.75 () {60 vars in 1276 bytes} [Thu May 26 12:48:14 2022] GET /compute/v2.1/servers/f44f180b-9143-43d6-b9cd-ced0c42fd928 => generated 1741 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 12:48:15.307250 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi [None req-e8f47d3b-3851-4a2b-83bb-cd9f408bbbc1 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Calling method '>' {{(pid=129321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:48:15.308210 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.compute.api [None req-e8f47d3b-3851-4a2b-83bb-cd9f408bbbc1 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] [instance: f44f180b-9143-43d6-b9cd-ced0c42fd928] Fetching instance by UUID {{(pid=129321) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:48:15.315051 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-e8f47d3b-3851-4a2b-83bb-cd9f408bbbc1 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:48:15.315525 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-e8f47d3b-3851-4a2b-83bb-cd9f408bbbc1 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:48:15.316967 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-e8f47d3b-3851-4a2b-83bb-cd9f408bbbc1 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:48:15.317197 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-e8f47d3b-3851-4a2b-83bb-cd9f408bbbc1 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:48:15.530067 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.policy [None req-e8f47d3b-3851-4a2b-83bb-cd9f408bbbc1 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e811736979c44b02b14fecb74c6bd7ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675272fb40d4847819f83ec04afecef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129321) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:48:15.540067 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.policy [None req-e8f47d3b-3851-4a2b-83bb-cd9f408bbbc1 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e811736979c44b02b14fecb74c6bd7ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675272fb40d4847819f83ec04afecef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129321) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:48:15.541735 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.policy [None req-e8f47d3b-3851-4a2b-83bb-cd9f408bbbc1 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e811736979c44b02b14fecb74c6bd7ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675272fb40d4847819f83ec04afecef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129321) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:48:15.542913 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: INFO nova.api.openstack.requestlog [None req-e8f47d3b-3851-4a2b-83bb-cd9f408bbbc1 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] 10.222.0.75 "GET /compute/v2.1/servers/f44f180b-9143-43d6-b9cd-ced0c42fd928" status: 200 len: 1723 microversion: 2.20 time: 0.240747 May 26 12:48:15.543645 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: [pid: 129321|app: 0|req: 473/967] 10.222.0.75 () {60 vars in 1276 bytes} [Thu May 26 12:48:15 2022] GET /compute/v2.1/servers/f44f180b-9143-43d6-b9cd-ced0c42fd928 => generated 1723 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 12:48:16.562770 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi [None req-11241fea-4d1c-4b6b-8e86-b21fc5f63f63 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Calling method '>' {{(pid=129322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:48:16.563368 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.compute.api [None req-11241fea-4d1c-4b6b-8e86-b21fc5f63f63 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] [instance: f44f180b-9143-43d6-b9cd-ced0c42fd928] Fetching instance by UUID {{(pid=129322) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:48:16.572055 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-11241fea-4d1c-4b6b-8e86-b21fc5f63f63 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:48:16.572609 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-11241fea-4d1c-4b6b-8e86-b21fc5f63f63 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:48:16.573511 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-11241fea-4d1c-4b6b-8e86-b21fc5f63f63 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:48:16.573951 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-11241fea-4d1c-4b6b-8e86-b21fc5f63f63 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:48:16.725023 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.policy [None req-11241fea-4d1c-4b6b-8e86-b21fc5f63f63 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e811736979c44b02b14fecb74c6bd7ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675272fb40d4847819f83ec04afecef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129322) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:48:16.734303 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.policy [None req-11241fea-4d1c-4b6b-8e86-b21fc5f63f63 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e811736979c44b02b14fecb74c6bd7ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675272fb40d4847819f83ec04afecef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129322) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:48:16.735909 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.policy [None req-11241fea-4d1c-4b6b-8e86-b21fc5f63f63 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e811736979c44b02b14fecb74c6bd7ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675272fb40d4847819f83ec04afecef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129322) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:48:16.737219 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: INFO nova.api.openstack.requestlog [None req-11241fea-4d1c-4b6b-8e86-b21fc5f63f63 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] 10.222.0.75 "GET /compute/v2.1/servers/f44f180b-9143-43d6-b9cd-ced0c42fd928" status: 200 len: 1723 microversion: 2.20 time: 0.179005 May 26 12:48:16.737856 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: [pid: 129322|app: 0|req: 495/968] 10.222.0.75 () {60 vars in 1276 bytes} [Thu May 26 12:48:16 2022] GET /compute/v2.1/servers/f44f180b-9143-43d6-b9cd-ced0c42fd928 => generated 1723 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 12:48:17.398360 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi [req-970dc8c3-a40d-47a0-b6c1-faa8ba094052 req-db4426ec-098b-4d92-9f67-5c61156c5324 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f44f180b-9143-43d6-b9cd-ced0c42fd928", "name": "network-vif-unplugged", "status": "completed", "tag": "f9559056-2d17-4245-b9b6-e29db32c9ee2"}]} {{(pid=129321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 12:48:17.412065 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [req-970dc8c3-a40d-47a0-b6c1-faa8ba094052 req-db4426ec-098b-4d92-9f67-5c61156c5324 service nova] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:48:17.412732 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [req-970dc8c3-a40d-47a0-b6c1-faa8ba094052 req-db4426ec-098b-4d92-9f67-5c61156c5324 service nova] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:48:17.428887 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: INFO nova.api.openstack.compute.server_external_events [req-970dc8c3-a40d-47a0-b6c1-faa8ba094052 req-db4426ec-098b-4d92-9f67-5c61156c5324 service nova] Creating event network-vif-unplugged:f9559056-2d17-4245-b9b6-e29db32c9ee2 for instance f44f180b-9143-43d6-b9cd-ced0c42fd928 on hv-cinder-81966 May 26 12:48:17.437481 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: INFO nova.api.openstack.requestlog [req-970dc8c3-a40d-47a0-b6c1-faa8ba094052 req-db4426ec-098b-4d92-9f67-5c61156c5324 service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.050187 May 26 12:48:17.439316 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: [pid: 129321|app: 0|req: 474/969] 10.222.0.75 () {64 vars in 1317 bytes} [Thu May 26 12:48:17 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 12:48:17.755961 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi [None req-6bdcba9e-9198-4e99-9f58-d7f239bd7bc5 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Calling method '>' {{(pid=129322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:48:17.756661 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.compute.api [None req-6bdcba9e-9198-4e99-9f58-d7f239bd7bc5 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] [instance: f44f180b-9143-43d6-b9cd-ced0c42fd928] Fetching instance by UUID {{(pid=129322) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:48:17.763584 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-6bdcba9e-9198-4e99-9f58-d7f239bd7bc5 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:48:17.764139 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-6bdcba9e-9198-4e99-9f58-d7f239bd7bc5 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:48:17.764862 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-6bdcba9e-9198-4e99-9f58-d7f239bd7bc5 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:48:17.765295 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-6bdcba9e-9198-4e99-9f58-d7f239bd7bc5 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:48:17.920022 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.policy [None req-6bdcba9e-9198-4e99-9f58-d7f239bd7bc5 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e811736979c44b02b14fecb74c6bd7ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675272fb40d4847819f83ec04afecef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129322) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:48:17.929687 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.policy [None req-6bdcba9e-9198-4e99-9f58-d7f239bd7bc5 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e811736979c44b02b14fecb74c6bd7ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675272fb40d4847819f83ec04afecef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129322) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:48:17.931319 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.policy [None req-6bdcba9e-9198-4e99-9f58-d7f239bd7bc5 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e811736979c44b02b14fecb74c6bd7ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675272fb40d4847819f83ec04afecef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129322) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:48:17.932707 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: INFO nova.api.openstack.requestlog [None req-6bdcba9e-9198-4e99-9f58-d7f239bd7bc5 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] 10.222.0.75 "GET /compute/v2.1/servers/f44f180b-9143-43d6-b9cd-ced0c42fd928" status: 200 len: 1666 microversion: 2.20 time: 0.180716 May 26 12:48:17.933356 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: [pid: 129322|app: 0|req: 496/970] 10.222.0.75 () {60 vars in 1276 bytes} [Thu May 26 12:48:17 2022] GET /compute/v2.1/servers/f44f180b-9143-43d6-b9cd-ced0c42fd928 => generated 1666 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 12:48:17.951895 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi [None req-f2ce68ad-1a91-441f-895e-355a71660d4f tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "5c4363b7-d06b-41d4-a45f-9b35ed6f61f7"}} {{(pid=129321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 12:48:17.953030 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.compute.api [None req-f2ce68ad-1a91-441f-895e-355a71660d4f tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] [instance: f44f180b-9143-43d6-b9cd-ced0c42fd928] Fetching instance by UUID {{(pid=129321) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:48:17.959823 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-f2ce68ad-1a91-441f-895e-355a71660d4f tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:48:17.960067 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-f2ce68ad-1a91-441f-895e-355a71660d4f tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:48:17.960859 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-f2ce68ad-1a91-441f-895e-355a71660d4f tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:48:17.961255 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-f2ce68ad-1a91-441f-895e-355a71660d4f tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:48:18.285116 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: INFO nova.api.openstack.requestlog [None req-f2ce68ad-1a91-441f-895e-355a71660d4f tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] 10.222.0.75 "POST /compute/v2.1/servers/f44f180b-9143-43d6-b9cd-ced0c42fd928/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.338141 May 26 12:48:18.285801 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: [pid: 129321|app: 0|req: 475/971] 10.222.0.75 () {62 vars in 1363 bytes} [Thu May 26 12:48:17 2022] POST /compute/v2.1/servers/f44f180b-9143-43d6-b9cd-ced0c42fd928/os-volume_attachments => generated 188 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 26 12:48:18.414676 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi [None req-54b79d55-0a9a-4e08-b1d4-1acde24c373f tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Calling method '>' {{(pid=129322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:48:18.415141 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.compute.api [None req-54b79d55-0a9a-4e08-b1d4-1acde24c373f tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] [instance: f44f180b-9143-43d6-b9cd-ced0c42fd928] Fetching instance by UUID {{(pid=129322) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:48:18.421729 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-54b79d55-0a9a-4e08-b1d4-1acde24c373f tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:48:18.422171 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-54b79d55-0a9a-4e08-b1d4-1acde24c373f tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:48:18.422950 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-54b79d55-0a9a-4e08-b1d4-1acde24c373f tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:48:18.423389 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-54b79d55-0a9a-4e08-b1d4-1acde24c373f tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:48:18.697580 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: INFO nova.api.openstack.requestlog [None req-54b79d55-0a9a-4e08-b1d4-1acde24c373f tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] 10.222.0.75 "DELETE /compute/v2.1/servers/f44f180b-9143-43d6-b9cd-ced0c42fd928/os-volume_attachments/5c4363b7-d06b-41d4-a45f-9b35ed6f61f7" status: 202 len: 0 microversion: 2.20 time: 0.287182 May 26 12:48:18.698300 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: [pid: 129322|app: 0|req: 497/972] 10.222.0.75 () {60 vars in 1456 bytes} [Thu May 26 12:48:18 2022] DELETE /compute/v2.1/servers/f44f180b-9143-43d6-b9cd-ced0c42fd928/os-volume_attachments/5c4363b7-d06b-41d4-a45f-9b35ed6f61f7 => generated 0 bytes in 289 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) May 26 12:48:18.761997 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi [None req-c1375475-4af0-4408-96b1-bf8a1b672be7 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=129321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 12:48:18.762571 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.compute.api [None req-c1375475-4af0-4408-96b1-bf8a1b672be7 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] [instance: f44f180b-9143-43d6-b9cd-ced0c42fd928] Fetching instance by UUID {{(pid=129321) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:48:18.769694 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-c1375475-4af0-4408-96b1-bf8a1b672be7 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:48:18.770148 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-c1375475-4af0-4408-96b1-bf8a1b672be7 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:48:18.770935 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-c1375475-4af0-4408-96b1-bf8a1b672be7 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:48:18.771376 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-c1375475-4af0-4408-96b1-bf8a1b672be7 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:48:18.857093 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: INFO nova.api.openstack.requestlog [None req-c1375475-4af0-4408-96b1-bf8a1b672be7 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] 10.222.0.75 "POST /compute/v2.1/servers/f44f180b-9143-43d6-b9cd-ced0c42fd928/action" status: 202 len: 0 microversion: 2.20 time: 0.099404 May 26 12:48:18.858220 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: [pid: 129321|app: 0|req: 476/973] 10.222.0.75 () {62 vars in 1318 bytes} [Thu May 26 12:48:18 2022] POST /compute/v2.1/servers/f44f180b-9143-43d6-b9cd-ced0c42fd928/action => generated 0 bytes in 101 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) May 26 12:48:18.868638 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi [None req-7cf7f2df-845e-49ab-9b7e-4aaf4448d631 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Calling method '>' {{(pid=129322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:48:18.869843 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.compute.api [None req-7cf7f2df-845e-49ab-9b7e-4aaf4448d631 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] [instance: f44f180b-9143-43d6-b9cd-ced0c42fd928] Fetching instance by UUID {{(pid=129322) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:48:18.882974 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-7cf7f2df-845e-49ab-9b7e-4aaf4448d631 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:48:18.883849 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-7cf7f2df-845e-49ab-9b7e-4aaf4448d631 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:48:18.885102 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-7cf7f2df-845e-49ab-9b7e-4aaf4448d631 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:48:18.886013 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-7cf7f2df-845e-49ab-9b7e-4aaf4448d631 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:48:19.045403 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.policy [None req-7cf7f2df-845e-49ab-9b7e-4aaf4448d631 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e811736979c44b02b14fecb74c6bd7ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675272fb40d4847819f83ec04afecef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129322) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:48:19.055723 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.policy [None req-7cf7f2df-845e-49ab-9b7e-4aaf4448d631 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e811736979c44b02b14fecb74c6bd7ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675272fb40d4847819f83ec04afecef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129322) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:48:19.057340 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.policy [None req-7cf7f2df-845e-49ab-9b7e-4aaf4448d631 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e811736979c44b02b14fecb74c6bd7ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675272fb40d4847819f83ec04afecef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129322) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:48:19.058566 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: INFO nova.api.openstack.requestlog [None req-7cf7f2df-845e-49ab-9b7e-4aaf4448d631 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] 10.222.0.75 "GET /compute/v2.1/servers/f44f180b-9143-43d6-b9cd-ced0c42fd928" status: 200 len: 1674 microversion: 2.20 time: 0.195567 May 26 12:48:19.059369 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: [pid: 129322|app: 0|req: 498/974] 10.222.0.75 () {60 vars in 1276 bytes} [Thu May 26 12:48:18 2022] GET /compute/v2.1/servers/f44f180b-9143-43d6-b9cd-ced0c42fd928 => generated 1674 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 12:48:20.081313 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi [None req-aa0482be-646d-4521-aae3-57924f5a2246 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Calling method '>' {{(pid=129321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:48:20.081970 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.compute.api [None req-aa0482be-646d-4521-aae3-57924f5a2246 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] [instance: f44f180b-9143-43d6-b9cd-ced0c42fd928] Fetching instance by UUID {{(pid=129321) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:48:20.088987 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-aa0482be-646d-4521-aae3-57924f5a2246 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:48:20.089446 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-aa0482be-646d-4521-aae3-57924f5a2246 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:48:20.090216 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-aa0482be-646d-4521-aae3-57924f5a2246 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:48:20.090708 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-aa0482be-646d-4521-aae3-57924f5a2246 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:48:20.267157 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.policy [None req-aa0482be-646d-4521-aae3-57924f5a2246 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e811736979c44b02b14fecb74c6bd7ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675272fb40d4847819f83ec04afecef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129321) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:48:20.276598 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.policy [None req-aa0482be-646d-4521-aae3-57924f5a2246 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e811736979c44b02b14fecb74c6bd7ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675272fb40d4847819f83ec04afecef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129321) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:48:20.278106 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.policy [None req-aa0482be-646d-4521-aae3-57924f5a2246 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e811736979c44b02b14fecb74c6bd7ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675272fb40d4847819f83ec04afecef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129321) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:48:20.281007 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: INFO nova.api.openstack.requestlog [None req-aa0482be-646d-4521-aae3-57924f5a2246 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] 10.222.0.75 "GET /compute/v2.1/servers/f44f180b-9143-43d6-b9cd-ced0c42fd928" status: 200 len: 1732 microversion: 2.20 time: 0.206349 May 26 12:48:20.285739 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: [pid: 129321|app: 0|req: 477/975] 10.222.0.75 () {60 vars in 1276 bytes} [Thu May 26 12:48:20 2022] GET /compute/v2.1/servers/f44f180b-9143-43d6-b9cd-ced0c42fd928 => generated 1732 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 26 12:48:21.312349 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi [None req-d914ff3f-e7f3-4ce2-a35f-592c693408eb tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Calling method '>' {{(pid=129322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:48:21.314048 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.compute.api [None req-d914ff3f-e7f3-4ce2-a35f-592c693408eb tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] [instance: f44f180b-9143-43d6-b9cd-ced0c42fd928] Fetching instance by UUID {{(pid=129322) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:48:21.320848 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-d914ff3f-e7f3-4ce2-a35f-592c693408eb tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:48:21.321570 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-d914ff3f-e7f3-4ce2-a35f-592c693408eb tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:48:21.323092 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-d914ff3f-e7f3-4ce2-a35f-592c693408eb tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:48:21.323849 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-d914ff3f-e7f3-4ce2-a35f-592c693408eb tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:48:21.489985 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.policy [None req-d914ff3f-e7f3-4ce2-a35f-592c693408eb tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e811736979c44b02b14fecb74c6bd7ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675272fb40d4847819f83ec04afecef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129322) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:48:21.500422 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.policy [None req-d914ff3f-e7f3-4ce2-a35f-592c693408eb tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e811736979c44b02b14fecb74c6bd7ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675272fb40d4847819f83ec04afecef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129322) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:48:21.502422 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.policy [None req-d914ff3f-e7f3-4ce2-a35f-592c693408eb tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e811736979c44b02b14fecb74c6bd7ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675272fb40d4847819f83ec04afecef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129322) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:48:21.504574 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: INFO nova.api.openstack.requestlog [None req-d914ff3f-e7f3-4ce2-a35f-592c693408eb tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] 10.222.0.75 "GET /compute/v2.1/servers/f44f180b-9143-43d6-b9cd-ced0c42fd928" status: 200 len: 1732 microversion: 2.20 time: 0.198655 May 26 12:48:21.505153 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: [pid: 129322|app: 0|req: 499/976] 10.222.0.75 () {60 vars in 1276 bytes} [Thu May 26 12:48:21 2022] GET /compute/v2.1/servers/f44f180b-9143-43d6-b9cd-ced0c42fd928 => generated 1732 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 12:48:22.522981 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi [None req-b9cd98c9-9eb6-4842-b539-cbbf4c13ffc6 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Calling method '>' {{(pid=129321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:48:22.524408 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.compute.api [None req-b9cd98c9-9eb6-4842-b539-cbbf4c13ffc6 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] [instance: f44f180b-9143-43d6-b9cd-ced0c42fd928] Fetching instance by UUID {{(pid=129321) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:48:22.533540 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-b9cd98c9-9eb6-4842-b539-cbbf4c13ffc6 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:48:22.533976 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-b9cd98c9-9eb6-4842-b539-cbbf4c13ffc6 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:48:22.534978 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-b9cd98c9-9eb6-4842-b539-cbbf4c13ffc6 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:48:22.535696 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-b9cd98c9-9eb6-4842-b539-cbbf4c13ffc6 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:48:22.691573 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.policy [None req-b9cd98c9-9eb6-4842-b539-cbbf4c13ffc6 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e811736979c44b02b14fecb74c6bd7ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675272fb40d4847819f83ec04afecef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129321) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:48:22.701301 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.policy [None req-b9cd98c9-9eb6-4842-b539-cbbf4c13ffc6 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e811736979c44b02b14fecb74c6bd7ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675272fb40d4847819f83ec04afecef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129321) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:48:22.702844 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.policy [None req-b9cd98c9-9eb6-4842-b539-cbbf4c13ffc6 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e811736979c44b02b14fecb74c6bd7ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675272fb40d4847819f83ec04afecef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129321) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:48:22.704245 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: INFO nova.api.openstack.requestlog [None req-b9cd98c9-9eb6-4842-b539-cbbf4c13ffc6 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] 10.222.0.75 "GET /compute/v2.1/servers/f44f180b-9143-43d6-b9cd-ced0c42fd928" status: 200 len: 1732 microversion: 2.20 time: 0.185602 May 26 12:48:22.705118 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: [pid: 129321|app: 0|req: 478/977] 10.222.0.75 () {60 vars in 1276 bytes} [Thu May 26 12:48:22 2022] GET /compute/v2.1/servers/f44f180b-9143-43d6-b9cd-ced0c42fd928 => generated 1732 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 12:48:23.723108 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi [None req-f22707d8-fde7-4c10-bd74-1e5023101c50 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Calling method '>' {{(pid=129322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:48:23.723909 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.compute.api [None req-f22707d8-fde7-4c10-bd74-1e5023101c50 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] [instance: f44f180b-9143-43d6-b9cd-ced0c42fd928] Fetching instance by UUID {{(pid=129322) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:48:23.731874 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-f22707d8-fde7-4c10-bd74-1e5023101c50 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:48:23.732420 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-f22707d8-fde7-4c10-bd74-1e5023101c50 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:48:23.733441 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-f22707d8-fde7-4c10-bd74-1e5023101c50 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:48:23.734103 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-f22707d8-fde7-4c10-bd74-1e5023101c50 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:48:23.899727 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.policy [None req-f22707d8-fde7-4c10-bd74-1e5023101c50 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e811736979c44b02b14fecb74c6bd7ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675272fb40d4847819f83ec04afecef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129322) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:48:23.908780 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.policy [None req-f22707d8-fde7-4c10-bd74-1e5023101c50 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e811736979c44b02b14fecb74c6bd7ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675272fb40d4847819f83ec04afecef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129322) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:48:23.919527 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.policy [None req-f22707d8-fde7-4c10-bd74-1e5023101c50 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e811736979c44b02b14fecb74c6bd7ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675272fb40d4847819f83ec04afecef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129322) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:48:23.919527 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: INFO nova.api.openstack.requestlog [None req-f22707d8-fde7-4c10-bd74-1e5023101c50 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] 10.222.0.75 "GET /compute/v2.1/servers/f44f180b-9143-43d6-b9cd-ced0c42fd928" status: 200 len: 1732 microversion: 2.20 time: 0.193079 May 26 12:48:23.919527 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: [pid: 129322|app: 0|req: 500/978] 10.222.0.75 () {60 vars in 1276 bytes} [Thu May 26 12:48:23 2022] GET /compute/v2.1/servers/f44f180b-9143-43d6-b9cd-ced0c42fd928 => generated 1732 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 12:48:24.930717 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi [None req-9eefaf91-22ba-4361-b155-86ce28285b69 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Calling method '>' {{(pid=129321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:48:24.932713 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.compute.api [None req-9eefaf91-22ba-4361-b155-86ce28285b69 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] [instance: f44f180b-9143-43d6-b9cd-ced0c42fd928] Fetching instance by UUID {{(pid=129321) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:48:24.939205 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-9eefaf91-22ba-4361-b155-86ce28285b69 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:48:24.939884 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-9eefaf91-22ba-4361-b155-86ce28285b69 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:48:24.940683 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-9eefaf91-22ba-4361-b155-86ce28285b69 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:48:24.941124 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-9eefaf91-22ba-4361-b155-86ce28285b69 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:48:25.102393 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.policy [None req-9eefaf91-22ba-4361-b155-86ce28285b69 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e811736979c44b02b14fecb74c6bd7ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675272fb40d4847819f83ec04afecef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129321) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:48:25.112491 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.policy [None req-9eefaf91-22ba-4361-b155-86ce28285b69 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e811736979c44b02b14fecb74c6bd7ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675272fb40d4847819f83ec04afecef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129321) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:48:25.114371 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.policy [None req-9eefaf91-22ba-4361-b155-86ce28285b69 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e811736979c44b02b14fecb74c6bd7ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675272fb40d4847819f83ec04afecef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129321) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:48:25.116418 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: INFO nova.api.openstack.requestlog [None req-9eefaf91-22ba-4361-b155-86ce28285b69 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] 10.222.0.75 "GET /compute/v2.1/servers/f44f180b-9143-43d6-b9cd-ced0c42fd928" status: 200 len: 1732 microversion: 2.20 time: 0.189164 May 26 12:48:25.117495 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: [pid: 129321|app: 0|req: 479/979] 10.222.0.75 () {60 vars in 1276 bytes} [Thu May 26 12:48:24 2022] GET /compute/v2.1/servers/f44f180b-9143-43d6-b9cd-ced0c42fd928 => generated 1732 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 12:48:26.142957 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi [None req-618da5cf-7eee-44c8-866a-d930afcc0e86 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Calling method '>' {{(pid=129322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:48:26.143657 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.compute.api [None req-618da5cf-7eee-44c8-866a-d930afcc0e86 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] [instance: f44f180b-9143-43d6-b9cd-ced0c42fd928] Fetching instance by UUID {{(pid=129322) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:48:26.152187 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-618da5cf-7eee-44c8-866a-d930afcc0e86 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:48:26.152648 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-618da5cf-7eee-44c8-866a-d930afcc0e86 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:48:26.153508 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-618da5cf-7eee-44c8-866a-d930afcc0e86 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:48:26.154015 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-618da5cf-7eee-44c8-866a-d930afcc0e86 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:48:26.305222 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.policy [None req-618da5cf-7eee-44c8-866a-d930afcc0e86 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e811736979c44b02b14fecb74c6bd7ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675272fb40d4847819f83ec04afecef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129322) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:48:26.314520 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.policy [None req-618da5cf-7eee-44c8-866a-d930afcc0e86 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e811736979c44b02b14fecb74c6bd7ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675272fb40d4847819f83ec04afecef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129322) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:48:26.315996 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.policy [None req-618da5cf-7eee-44c8-866a-d930afcc0e86 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e811736979c44b02b14fecb74c6bd7ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675272fb40d4847819f83ec04afecef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129322) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:48:26.317329 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: INFO nova.api.openstack.requestlog [None req-618da5cf-7eee-44c8-866a-d930afcc0e86 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] 10.222.0.75 "GET /compute/v2.1/servers/f44f180b-9143-43d6-b9cd-ced0c42fd928" status: 200 len: 1732 microversion: 2.20 time: 0.178845 May 26 12:48:26.318317 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: [pid: 129322|app: 0|req: 501/980] 10.222.0.75 () {60 vars in 1276 bytes} [Thu May 26 12:48:26 2022] GET /compute/v2.1/servers/f44f180b-9143-43d6-b9cd-ced0c42fd928 => generated 1732 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 12:48:27.339648 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi [None req-5e44b4e7-5baf-4661-9336-c42a45220b23 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Calling method '>' {{(pid=129321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:48:27.340557 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.compute.api [None req-5e44b4e7-5baf-4661-9336-c42a45220b23 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] [instance: f44f180b-9143-43d6-b9cd-ced0c42fd928] Fetching instance by UUID {{(pid=129321) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:48:27.348799 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-5e44b4e7-5baf-4661-9336-c42a45220b23 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:48:27.349379 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-5e44b4e7-5baf-4661-9336-c42a45220b23 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:48:27.350245 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-5e44b4e7-5baf-4661-9336-c42a45220b23 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:48:27.351158 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-5e44b4e7-5baf-4661-9336-c42a45220b23 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:48:27.507656 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.policy [None req-5e44b4e7-5baf-4661-9336-c42a45220b23 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e811736979c44b02b14fecb74c6bd7ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675272fb40d4847819f83ec04afecef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129321) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:48:27.517937 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.policy [None req-5e44b4e7-5baf-4661-9336-c42a45220b23 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e811736979c44b02b14fecb74c6bd7ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675272fb40d4847819f83ec04afecef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129321) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:48:27.519467 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.policy [None req-5e44b4e7-5baf-4661-9336-c42a45220b23 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e811736979c44b02b14fecb74c6bd7ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675272fb40d4847819f83ec04afecef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129321) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:48:27.520740 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: INFO nova.api.openstack.requestlog [None req-5e44b4e7-5baf-4661-9336-c42a45220b23 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] 10.222.0.75 "GET /compute/v2.1/servers/f44f180b-9143-43d6-b9cd-ced0c42fd928" status: 200 len: 1732 microversion: 2.20 time: 0.188293 May 26 12:48:27.521324 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: [pid: 129321|app: 0|req: 480/981] 10.222.0.75 () {60 vars in 1276 bytes} [Thu May 26 12:48:27 2022] GET /compute/v2.1/servers/f44f180b-9143-43d6-b9cd-ced0c42fd928 => generated 1732 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 12:48:28.540423 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi [None req-4aece311-f33b-422e-b397-24461a856998 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Calling method '>' {{(pid=129322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:48:28.541494 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.compute.api [None req-4aece311-f33b-422e-b397-24461a856998 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] [instance: f44f180b-9143-43d6-b9cd-ced0c42fd928] Fetching instance by UUID {{(pid=129322) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:48:28.549128 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-4aece311-f33b-422e-b397-24461a856998 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:48:28.549686 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-4aece311-f33b-422e-b397-24461a856998 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:48:28.550376 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-4aece311-f33b-422e-b397-24461a856998 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:48:28.550808 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-4aece311-f33b-422e-b397-24461a856998 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:48:28.712056 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.policy [None req-4aece311-f33b-422e-b397-24461a856998 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e811736979c44b02b14fecb74c6bd7ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675272fb40d4847819f83ec04afecef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129322) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:48:28.722161 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.policy [None req-4aece311-f33b-422e-b397-24461a856998 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e811736979c44b02b14fecb74c6bd7ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675272fb40d4847819f83ec04afecef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129322) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:48:28.723697 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.policy [None req-4aece311-f33b-422e-b397-24461a856998 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e811736979c44b02b14fecb74c6bd7ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675272fb40d4847819f83ec04afecef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129322) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:48:28.724957 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: INFO nova.api.openstack.requestlog [None req-4aece311-f33b-422e-b397-24461a856998 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] 10.222.0.75 "GET /compute/v2.1/servers/f44f180b-9143-43d6-b9cd-ced0c42fd928" status: 200 len: 1732 microversion: 2.20 time: 0.188699 May 26 12:48:28.725576 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: [pid: 129322|app: 0|req: 502/982] 10.222.0.75 () {60 vars in 1276 bytes} [Thu May 26 12:48:28 2022] GET /compute/v2.1/servers/f44f180b-9143-43d6-b9cd-ced0c42fd928 => generated 1732 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 26 12:48:29.745967 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi [None req-e4a06d88-ca25-444b-92e5-9610572457a6 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Calling method '>' {{(pid=129321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:48:29.747177 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.compute.api [None req-e4a06d88-ca25-444b-92e5-9610572457a6 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] [instance: f44f180b-9143-43d6-b9cd-ced0c42fd928] Fetching instance by UUID {{(pid=129321) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:48:29.757758 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-e4a06d88-ca25-444b-92e5-9610572457a6 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:48:29.758228 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-e4a06d88-ca25-444b-92e5-9610572457a6 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:48:29.758979 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-e4a06d88-ca25-444b-92e5-9610572457a6 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:48:29.759420 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-e4a06d88-ca25-444b-92e5-9610572457a6 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:48:29.939057 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.policy [None req-e4a06d88-ca25-444b-92e5-9610572457a6 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e811736979c44b02b14fecb74c6bd7ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675272fb40d4847819f83ec04afecef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129321) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:48:29.949190 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.policy [None req-e4a06d88-ca25-444b-92e5-9610572457a6 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e811736979c44b02b14fecb74c6bd7ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675272fb40d4847819f83ec04afecef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129321) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:48:29.950995 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.policy [None req-e4a06d88-ca25-444b-92e5-9610572457a6 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e811736979c44b02b14fecb74c6bd7ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675272fb40d4847819f83ec04afecef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129321) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:48:29.952248 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: INFO nova.api.openstack.requestlog [None req-e4a06d88-ca25-444b-92e5-9610572457a6 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] 10.222.0.75 "GET /compute/v2.1/servers/f44f180b-9143-43d6-b9cd-ced0c42fd928" status: 200 len: 1732 microversion: 2.20 time: 0.212667 May 26 12:48:29.952812 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: [pid: 129321|app: 0|req: 481/983] 10.222.0.75 () {60 vars in 1276 bytes} [Thu May 26 12:48:29 2022] GET /compute/v2.1/servers/f44f180b-9143-43d6-b9cd-ced0c42fd928 => generated 1732 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 12:48:30.972734 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi [None req-5ee195ab-c99e-4fda-bfbc-7f9f397685fa tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Calling method '>' {{(pid=129322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:48:30.974512 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.compute.api [None req-5ee195ab-c99e-4fda-bfbc-7f9f397685fa tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] [instance: f44f180b-9143-43d6-b9cd-ced0c42fd928] Fetching instance by UUID {{(pid=129322) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:48:30.985711 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-5ee195ab-c99e-4fda-bfbc-7f9f397685fa tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:48:30.986240 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-5ee195ab-c99e-4fda-bfbc-7f9f397685fa tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:48:30.987169 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-5ee195ab-c99e-4fda-bfbc-7f9f397685fa tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:48:30.988022 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-5ee195ab-c99e-4fda-bfbc-7f9f397685fa tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:48:30.993252 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG dbcounter [-] [129322] Writing DB stats nova_cell1:SELECT=94,nova_cell1:INSERT=2,nova_cell1:UPDATE=4 {{(pid=129322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:48:31.133187 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.policy [None req-5ee195ab-c99e-4fda-bfbc-7f9f397685fa tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e811736979c44b02b14fecb74c6bd7ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675272fb40d4847819f83ec04afecef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129322) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:48:31.142394 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.policy [None req-5ee195ab-c99e-4fda-bfbc-7f9f397685fa tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e811736979c44b02b14fecb74c6bd7ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675272fb40d4847819f83ec04afecef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129322) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:48:31.143942 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.policy [None req-5ee195ab-c99e-4fda-bfbc-7f9f397685fa tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e811736979c44b02b14fecb74c6bd7ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675272fb40d4847819f83ec04afecef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129322) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:48:31.145131 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: INFO nova.api.openstack.requestlog [None req-5ee195ab-c99e-4fda-bfbc-7f9f397685fa tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] 10.222.0.75 "GET /compute/v2.1/servers/f44f180b-9143-43d6-b9cd-ced0c42fd928" status: 200 len: 1732 microversion: 2.20 time: 0.176420 May 26 12:48:31.145730 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: [pid: 129322|app: 0|req: 503/984] 10.222.0.75 () {60 vars in 1276 bytes} [Thu May 26 12:48:30 2022] GET /compute/v2.1/servers/f44f180b-9143-43d6-b9cd-ced0c42fd928 => generated 1732 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 12:48:32.167206 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi [None req-1d8a5577-8005-4c90-bdd8-0c86b434f9aa tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Calling method '>' {{(pid=129321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:48:32.167870 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.compute.api [None req-1d8a5577-8005-4c90-bdd8-0c86b434f9aa tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] [instance: f44f180b-9143-43d6-b9cd-ced0c42fd928] Fetching instance by UUID {{(pid=129321) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:48:32.176414 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-1d8a5577-8005-4c90-bdd8-0c86b434f9aa tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:48:32.176966 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-1d8a5577-8005-4c90-bdd8-0c86b434f9aa tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:48:32.178047 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-1d8a5577-8005-4c90-bdd8-0c86b434f9aa tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:48:32.178585 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-1d8a5577-8005-4c90-bdd8-0c86b434f9aa tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:48:32.340724 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.policy [None req-1d8a5577-8005-4c90-bdd8-0c86b434f9aa tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e811736979c44b02b14fecb74c6bd7ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675272fb40d4847819f83ec04afecef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129321) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:48:32.343083 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG dbcounter [-] [129321] Writing DB stats nova_cell1:SELECT=91,nova_cell1:INSERT=4,nova_cell1:UPDATE=5 {{(pid=129321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:48:32.351241 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.policy [None req-1d8a5577-8005-4c90-bdd8-0c86b434f9aa tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e811736979c44b02b14fecb74c6bd7ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675272fb40d4847819f83ec04afecef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129321) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:48:32.352791 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.policy [None req-1d8a5577-8005-4c90-bdd8-0c86b434f9aa tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e811736979c44b02b14fecb74c6bd7ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675272fb40d4847819f83ec04afecef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129321) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:48:32.354087 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: INFO nova.api.openstack.requestlog [None req-1d8a5577-8005-4c90-bdd8-0c86b434f9aa tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] 10.222.0.75 "GET /compute/v2.1/servers/f44f180b-9143-43d6-b9cd-ced0c42fd928" status: 200 len: 1732 microversion: 2.20 time: 0.191077 May 26 12:48:32.354780 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: [pid: 129321|app: 0|req: 482/985] 10.222.0.75 () {60 vars in 1276 bytes} [Thu May 26 12:48:32 2022] GET /compute/v2.1/servers/f44f180b-9143-43d6-b9cd-ced0c42fd928 => generated 1732 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 12:48:33.373038 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi [None req-00d93fd9-1bc3-4880-a53d-4f3b752e9c22 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Calling method '>' {{(pid=129322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:48:33.373613 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.compute.api [None req-00d93fd9-1bc3-4880-a53d-4f3b752e9c22 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] [instance: f44f180b-9143-43d6-b9cd-ced0c42fd928] Fetching instance by UUID {{(pid=129322) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:48:33.376006 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG dbcounter [-] [129322] Writing DB stats nova_api:SELECT=30 {{(pid=129322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:48:33.381575 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-00d93fd9-1bc3-4880-a53d-4f3b752e9c22 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:48:33.382024 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-00d93fd9-1bc3-4880-a53d-4f3b752e9c22 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:48:33.382791 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-00d93fd9-1bc3-4880-a53d-4f3b752e9c22 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:48:33.383221 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-00d93fd9-1bc3-4880-a53d-4f3b752e9c22 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:48:33.528966 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.policy [None req-00d93fd9-1bc3-4880-a53d-4f3b752e9c22 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e811736979c44b02b14fecb74c6bd7ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675272fb40d4847819f83ec04afecef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129322) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:48:33.537895 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.policy [None req-00d93fd9-1bc3-4880-a53d-4f3b752e9c22 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e811736979c44b02b14fecb74c6bd7ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675272fb40d4847819f83ec04afecef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129322) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:48:33.539439 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.policy [None req-00d93fd9-1bc3-4880-a53d-4f3b752e9c22 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e811736979c44b02b14fecb74c6bd7ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675272fb40d4847819f83ec04afecef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129322) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:48:33.540651 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: INFO nova.api.openstack.requestlog [None req-00d93fd9-1bc3-4880-a53d-4f3b752e9c22 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] 10.222.0.75 "GET /compute/v2.1/servers/f44f180b-9143-43d6-b9cd-ced0c42fd928" status: 200 len: 1732 microversion: 2.20 time: 0.171846 May 26 12:48:33.542054 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: [pid: 129322|app: 0|req: 504/986] 10.222.0.75 () {60 vars in 1276 bytes} [Thu May 26 12:48:33 2022] GET /compute/v2.1/servers/f44f180b-9143-43d6-b9cd-ced0c42fd928 => generated 1732 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 12:48:34.442207 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi [None req-e84455d0-dbc9-4ad7-a2c9-691a0fa511e8 tempest-TestVolumeBootPattern-1304354335 tempest-TestVolumeBootPattern-1304354335-project] Calling method '>' {{(pid=129321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:48:34.442812 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.compute.api [None req-e84455d0-dbc9-4ad7-a2c9-691a0fa511e8 tempest-TestVolumeBootPattern-1304354335 tempest-TestVolumeBootPattern-1304354335-project] [instance: 475179d2-21d7-4ace-90eb-e6525cb14928] Fetching instance by UUID {{(pid=129321) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:48:34.450441 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-e84455d0-dbc9-4ad7-a2c9-691a0fa511e8 tempest-TestVolumeBootPattern-1304354335 tempest-TestVolumeBootPattern-1304354335-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:48:34.450891 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-e84455d0-dbc9-4ad7-a2c9-691a0fa511e8 tempest-TestVolumeBootPattern-1304354335 tempest-TestVolumeBootPattern-1304354335-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:48:34.451717 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-e84455d0-dbc9-4ad7-a2c9-691a0fa511e8 tempest-TestVolumeBootPattern-1304354335 tempest-TestVolumeBootPattern-1304354335-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:48:34.452153 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-e84455d0-dbc9-4ad7-a2c9-691a0fa511e8 tempest-TestVolumeBootPattern-1304354335 tempest-TestVolumeBootPattern-1304354335-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:48:34.479076 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.compute.api [None req-e84455d0-dbc9-4ad7-a2c9-691a0fa511e8 tempest-TestVolumeBootPattern-1304354335 tempest-TestVolumeBootPattern-1304354335-project] [instance: 475179d2-21d7-4ace-90eb-e6525cb14928] Going to try to terminate instance {{(pid=129321) delete /opt/stack/nova/nova/compute/api.py:2664}} May 26 12:48:34.560381 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi [None req-a12a7d32-70d9-4ae8-a108-51cb829b143f tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Calling method '>' {{(pid=129322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:48:34.561241 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.compute.api [None req-a12a7d32-70d9-4ae8-a108-51cb829b143f tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] [instance: f44f180b-9143-43d6-b9cd-ced0c42fd928] Fetching instance by UUID {{(pid=129322) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:48:34.562807 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: INFO nova.api.openstack.requestlog [None req-e84455d0-dbc9-4ad7-a2c9-691a0fa511e8 tempest-TestVolumeBootPattern-1304354335 tempest-TestVolumeBootPattern-1304354335-project] 10.222.0.75 "DELETE /compute/v2.1/servers/475179d2-21d7-4ace-90eb-e6525cb14928" status: 204 len: 0 microversion: 2.1 time: 0.124347 May 26 12:48:34.563411 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: [pid: 129321|app: 0|req: 483/987] 10.222.0.75 () {58 vars in 1238 bytes} [Thu May 26 12:48:34 2022] DELETE /compute/v2.1/servers/475179d2-21d7-4ace-90eb-e6525cb14928 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 26 12:48:34.568564 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-a12a7d32-70d9-4ae8-a108-51cb829b143f tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:48:34.569005 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-a12a7d32-70d9-4ae8-a108-51cb829b143f tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:48:34.569791 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-a12a7d32-70d9-4ae8-a108-51cb829b143f tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:48:34.570203 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-a12a7d32-70d9-4ae8-a108-51cb829b143f tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:48:34.571946 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi [None req-954f1cd1-854c-416c-aa1d-7a1bff4b78cf tempest-TestVolumeBootPattern-1304354335 tempest-TestVolumeBootPattern-1304354335-project] Calling method '>' {{(pid=129321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:48:34.572673 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.compute.api [None req-954f1cd1-854c-416c-aa1d-7a1bff4b78cf tempest-TestVolumeBootPattern-1304354335 tempest-TestVolumeBootPattern-1304354335-project] [instance: 475179d2-21d7-4ace-90eb-e6525cb14928] Fetching instance by UUID {{(pid=129321) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:48:34.578850 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-954f1cd1-854c-416c-aa1d-7a1bff4b78cf tempest-TestVolumeBootPattern-1304354335 tempest-TestVolumeBootPattern-1304354335-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:48:34.579290 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-954f1cd1-854c-416c-aa1d-7a1bff4b78cf tempest-TestVolumeBootPattern-1304354335 tempest-TestVolumeBootPattern-1304354335-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:48:34.580091 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-954f1cd1-854c-416c-aa1d-7a1bff4b78cf tempest-TestVolumeBootPattern-1304354335 tempest-TestVolumeBootPattern-1304354335-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:48:34.580519 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-954f1cd1-854c-416c-aa1d-7a1bff4b78cf tempest-TestVolumeBootPattern-1304354335 tempest-TestVolumeBootPattern-1304354335-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:48:34.725775 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.policy [None req-a12a7d32-70d9-4ae8-a108-51cb829b143f tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e811736979c44b02b14fecb74c6bd7ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675272fb40d4847819f83ec04afecef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129322) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:48:34.734389 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.policy [None req-a12a7d32-70d9-4ae8-a108-51cb829b143f tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e811736979c44b02b14fecb74c6bd7ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675272fb40d4847819f83ec04afecef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129322) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:48:34.735946 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.policy [None req-a12a7d32-70d9-4ae8-a108-51cb829b143f tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e811736979c44b02b14fecb74c6bd7ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675272fb40d4847819f83ec04afecef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129322) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:48:34.737142 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: INFO nova.api.openstack.requestlog [None req-a12a7d32-70d9-4ae8-a108-51cb829b143f tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] 10.222.0.75 "GET /compute/v2.1/servers/f44f180b-9143-43d6-b9cd-ced0c42fd928" status: 200 len: 1732 microversion: 2.20 time: 0.181336 May 26 12:48:34.737713 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: [pid: 129322|app: 0|req: 505/988] 10.222.0.75 () {60 vars in 1276 bytes} [Thu May 26 12:48:34 2022] GET /compute/v2.1/servers/f44f180b-9143-43d6-b9cd-ced0c42fd928 => generated 1732 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 26 12:48:34.742016 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.policy [None req-954f1cd1-854c-416c-aa1d-7a1bff4b78cf tempest-TestVolumeBootPattern-1304354335 tempest-TestVolumeBootPattern-1304354335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab469b18ce0444d9884cdddc34ef7247', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fb41c547884511893b768b833f4e90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129321) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:48:34.750082 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: INFO nova.api.openstack.requestlog [None req-954f1cd1-854c-416c-aa1d-7a1bff4b78cf tempest-TestVolumeBootPattern-1304354335 tempest-TestVolumeBootPattern-1304354335-project] 10.222.0.75 "GET /compute/v2.1/servers/475179d2-21d7-4ace-90eb-e6525cb14928" status: 200 len: 1579 microversion: 2.1 time: 0.182297 May 26 12:48:34.750659 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: [pid: 129321|app: 0|req: 484/989] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 26 12:48:34 2022] GET /compute/v2.1/servers/475179d2-21d7-4ace-90eb-e6525cb14928 => generated 1579 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 12:48:35.756719 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi [None req-6983ad10-d8b2-4834-a657-d6e450d00066 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Calling method '>' {{(pid=129322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:48:35.757357 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.compute.api [None req-6983ad10-d8b2-4834-a657-d6e450d00066 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] [instance: f44f180b-9143-43d6-b9cd-ced0c42fd928] Fetching instance by UUID {{(pid=129322) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:48:35.766220 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-6983ad10-d8b2-4834-a657-d6e450d00066 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:48:35.766678 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-6983ad10-d8b2-4834-a657-d6e450d00066 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:48:35.767467 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-6983ad10-d8b2-4834-a657-d6e450d00066 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:48:35.767853 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi [None req-707fc863-30ec-4076-8204-4746a051ac3b tempest-TestVolumeBootPattern-1304354335 tempest-TestVolumeBootPattern-1304354335-project] Calling method '>' {{(pid=129321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:48:35.768330 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-6983ad10-d8b2-4834-a657-d6e450d00066 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:48:35.768460 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.compute.api [None req-707fc863-30ec-4076-8204-4746a051ac3b tempest-TestVolumeBootPattern-1304354335 tempest-TestVolumeBootPattern-1304354335-project] [instance: 475179d2-21d7-4ace-90eb-e6525cb14928] Fetching instance by UUID {{(pid=129321) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:48:35.776064 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-707fc863-30ec-4076-8204-4746a051ac3b tempest-TestVolumeBootPattern-1304354335 tempest-TestVolumeBootPattern-1304354335-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:48:35.776568 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-707fc863-30ec-4076-8204-4746a051ac3b tempest-TestVolumeBootPattern-1304354335 tempest-TestVolumeBootPattern-1304354335-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:48:35.777340 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-707fc863-30ec-4076-8204-4746a051ac3b tempest-TestVolumeBootPattern-1304354335 tempest-TestVolumeBootPattern-1304354335-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:48:35.777780 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-707fc863-30ec-4076-8204-4746a051ac3b tempest-TestVolumeBootPattern-1304354335 tempest-TestVolumeBootPattern-1304354335-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:48:35.906708 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.policy [None req-6983ad10-d8b2-4834-a657-d6e450d00066 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e811736979c44b02b14fecb74c6bd7ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675272fb40d4847819f83ec04afecef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129322) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:48:35.912129 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.policy [None req-707fc863-30ec-4076-8204-4746a051ac3b tempest-TestVolumeBootPattern-1304354335 tempest-TestVolumeBootPattern-1304354335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab469b18ce0444d9884cdddc34ef7247', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fb41c547884511893b768b833f4e90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129321) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:48:35.915693 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.policy [None req-6983ad10-d8b2-4834-a657-d6e450d00066 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e811736979c44b02b14fecb74c6bd7ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675272fb40d4847819f83ec04afecef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129322) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:48:35.917368 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.policy [None req-6983ad10-d8b2-4834-a657-d6e450d00066 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e811736979c44b02b14fecb74c6bd7ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675272fb40d4847819f83ec04afecef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129322) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:48:35.918539 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: INFO nova.api.openstack.requestlog [None req-6983ad10-d8b2-4834-a657-d6e450d00066 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] 10.222.0.75 "GET /compute/v2.1/servers/f44f180b-9143-43d6-b9cd-ced0c42fd928" status: 200 len: 1732 microversion: 2.20 time: 0.166323 May 26 12:48:35.919109 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: [pid: 129322|app: 0|req: 506/990] 10.222.0.75 () {60 vars in 1276 bytes} [Thu May 26 12:48:35 2022] GET /compute/v2.1/servers/f44f180b-9143-43d6-b9cd-ced0c42fd928 => generated 1732 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 12:48:35.925533 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: INFO nova.api.openstack.requestlog [None req-707fc863-30ec-4076-8204-4746a051ac3b tempest-TestVolumeBootPattern-1304354335 tempest-TestVolumeBootPattern-1304354335-project] 10.222.0.75 "GET /compute/v2.1/servers/475179d2-21d7-4ace-90eb-e6525cb14928" status: 200 len: 1579 microversion: 2.1 time: 0.161546 May 26 12:48:35.926124 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: [pid: 129321|app: 0|req: 485/991] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 26 12:48:35 2022] GET /compute/v2.1/servers/475179d2-21d7-4ace-90eb-e6525cb14928 => generated 1579 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:48:36.939366 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi [None req-faa4276c-c035-4864-89b3-715b868839a9 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Calling method '>' {{(pid=129322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:48:36.940056 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.compute.api [None req-faa4276c-c035-4864-89b3-715b868839a9 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] [instance: f44f180b-9143-43d6-b9cd-ced0c42fd928] Fetching instance by UUID {{(pid=129322) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:48:36.944430 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi [None req-7b2b8af3-7edf-4464-965e-b6680031554a tempest-TestVolumeBootPattern-1304354335 tempest-TestVolumeBootPattern-1304354335-project] Calling method '>' {{(pid=129321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:48:36.945027 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.compute.api [None req-7b2b8af3-7edf-4464-965e-b6680031554a tempest-TestVolumeBootPattern-1304354335 tempest-TestVolumeBootPattern-1304354335-project] [instance: 475179d2-21d7-4ace-90eb-e6525cb14928] Fetching instance by UUID {{(pid=129321) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:48:36.946988 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-faa4276c-c035-4864-89b3-715b868839a9 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:48:36.947592 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-faa4276c-c035-4864-89b3-715b868839a9 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:48:36.948356 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-faa4276c-c035-4864-89b3-715b868839a9 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:48:36.948816 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-faa4276c-c035-4864-89b3-715b868839a9 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:48:36.951978 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-7b2b8af3-7edf-4464-965e-b6680031554a tempest-TestVolumeBootPattern-1304354335 tempest-TestVolumeBootPattern-1304354335-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:48:36.952428 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-7b2b8af3-7edf-4464-965e-b6680031554a tempest-TestVolumeBootPattern-1304354335 tempest-TestVolumeBootPattern-1304354335-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:48:36.953301 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-7b2b8af3-7edf-4464-965e-b6680031554a tempest-TestVolumeBootPattern-1304354335 tempest-TestVolumeBootPattern-1304354335-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:48:36.953889 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-7b2b8af3-7edf-4464-965e-b6680031554a tempest-TestVolumeBootPattern-1304354335 tempest-TestVolumeBootPattern-1304354335-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:48:37.086972 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.policy [None req-7b2b8af3-7edf-4464-965e-b6680031554a tempest-TestVolumeBootPattern-1304354335 tempest-TestVolumeBootPattern-1304354335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab469b18ce0444d9884cdddc34ef7247', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fb41c547884511893b768b833f4e90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129321) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:48:37.089592 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.policy [None req-faa4276c-c035-4864-89b3-715b868839a9 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e811736979c44b02b14fecb74c6bd7ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675272fb40d4847819f83ec04afecef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129322) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:48:37.096908 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: INFO nova.api.openstack.requestlog [None req-7b2b8af3-7edf-4464-965e-b6680031554a tempest-TestVolumeBootPattern-1304354335 tempest-TestVolumeBootPattern-1304354335-project] 10.222.0.75 "GET /compute/v2.1/servers/475179d2-21d7-4ace-90eb-e6525cb14928" status: 200 len: 1579 microversion: 2.1 time: 0.156407 May 26 12:48:37.097502 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: [pid: 129321|app: 0|req: 486/992] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 26 12:48:36 2022] GET /compute/v2.1/servers/475179d2-21d7-4ace-90eb-e6525cb14928 => generated 1579 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:48:37.101256 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.policy [None req-faa4276c-c035-4864-89b3-715b868839a9 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e811736979c44b02b14fecb74c6bd7ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675272fb40d4847819f83ec04afecef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129322) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:48:37.102649 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.policy [None req-faa4276c-c035-4864-89b3-715b868839a9 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e811736979c44b02b14fecb74c6bd7ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675272fb40d4847819f83ec04afecef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129322) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:48:37.104093 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: INFO nova.api.openstack.requestlog [None req-faa4276c-c035-4864-89b3-715b868839a9 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] 10.222.0.75 "GET /compute/v2.1/servers/f44f180b-9143-43d6-b9cd-ced0c42fd928" status: 200 len: 1732 microversion: 2.20 time: 0.168631 May 26 12:48:37.104738 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: [pid: 129322|app: 0|req: 507/993] 10.222.0.75 () {60 vars in 1276 bytes} [Thu May 26 12:48:36 2022] GET /compute/v2.1/servers/f44f180b-9143-43d6-b9cd-ced0c42fd928 => generated 1732 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 12:48:38.116073 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi [None req-594e690d-d343-4140-ad24-8d3f43ccef12 tempest-TestVolumeBootPattern-1304354335 tempest-TestVolumeBootPattern-1304354335-project] Calling method '>' {{(pid=129321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:48:38.116777 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.compute.api [None req-594e690d-d343-4140-ad24-8d3f43ccef12 tempest-TestVolumeBootPattern-1304354335 tempest-TestVolumeBootPattern-1304354335-project] [instance: 475179d2-21d7-4ace-90eb-e6525cb14928] Fetching instance by UUID {{(pid=129321) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:48:38.126634 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-594e690d-d343-4140-ad24-8d3f43ccef12 tempest-TestVolumeBootPattern-1304354335 tempest-TestVolumeBootPattern-1304354335-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:48:38.127225 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi [None req-49e065e1-e505-443a-af69-8db6867152a1 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Calling method '>' {{(pid=129322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:48:38.128259 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-594e690d-d343-4140-ad24-8d3f43ccef12 tempest-TestVolumeBootPattern-1304354335 tempest-TestVolumeBootPattern-1304354335-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:48:38.128519 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.compute.api [None req-49e065e1-e505-443a-af69-8db6867152a1 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] [instance: f44f180b-9143-43d6-b9cd-ced0c42fd928] Fetching instance by UUID {{(pid=129322) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:48:38.128769 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-594e690d-d343-4140-ad24-8d3f43ccef12 tempest-TestVolumeBootPattern-1304354335 tempest-TestVolumeBootPattern-1304354335-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:48:38.129011 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-594e690d-d343-4140-ad24-8d3f43ccef12 tempest-TestVolumeBootPattern-1304354335 tempest-TestVolumeBootPattern-1304354335-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:48:38.140629 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-49e065e1-e505-443a-af69-8db6867152a1 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:48:38.141222 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-49e065e1-e505-443a-af69-8db6867152a1 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:48:38.142013 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-49e065e1-e505-443a-af69-8db6867152a1 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:48:38.142452 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-49e065e1-e505-443a-af69-8db6867152a1 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:48:38.272250 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.policy [None req-594e690d-d343-4140-ad24-8d3f43ccef12 tempest-TestVolumeBootPattern-1304354335 tempest-TestVolumeBootPattern-1304354335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab469b18ce0444d9884cdddc34ef7247', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fb41c547884511893b768b833f4e90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129321) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:48:38.280791 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: INFO nova.api.openstack.requestlog [None req-594e690d-d343-4140-ad24-8d3f43ccef12 tempest-TestVolumeBootPattern-1304354335 tempest-TestVolumeBootPattern-1304354335-project] 10.222.0.75 "GET /compute/v2.1/servers/475179d2-21d7-4ace-90eb-e6525cb14928" status: 200 len: 1579 microversion: 2.1 time: 0.169540 May 26 12:48:38.287595 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: [pid: 129321|app: 0|req: 487/994] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 26 12:48:38 2022] GET /compute/v2.1/servers/475179d2-21d7-4ace-90eb-e6525cb14928 => generated 1579 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:48:38.287954 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.policy [None req-49e065e1-e505-443a-af69-8db6867152a1 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e811736979c44b02b14fecb74c6bd7ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675272fb40d4847819f83ec04afecef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129322) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:48:38.293890 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.policy [None req-49e065e1-e505-443a-af69-8db6867152a1 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e811736979c44b02b14fecb74c6bd7ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675272fb40d4847819f83ec04afecef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129322) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:48:38.295391 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.policy [None req-49e065e1-e505-443a-af69-8db6867152a1 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e811736979c44b02b14fecb74c6bd7ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675272fb40d4847819f83ec04afecef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129322) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:48:38.296656 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: INFO nova.api.openstack.requestlog [None req-49e065e1-e505-443a-af69-8db6867152a1 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] 10.222.0.75 "GET /compute/v2.1/servers/f44f180b-9143-43d6-b9cd-ced0c42fd928" status: 200 len: 1732 microversion: 2.20 time: 0.176096 May 26 12:48:38.297225 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: [pid: 129322|app: 0|req: 508/995] 10.222.0.75 () {60 vars in 1276 bytes} [Thu May 26 12:48:38 2022] GET /compute/v2.1/servers/f44f180b-9143-43d6-b9cd-ced0c42fd928 => generated 1732 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 12:48:39.300558 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi [None req-23d2ee54-4a35-42b6-8a05-b7b3905399ee tempest-TestVolumeBootPattern-1304354335 tempest-TestVolumeBootPattern-1304354335-project] Calling method '>' {{(pid=129322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:48:39.301997 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.compute.api [None req-23d2ee54-4a35-42b6-8a05-b7b3905399ee tempest-TestVolumeBootPattern-1304354335 tempest-TestVolumeBootPattern-1304354335-project] [instance: 475179d2-21d7-4ace-90eb-e6525cb14928] Fetching instance by UUID {{(pid=129322) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:48:39.309440 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-23d2ee54-4a35-42b6-8a05-b7b3905399ee tempest-TestVolumeBootPattern-1304354335 tempest-TestVolumeBootPattern-1304354335-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:48:39.310237 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-23d2ee54-4a35-42b6-8a05-b7b3905399ee tempest-TestVolumeBootPattern-1304354335 tempest-TestVolumeBootPattern-1304354335-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:48:39.311403 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-23d2ee54-4a35-42b6-8a05-b7b3905399ee tempest-TestVolumeBootPattern-1304354335 tempest-TestVolumeBootPattern-1304354335-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:48:39.312047 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-23d2ee54-4a35-42b6-8a05-b7b3905399ee tempest-TestVolumeBootPattern-1304354335 tempest-TestVolumeBootPattern-1304354335-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:48:39.381600 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi [req-4d9d2eb2-977e-476d-8fd2-8b863da5dbae req-5b2d6073-3b83-4d42-b735-0c2797fbf1e3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "475179d2-21d7-4ace-90eb-e6525cb14928", "name": "network-vif-deleted", "tag": "ee0c6b40-1d57-4fbb-97a8-db624e2f3d50"}]} {{(pid=129321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 12:48:39.390846 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [req-4d9d2eb2-977e-476d-8fd2-8b863da5dbae req-5b2d6073-3b83-4d42-b735-0c2797fbf1e3 service nova] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:48:39.391652 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [req-4d9d2eb2-977e-476d-8fd2-8b863da5dbae req-5b2d6073-3b83-4d42-b735-0c2797fbf1e3 service nova] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:48:39.405684 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: INFO nova.api.openstack.compute.server_external_events [req-4d9d2eb2-977e-476d-8fd2-8b863da5dbae req-5b2d6073-3b83-4d42-b735-0c2797fbf1e3 service nova] Creating event network-vif-deleted:ee0c6b40-1d57-4fbb-97a8-db624e2f3d50 for instance 475179d2-21d7-4ace-90eb-e6525cb14928 on hv-cinder-81966 May 26 12:48:39.412539 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: INFO nova.api.openstack.requestlog [req-4d9d2eb2-977e-476d-8fd2-8b863da5dbae req-5b2d6073-3b83-4d42-b735-0c2797fbf1e3 service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.121636 May 26 12:48:39.419857 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: [pid: 129321|app: 0|req: 488/996] 10.222.0.75 () {64 vars in 1317 bytes} [Thu May 26 12:48:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 12:48:39.426280 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi [None req-1e200b5c-635a-4306-ae30-353cefb76a48 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Calling method '>' {{(pid=129321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:48:39.426984 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.compute.api [None req-1e200b5c-635a-4306-ae30-353cefb76a48 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] [instance: f44f180b-9143-43d6-b9cd-ced0c42fd928] Fetching instance by UUID {{(pid=129321) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:48:39.434164 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-1e200b5c-635a-4306-ae30-353cefb76a48 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:48:39.435328 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-1e200b5c-635a-4306-ae30-353cefb76a48 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:48:39.436530 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-1e200b5c-635a-4306-ae30-353cefb76a48 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:48:39.437336 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-1e200b5c-635a-4306-ae30-353cefb76a48 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:48:39.486350 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.policy [None req-23d2ee54-4a35-42b6-8a05-b7b3905399ee tempest-TestVolumeBootPattern-1304354335 tempest-TestVolumeBootPattern-1304354335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab469b18ce0444d9884cdddc34ef7247', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fb41c547884511893b768b833f4e90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129322) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:48:39.501958 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: INFO nova.api.openstack.requestlog [None req-23d2ee54-4a35-42b6-8a05-b7b3905399ee tempest-TestVolumeBootPattern-1304354335 tempest-TestVolumeBootPattern-1304354335-project] 10.222.0.75 "GET /compute/v2.1/servers/475179d2-21d7-4ace-90eb-e6525cb14928" status: 200 len: 1511 microversion: 2.1 time: 0.206339 May 26 12:48:39.516360 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: [pid: 129322|app: 0|req: 509/997] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 26 12:48:39 2022] GET /compute/v2.1/servers/475179d2-21d7-4ace-90eb-e6525cb14928 => generated 1511 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:48:39.602623 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.policy [None req-1e200b5c-635a-4306-ae30-353cefb76a48 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e811736979c44b02b14fecb74c6bd7ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675272fb40d4847819f83ec04afecef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129321) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:48:39.611747 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.policy [None req-1e200b5c-635a-4306-ae30-353cefb76a48 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e811736979c44b02b14fecb74c6bd7ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675272fb40d4847819f83ec04afecef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129321) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:48:39.613650 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.policy [None req-1e200b5c-635a-4306-ae30-353cefb76a48 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e811736979c44b02b14fecb74c6bd7ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675272fb40d4847819f83ec04afecef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129321) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:48:39.615074 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: INFO nova.api.openstack.requestlog [None req-1e200b5c-635a-4306-ae30-353cefb76a48 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] 10.222.0.75 "GET /compute/v2.1/servers/f44f180b-9143-43d6-b9cd-ced0c42fd928" status: 200 len: 1732 microversion: 2.20 time: 0.193800 May 26 12:48:39.615886 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: [pid: 129321|app: 0|req: 489/998] 10.222.0.75 () {60 vars in 1276 bytes} [Thu May 26 12:48:39 2022] GET /compute/v2.1/servers/f44f180b-9143-43d6-b9cd-ced0c42fd928 => generated 1732 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 12:48:39.699651 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi [req-97d0ed1c-e543-4a36-befc-d9ab4df33f10 req-7cefb19a-7a5c-4870-bd6d-eca3b521232d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f44f180b-9143-43d6-b9cd-ced0c42fd928", "name": "network-vif-plugged", "status": "completed", "tag": "f9559056-2d17-4245-b9b6-e29db32c9ee2"}]} {{(pid=129322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 12:48:39.708967 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [req-97d0ed1c-e543-4a36-befc-d9ab4df33f10 req-7cefb19a-7a5c-4870-bd6d-eca3b521232d service nova] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:48:39.709719 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [req-97d0ed1c-e543-4a36-befc-d9ab4df33f10 req-7cefb19a-7a5c-4870-bd6d-eca3b521232d service nova] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:48:39.727344 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: INFO nova.api.openstack.compute.server_external_events [req-97d0ed1c-e543-4a36-befc-d9ab4df33f10 req-7cefb19a-7a5c-4870-bd6d-eca3b521232d service nova] Creating event network-vif-plugged:f9559056-2d17-4245-b9b6-e29db32c9ee2 for instance f44f180b-9143-43d6-b9cd-ced0c42fd928 on hv-cinder-81966 May 26 12:48:39.735997 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: INFO nova.api.openstack.requestlog [req-97d0ed1c-e543-4a36-befc-d9ab4df33f10 req-7cefb19a-7a5c-4870-bd6d-eca3b521232d service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040329 May 26 12:48:39.737035 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: [pid: 129322|app: 0|req: 510/999] 10.222.0.75 () {64 vars in 1317 bytes} [Thu May 26 12:48:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 12:48:40.527696 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi [None req-025f5bb0-5726-44d3-af0e-5c57f5a8c837 tempest-TestVolumeBootPattern-1304354335 tempest-TestVolumeBootPattern-1304354335-project] Calling method '>' {{(pid=129321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:48:40.528234 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.compute.api [None req-025f5bb0-5726-44d3-af0e-5c57f5a8c837 tempest-TestVolumeBootPattern-1304354335 tempest-TestVolumeBootPattern-1304354335-project] [instance: 475179d2-21d7-4ace-90eb-e6525cb14928] Fetching instance by UUID {{(pid=129321) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:48:40.531906 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG dbcounter [-] [129321] Writing DB stats nova_api:SELECT=45,nova_api:UPDATE=1 {{(pid=129321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:48:40.536181 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-025f5bb0-5726-44d3-af0e-5c57f5a8c837 tempest-TestVolumeBootPattern-1304354335 tempest-TestVolumeBootPattern-1304354335-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:48:40.536623 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-025f5bb0-5726-44d3-af0e-5c57f5a8c837 tempest-TestVolumeBootPattern-1304354335 tempest-TestVolumeBootPattern-1304354335-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:48:40.537384 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-025f5bb0-5726-44d3-af0e-5c57f5a8c837 tempest-TestVolumeBootPattern-1304354335 tempest-TestVolumeBootPattern-1304354335-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:48:40.537814 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-025f5bb0-5726-44d3-af0e-5c57f5a8c837 tempest-TestVolumeBootPattern-1304354335 tempest-TestVolumeBootPattern-1304354335-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:48:40.553704 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: INFO nova.api.openstack.wsgi [None req-025f5bb0-5726-44d3-af0e-5c57f5a8c837 tempest-TestVolumeBootPattern-1304354335 tempest-TestVolumeBootPattern-1304354335-project] HTTP exception thrown: Instance 475179d2-21d7-4ace-90eb-e6525cb14928 could not be found. May 26 12:48:40.555351 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi [None req-025f5bb0-5726-44d3-af0e-5c57f5a8c837 tempest-TestVolumeBootPattern-1304354335 tempest-TestVolumeBootPattern-1304354335-project] Request method failure captured: May 26 12:48:40.555351 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: request: GET /compute/v2.1/servers/475179d2-21d7-4ace-90eb-e6525cb14928 HTTP/1.1 May 26 12:48:40.555351 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: Accept: application/json May 26 12:48:40.555351 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: Accept-Encoding: identity May 26 12:48:40.555351 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: Connection: close May 26 12:48:40.555351 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: Content-Length: 0 May 26 12:48:40.555351 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: Content-Type: application/json May 26 12:48:40.555351 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: Host: 10.222.0.75 May 26 12:48:40.555351 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: Openstack-System-Scope: None May 26 12:48:40.555351 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: User-Agent: python-urllib3/1.26.9 May 26 12:48:40.555351 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: X-Auth-Token: gAAAAABij3ZYnnQSOjd0sWax7VYUWN6gzPhz8PA68yBKbpbl44ztpHdpGCRT5OTjH4mK7k5RUbM9n2BHMaQqTaPiaGVVrYiHYtBG0MmM1aMhd-X0oiDBwHF_1in7JqJZE2_08VQXydhfFCXEAAaHZONGGU73Q7O2hxQn12upcSRYehzmIlzQIBo May 26 12:48:40.555351 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: X-Domain-Id: None May 26 12:48:40.555351 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: X-Domain-Name: None May 26 12:48:40.555351 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: X-Identity-Status: Confirmed May 26 12:48:40.555351 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: X-Is-Admin-Project: True May 26 12:48:40.555351 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: X-Project-Domain-Id: default May 26 12:48:40.555351 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: X-Project-Domain-Name: Default May 26 12:48:40.555351 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: X-Project-Id: d6fb41c547884511893b768b833f4e90 May 26 12:48:40.555351 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: X-Project-Name: tempest-TestVolumeBootPattern-1304354335 May 26 12:48:40.555351 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: X-Role: member,reader May 26 12:48:40.555351 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: X-Roles: member,reader May 26 12:48:40.557227 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/d6fb41c547884511893b768b833f4e90"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.75:8080", "publicURL": "http://10.222.0.75:8080/v1/AUTH_d6fb41c547884511893b768b833f4e90"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2/d6fb41c547884511893b768b833f4e90"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/d6fb41c547884511893b768b833f4e90"}]}] May 26 12:48:40.557227 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: X-Tenant: tempest-TestVolumeBootPattern-1304354335 May 26 12:48:40.557227 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: X-Tenant-Id: d6fb41c547884511893b768b833f4e90 May 26 12:48:40.557227 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: X-Tenant-Name: tempest-TestVolumeBootPattern-1304354335 May 26 12:48:40.557227 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: X-User: tempest-TestVolumeBootPattern-1304354335-project May 26 12:48:40.557227 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: X-User-Domain-Id: default May 26 12:48:40.557227 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: X-User-Domain-Name: Default May 26 12:48:40.557227 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: X-User-Id: ab469b18ce0444d9884cdddc34ef7247 May 26 12:48:40.557227 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: X-User-Name: tempest-TestVolumeBootPattern-1304354335-project May 26 12:48:40.557227 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: method: > May 26 12:48:40.557227 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: exception: Instance 475179d2-21d7-4ace-90eb-e6525cb14928 could not be found. May 26 12:48:40.557227 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: action_args: {'id': '475179d2-21d7-4ace-90eb-e6525cb14928'} May 26 12:48:40.558355 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: {{(pid=129321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 12:48:40.558355 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 12:48:40.558355 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 26 12:48:40.558355 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 26 12:48:40.558355 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 26 12:48:40.558355 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 26 12:48:40.558355 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 26 12:48:40.558355 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 26 12:48:40.558355 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 26 12:48:40.558355 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 26 12:48:40.558355 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 475179d2-21d7-4ace-90eb-e6525cb14928 could not be found. May 26 12:48:40.558355 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi May 26 12:48:40.558355 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 12:48:40.558355 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi May 26 12:48:40.558355 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 12:48:40.558355 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 12:48:40.558355 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 12:48:40.558355 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 12:48:40.558355 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 12:48:40.558355 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 12:48:40.559673 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 12:48:40.559673 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 26 12:48:40.559673 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 26 12:48:40.559673 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 26 12:48:40.559673 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 26 12:48:40.559673 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 26 12:48:40.559673 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 12:48:40.559673 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 475179d2-21d7-4ace-90eb-e6525cb14928 could not be found. May 26 12:48:40.559673 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi May 26 12:48:40.559673 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 12:48:40.559673 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi May 26 12:48:40.559673 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 12:48:40.559673 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 12:48:40.559673 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 12:48:40.559673 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 12:48:40.559673 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 12:48:40.559673 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 475179d2-21d7-4ace-90eb-e6525cb14928 could not be found. May 26 12:48:40.559673 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi May 26 12:48:40.560927 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi [None req-025f5bb0-5726-44d3-af0e-5c57f5a8c837 tempest-TestVolumeBootPattern-1304354335 tempest-TestVolumeBootPattern-1304354335-project] Returning 404 to user: Instance 475179d2-21d7-4ace-90eb-e6525cb14928 could not be found. {{(pid=129321) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 12:48:40.560927 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: INFO nova.api.openstack.requestlog [None req-025f5bb0-5726-44d3-af0e-5c57f5a8c837 tempest-TestVolumeBootPattern-1304354335 tempest-TestVolumeBootPattern-1304354335-project] 10.222.0.75 "GET /compute/v2.1/servers/475179d2-21d7-4ace-90eb-e6525cb14928" status: 404 len: 111 microversion: 2.1 time: 0.033459 May 26 12:48:40.560927 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: [pid: 129321|app: 0|req: 490/1000] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 26 12:48:40 2022] GET /compute/v2.1/servers/475179d2-21d7-4ace-90eb-e6525cb14928 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 26 12:48:40.636024 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi [None req-b35ff17c-34ce-4b73-a423-d951d9303d65 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Calling method '>' {{(pid=129322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:48:40.636933 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.compute.api [None req-b35ff17c-34ce-4b73-a423-d951d9303d65 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] [instance: f44f180b-9143-43d6-b9cd-ced0c42fd928] Fetching instance by UUID {{(pid=129322) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:48:40.643843 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-b35ff17c-34ce-4b73-a423-d951d9303d65 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:48:40.644409 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-b35ff17c-34ce-4b73-a423-d951d9303d65 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:48:40.645293 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-b35ff17c-34ce-4b73-a423-d951d9303d65 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:48:40.645966 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-b35ff17c-34ce-4b73-a423-d951d9303d65 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:48:40.671692 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi [None req-9440216d-9cb1-45fe-9873-81767b6f13dd tempest-TestVolumeBootPattern-1304354335 tempest-TestVolumeBootPattern-1304354335-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1199728812", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-172235393", "security_groups": [{"name": "tempest-secgroup-smoke-1960816556"}], "block_device_mapping_v2": [{"uuid": "ddb8ef91-5192-4abd-a66e-45eb1481a8a0", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "7eee456a-a9f6-42d0-bed8-fc7419b250fe"}]}} {{(pid=129321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 12:48:40.804676 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.policy [None req-b35ff17c-34ce-4b73-a423-d951d9303d65 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e811736979c44b02b14fecb74c6bd7ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675272fb40d4847819f83ec04afecef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129322) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:48:40.808668 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.network.neutron [None req-9440216d-9cb1-45fe-9873-81767b6f13dd tempest-TestVolumeBootPattern-1304354335 tempest-TestVolumeBootPattern-1304354335-project] validate_networks() for [('7eee456a-a9f6-42d0-bed8-fc7419b250fe', None, None, None, None, None)] {{(pid=129321) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 26 12:48:40.815084 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.policy [None req-b35ff17c-34ce-4b73-a423-d951d9303d65 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e811736979c44b02b14fecb74c6bd7ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675272fb40d4847819f83ec04afecef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129322) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:48:40.816641 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.policy [None req-b35ff17c-34ce-4b73-a423-d951d9303d65 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e811736979c44b02b14fecb74c6bd7ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675272fb40d4847819f83ec04afecef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129322) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:48:40.817845 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: INFO nova.api.openstack.requestlog [None req-b35ff17c-34ce-4b73-a423-d951d9303d65 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] 10.222.0.75 "GET /compute/v2.1/servers/f44f180b-9143-43d6-b9cd-ced0c42fd928" status: 200 len: 1732 microversion: 2.20 time: 0.186759 May 26 12:48:40.818415 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: [pid: 129322|app: 0|req: 511/1001] 10.222.0.75 () {60 vars in 1276 bytes} [Thu May 26 12:48:40 2022] GET /compute/v2.1/servers/f44f180b-9143-43d6-b9cd-ced0c42fd928 => generated 1732 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 12:48:41.522445 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.virt.hardware [None req-9440216d-9cb1-45fe-9873-81767b6f13dd tempest-TestVolumeBootPattern-1304354335 tempest-TestVolumeBootPattern-1304354335-project] Flavor limits 0:0:0 {{(pid=129321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 26 12:48:41.522871 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.virt.hardware [None req-9440216d-9cb1-45fe-9873-81767b6f13dd tempest-TestVolumeBootPattern-1304354335 tempest-TestVolumeBootPattern-1304354335-project] Image limits 0:0:0 {{(pid=129321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 26 12:48:41.523409 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.virt.hardware [None req-9440216d-9cb1-45fe-9873-81767b6f13dd tempest-TestVolumeBootPattern-1304354335 tempest-TestVolumeBootPattern-1304354335-project] Flavor pref 0:0:0 {{(pid=129321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 26 12:48:41.523969 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.virt.hardware [None req-9440216d-9cb1-45fe-9873-81767b6f13dd tempest-TestVolumeBootPattern-1304354335 tempest-TestVolumeBootPattern-1304354335-project] Image pref 0:0:0 {{(pid=129321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 26 12:48:41.524381 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.virt.hardware [None req-9440216d-9cb1-45fe-9873-81767b6f13dd tempest-TestVolumeBootPattern-1304354335 tempest-TestVolumeBootPattern-1304354335-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 26 12:48:41.535127 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-9440216d-9cb1-45fe-9873-81767b6f13dd tempest-TestVolumeBootPattern-1304354335 tempest-TestVolumeBootPattern-1304354335-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:48:41.535883 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-9440216d-9cb1-45fe-9873-81767b6f13dd tempest-TestVolumeBootPattern-1304354335 tempest-TestVolumeBootPattern-1304354335-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:48:41.536415 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-9440216d-9cb1-45fe-9873-81767b6f13dd tempest-TestVolumeBootPattern-1304354335 tempest-TestVolumeBootPattern-1304354335-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:48:41.536851 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-9440216d-9cb1-45fe-9873-81767b6f13dd tempest-TestVolumeBootPattern-1304354335 tempest-TestVolumeBootPattern-1304354335-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:48:41.554576 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.quota [None req-9440216d-9cb1-45fe-9873-81767b6f13dd tempest-TestVolumeBootPattern-1304354335 tempest-TestVolumeBootPattern-1304354335-project] Getting quotas for project d6fb41c547884511893b768b833f4e90. Resources: {'instances', 'cores', 'ram'} {{(pid=129321) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 26 12:48:41.558841 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.quota [None req-9440216d-9cb1-45fe-9873-81767b6f13dd tempest-TestVolumeBootPattern-1304354335 tempest-TestVolumeBootPattern-1304354335-project] Getting quotas for user ab469b18ce0444d9884cdddc34ef7247 and project d6fb41c547884511893b768b833f4e90. Resources: {'instances', 'cores', 'ram'} {{(pid=129321) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 26 12:48:41.617536 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.compute.api [None req-9440216d-9cb1-45fe-9873-81767b6f13dd tempest-TestVolumeBootPattern-1304354335 tempest-TestVolumeBootPattern-1304354335-project] Going to run 1 instances... {{(pid=129321) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 26 12:48:41.619676 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.compute.api [None req-9440216d-9cb1-45fe-9873-81767b6f13dd tempest-TestVolumeBootPattern-1304354335 tempest-TestVolumeBootPattern-1304354335-project] [instance: 91eb2cfb-795d-4d5c-8921-892b58ae4fa6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='ddb8ef91-5192-4abd-a66e-45eb1481a8a0',volume_size=None,volume_type=None)] {{(pid=129321) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 26 12:48:41.760732 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: INFO nova.api.openstack.requestlog [None req-9440216d-9cb1-45fe-9873-81767b6f13dd tempest-TestVolumeBootPattern-1304354335 tempest-TestVolumeBootPattern-1304354335-project] 10.222.0.75 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.093990 May 26 12:48:41.761532 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: [pid: 129321|app: 0|req: 491/1002] 10.222.0.75 () {60 vars in 1146 bytes} [Thu May 26 12:48:40 2022] POST /compute/v2.1/servers => generated 406 bytes in 1095 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) May 26 12:48:41.772395 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi [None req-5d618e59-4dfd-4f4a-a29c-847da00635d7 tempest-TestVolumeBootPattern-1304354335 tempest-TestVolumeBootPattern-1304354335-project] Calling method '>' {{(pid=129322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:48:41.772990 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.compute.api [None req-5d618e59-4dfd-4f4a-a29c-847da00635d7 tempest-TestVolumeBootPattern-1304354335 tempest-TestVolumeBootPattern-1304354335-project] [instance: 91eb2cfb-795d-4d5c-8921-892b58ae4fa6] Fetching instance by UUID {{(pid=129322) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:48:41.830438 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.policy [None req-5d618e59-4dfd-4f4a-a29c-847da00635d7 tempest-TestVolumeBootPattern-1304354335 tempest-TestVolumeBootPattern-1304354335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab469b18ce0444d9884cdddc34ef7247', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fb41c547884511893b768b833f4e90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129322) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:48:41.837760 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi [None req-4a5b8c43-a874-4f36-96a1-6731aa5dbca4 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Calling method '>' {{(pid=129321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:48:41.838368 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.compute.api [None req-4a5b8c43-a874-4f36-96a1-6731aa5dbca4 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] [instance: f44f180b-9143-43d6-b9cd-ced0c42fd928] Fetching instance by UUID {{(pid=129321) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:48:41.838524 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: INFO nova.api.openstack.requestlog [None req-5d618e59-4dfd-4f4a-a29c-847da00635d7 tempest-TestVolumeBootPattern-1304354335 tempest-TestVolumeBootPattern-1304354335-project] 10.222.0.75 "GET /compute/v2.1/servers/91eb2cfb-795d-4d5c-8921-892b58ae4fa6" status: 200 len: 1094 microversion: 2.1 time: 0.070362 May 26 12:48:41.839108 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: [pid: 129322|app: 0|req: 512/1003] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 26 12:48:41 2022] GET /compute/v2.1/servers/91eb2cfb-795d-4d5c-8921-892b58ae4fa6 => generated 1094 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:48:41.848287 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-4a5b8c43-a874-4f36-96a1-6731aa5dbca4 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:48:41.848287 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-4a5b8c43-a874-4f36-96a1-6731aa5dbca4 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:48:41.848992 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-4a5b8c43-a874-4f36-96a1-6731aa5dbca4 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:48:41.849748 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-4a5b8c43-a874-4f36-96a1-6731aa5dbca4 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:48:41.993986 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.policy [None req-4a5b8c43-a874-4f36-96a1-6731aa5dbca4 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e811736979c44b02b14fecb74c6bd7ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675272fb40d4847819f83ec04afecef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129321) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:48:42.003791 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.policy [None req-4a5b8c43-a874-4f36-96a1-6731aa5dbca4 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e811736979c44b02b14fecb74c6bd7ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675272fb40d4847819f83ec04afecef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129321) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:48:42.005260 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.policy [None req-4a5b8c43-a874-4f36-96a1-6731aa5dbca4 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e811736979c44b02b14fecb74c6bd7ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675272fb40d4847819f83ec04afecef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129321) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:48:42.006478 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: INFO nova.api.openstack.requestlog [None req-4a5b8c43-a874-4f36-96a1-6731aa5dbca4 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] 10.222.0.75 "GET /compute/v2.1/servers/f44f180b-9143-43d6-b9cd-ced0c42fd928" status: 200 len: 1732 microversion: 2.20 time: 0.172743 May 26 12:48:42.007496 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: [pid: 129321|app: 0|req: 492/1004] 10.222.0.75 () {60 vars in 1276 bytes} [Thu May 26 12:48:41 2022] GET /compute/v2.1/servers/f44f180b-9143-43d6-b9cd-ced0c42fd928 => generated 1732 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 26 12:48:42.856748 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi [None req-f6c72bf6-1226-463f-9df4-36b03ab3eaa4 tempest-TestVolumeBootPattern-1304354335 tempest-TestVolumeBootPattern-1304354335-project] Calling method '>' {{(pid=129322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:48:42.857557 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.compute.api [None req-f6c72bf6-1226-463f-9df4-36b03ab3eaa4 tempest-TestVolumeBootPattern-1304354335 tempest-TestVolumeBootPattern-1304354335-project] [instance: 91eb2cfb-795d-4d5c-8921-892b58ae4fa6] Fetching instance by UUID {{(pid=129322) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:48:42.865781 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-f6c72bf6-1226-463f-9df4-36b03ab3eaa4 tempest-TestVolumeBootPattern-1304354335 tempest-TestVolumeBootPattern-1304354335-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:48:42.866361 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-f6c72bf6-1226-463f-9df4-36b03ab3eaa4 tempest-TestVolumeBootPattern-1304354335 tempest-TestVolumeBootPattern-1304354335-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:48:42.867502 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-f6c72bf6-1226-463f-9df4-36b03ab3eaa4 tempest-TestVolumeBootPattern-1304354335 tempest-TestVolumeBootPattern-1304354335-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:48:42.868171 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-f6c72bf6-1226-463f-9df4-36b03ab3eaa4 tempest-TestVolumeBootPattern-1304354335 tempest-TestVolumeBootPattern-1304354335-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:48:42.964528 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.policy [None req-f6c72bf6-1226-463f-9df4-36b03ab3eaa4 tempest-TestVolumeBootPattern-1304354335 tempest-TestVolumeBootPattern-1304354335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab469b18ce0444d9884cdddc34ef7247', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fb41c547884511893b768b833f4e90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129322) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:48:42.978152 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: INFO nova.api.openstack.requestlog [None req-f6c72bf6-1226-463f-9df4-36b03ab3eaa4 tempest-TestVolumeBootPattern-1304354335 tempest-TestVolumeBootPattern-1304354335-project] 10.222.0.75 "GET /compute/v2.1/servers/91eb2cfb-795d-4d5c-8921-892b58ae4fa6" status: 200 len: 1192 microversion: 2.1 time: 0.125383 May 26 12:48:42.979183 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: [pid: 129322|app: 0|req: 513/1005] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 26 12:48:42 2022] GET /compute/v2.1/servers/91eb2cfb-795d-4d5c-8921-892b58ae4fa6 => generated 1192 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:48:43.026766 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi [None req-720936af-8be4-40d9-8c0f-46ac89e23681 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Calling method '>' {{(pid=129321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:48:43.027719 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.compute.api [None req-720936af-8be4-40d9-8c0f-46ac89e23681 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] [instance: f44f180b-9143-43d6-b9cd-ced0c42fd928] Fetching instance by UUID {{(pid=129321) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:48:43.035370 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-720936af-8be4-40d9-8c0f-46ac89e23681 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:48:43.035861 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-720936af-8be4-40d9-8c0f-46ac89e23681 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:48:43.036634 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-720936af-8be4-40d9-8c0f-46ac89e23681 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:48:43.037080 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-720936af-8be4-40d9-8c0f-46ac89e23681 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:48:43.281796 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.policy [None req-720936af-8be4-40d9-8c0f-46ac89e23681 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e811736979c44b02b14fecb74c6bd7ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675272fb40d4847819f83ec04afecef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129321) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:48:43.291275 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.policy [None req-720936af-8be4-40d9-8c0f-46ac89e23681 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e811736979c44b02b14fecb74c6bd7ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675272fb40d4847819f83ec04afecef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129321) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:48:43.293380 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.policy [None req-720936af-8be4-40d9-8c0f-46ac89e23681 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e811736979c44b02b14fecb74c6bd7ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675272fb40d4847819f83ec04afecef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129321) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:48:43.294570 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: INFO nova.api.openstack.requestlog [None req-720936af-8be4-40d9-8c0f-46ac89e23681 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] 10.222.0.75 "GET /compute/v2.1/servers/f44f180b-9143-43d6-b9cd-ced0c42fd928" status: 200 len: 1719 microversion: 2.20 time: 0.272443 May 26 12:48:43.295117 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: [pid: 129321|app: 0|req: 493/1006] 10.222.0.75 () {60 vars in 1276 bytes} [Thu May 26 12:48:43 2022] GET /compute/v2.1/servers/f44f180b-9143-43d6-b9cd-ced0c42fd928 => generated 1719 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 12:48:43.996716 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi [None req-bb925114-07d8-4ed4-bd97-17760a073d56 tempest-TestVolumeBootPattern-1304354335 tempest-TestVolumeBootPattern-1304354335-project] Calling method '>' {{(pid=129322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:48:43.998148 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.compute.api [None req-bb925114-07d8-4ed4-bd97-17760a073d56 tempest-TestVolumeBootPattern-1304354335 tempest-TestVolumeBootPattern-1304354335-project] [instance: 91eb2cfb-795d-4d5c-8921-892b58ae4fa6] Fetching instance by UUID {{(pid=129322) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:48:44.005030 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-bb925114-07d8-4ed4-bd97-17760a073d56 tempest-TestVolumeBootPattern-1304354335 tempest-TestVolumeBootPattern-1304354335-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:48:44.005500 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-bb925114-07d8-4ed4-bd97-17760a073d56 tempest-TestVolumeBootPattern-1304354335 tempest-TestVolumeBootPattern-1304354335-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:48:44.006272 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-bb925114-07d8-4ed4-bd97-17760a073d56 tempest-TestVolumeBootPattern-1304354335 tempest-TestVolumeBootPattern-1304354335-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:48:44.006699 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-bb925114-07d8-4ed4-bd97-17760a073d56 tempest-TestVolumeBootPattern-1304354335 tempest-TestVolumeBootPattern-1304354335-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:48:44.150855 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.policy [None req-bb925114-07d8-4ed4-bd97-17760a073d56 tempest-TestVolumeBootPattern-1304354335 tempest-TestVolumeBootPattern-1304354335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab469b18ce0444d9884cdddc34ef7247', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fb41c547884511893b768b833f4e90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129322) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:48:44.158438 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: INFO nova.api.openstack.requestlog [None req-bb925114-07d8-4ed4-bd97-17760a073d56 tempest-TestVolumeBootPattern-1304354335 tempest-TestVolumeBootPattern-1304354335-project] 10.222.0.75 "GET /compute/v2.1/servers/91eb2cfb-795d-4d5c-8921-892b58ae4fa6" status: 200 len: 1266 microversion: 2.1 time: 0.166348 May 26 12:48:44.159020 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: [pid: 129322|app: 0|req: 514/1007] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 26 12:48:43 2022] GET /compute/v2.1/servers/91eb2cfb-795d-4d5c-8921-892b58ae4fa6 => generated 1266 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:48:44.577860 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi [req-fe440c09-b8c6-4a9e-8c36-46231aa82a72 req-8f36cbf6-342d-4d00-83bc-7815679cdb13 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "91eb2cfb-795d-4d5c-8921-892b58ae4fa6", "tag": "fefc8d50-0c80-4088-adf1-045e8ac58366"}]} {{(pid=129321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 12:48:44.592590 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [req-fe440c09-b8c6-4a9e-8c36-46231aa82a72 req-8f36cbf6-342d-4d00-83bc-7815679cdb13 service nova] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:48:44.600699 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [req-fe440c09-b8c6-4a9e-8c36-46231aa82a72 req-8f36cbf6-342d-4d00-83bc-7815679cdb13 service nova] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:48:44.615814 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: INFO nova.api.openstack.compute.server_external_events [req-fe440c09-b8c6-4a9e-8c36-46231aa82a72 req-8f36cbf6-342d-4d00-83bc-7815679cdb13 service nova] Creating event network-changed:fefc8d50-0c80-4088-adf1-045e8ac58366 for instance 91eb2cfb-795d-4d5c-8921-892b58ae4fa6 on hv-cinder-81966 May 26 12:48:44.621933 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: INFO nova.api.openstack.requestlog [req-fe440c09-b8c6-4a9e-8c36-46231aa82a72 req-8f36cbf6-342d-4d00-83bc-7815679cdb13 service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049926 May 26 12:48:44.623399 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: [pid: 129321|app: 0|req: 494/1008] 10.222.0.75 () {64 vars in 1317 bytes} [Thu May 26 12:48:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 12:48:45.176225 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi [None req-c4db2d4d-3d90-4cd6-a0dc-566a26fc890d tempest-TestVolumeBootPattern-1304354335 tempest-TestVolumeBootPattern-1304354335-project] Calling method '>' {{(pid=129322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:48:45.176855 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.compute.api [None req-c4db2d4d-3d90-4cd6-a0dc-566a26fc890d tempest-TestVolumeBootPattern-1304354335 tempest-TestVolumeBootPattern-1304354335-project] [instance: 91eb2cfb-795d-4d5c-8921-892b58ae4fa6] Fetching instance by UUID {{(pid=129322) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:48:45.184265 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-c4db2d4d-3d90-4cd6-a0dc-566a26fc890d tempest-TestVolumeBootPattern-1304354335 tempest-TestVolumeBootPattern-1304354335-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:48:45.184716 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-c4db2d4d-3d90-4cd6-a0dc-566a26fc890d tempest-TestVolumeBootPattern-1304354335 tempest-TestVolumeBootPattern-1304354335-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:48:45.185494 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-c4db2d4d-3d90-4cd6-a0dc-566a26fc890d tempest-TestVolumeBootPattern-1304354335 tempest-TestVolumeBootPattern-1304354335-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:48:45.185926 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-c4db2d4d-3d90-4cd6-a0dc-566a26fc890d tempest-TestVolumeBootPattern-1304354335 tempest-TestVolumeBootPattern-1304354335-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:48:45.337260 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.policy [None req-c4db2d4d-3d90-4cd6-a0dc-566a26fc890d tempest-TestVolumeBootPattern-1304354335 tempest-TestVolumeBootPattern-1304354335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab469b18ce0444d9884cdddc34ef7247', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fb41c547884511893b768b833f4e90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129322) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:48:45.345288 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: INFO nova.api.openstack.requestlog [None req-c4db2d4d-3d90-4cd6-a0dc-566a26fc890d tempest-TestVolumeBootPattern-1304354335 tempest-TestVolumeBootPattern-1304354335-project] 10.222.0.75 "GET /compute/v2.1/servers/91eb2cfb-795d-4d5c-8921-892b58ae4fa6" status: 200 len: 1266 microversion: 2.1 time: 0.173101 May 26 12:48:45.345909 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: [pid: 129322|app: 0|req: 515/1009] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 26 12:48:45 2022] GET /compute/v2.1/servers/91eb2cfb-795d-4d5c-8921-892b58ae4fa6 => generated 1266 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:48:46.363185 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi [None req-0413e33c-6e68-4bc7-8049-d373ec876985 tempest-TestVolumeBootPattern-1304354335 tempest-TestVolumeBootPattern-1304354335-project] Calling method '>' {{(pid=129321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:48:46.363944 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.compute.api [None req-0413e33c-6e68-4bc7-8049-d373ec876985 tempest-TestVolumeBootPattern-1304354335 tempest-TestVolumeBootPattern-1304354335-project] [instance: 91eb2cfb-795d-4d5c-8921-892b58ae4fa6] Fetching instance by UUID {{(pid=129321) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:48:46.371140 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-0413e33c-6e68-4bc7-8049-d373ec876985 tempest-TestVolumeBootPattern-1304354335 tempest-TestVolumeBootPattern-1304354335-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:48:46.371597 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-0413e33c-6e68-4bc7-8049-d373ec876985 tempest-TestVolumeBootPattern-1304354335 tempest-TestVolumeBootPattern-1304354335-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:48:46.372680 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-0413e33c-6e68-4bc7-8049-d373ec876985 tempest-TestVolumeBootPattern-1304354335 tempest-TestVolumeBootPattern-1304354335-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:48:46.372972 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-0413e33c-6e68-4bc7-8049-d373ec876985 tempest-TestVolumeBootPattern-1304354335 tempest-TestVolumeBootPattern-1304354335-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:48:46.521309 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.policy [None req-0413e33c-6e68-4bc7-8049-d373ec876985 tempest-TestVolumeBootPattern-1304354335 tempest-TestVolumeBootPattern-1304354335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab469b18ce0444d9884cdddc34ef7247', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fb41c547884511893b768b833f4e90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129321) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:48:46.529305 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: INFO nova.api.openstack.requestlog [None req-0413e33c-6e68-4bc7-8049-d373ec876985 tempest-TestVolumeBootPattern-1304354335 tempest-TestVolumeBootPattern-1304354335-project] 10.222.0.75 "GET /compute/v2.1/servers/91eb2cfb-795d-4d5c-8921-892b58ae4fa6" status: 200 len: 1266 microversion: 2.1 time: 0.170341 May 26 12:48:46.529879 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: [pid: 129321|app: 0|req: 495/1010] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 26 12:48:46 2022] GET /compute/v2.1/servers/91eb2cfb-795d-4d5c-8921-892b58ae4fa6 => generated 1266 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:48:47.547064 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi [None req-fead4771-418b-4159-be44-a0a24f263b12 tempest-TestVolumeBootPattern-1304354335 tempest-TestVolumeBootPattern-1304354335-project] Calling method '>' {{(pid=129322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:48:47.548080 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.compute.api [None req-fead4771-418b-4159-be44-a0a24f263b12 tempest-TestVolumeBootPattern-1304354335 tempest-TestVolumeBootPattern-1304354335-project] [instance: 91eb2cfb-795d-4d5c-8921-892b58ae4fa6] Fetching instance by UUID {{(pid=129322) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:48:47.556959 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-fead4771-418b-4159-be44-a0a24f263b12 tempest-TestVolumeBootPattern-1304354335 tempest-TestVolumeBootPattern-1304354335-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:48:47.557558 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-fead4771-418b-4159-be44-a0a24f263b12 tempest-TestVolumeBootPattern-1304354335 tempest-TestVolumeBootPattern-1304354335-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:48:47.558633 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-fead4771-418b-4159-be44-a0a24f263b12 tempest-TestVolumeBootPattern-1304354335 tempest-TestVolumeBootPattern-1304354335-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:48:47.559153 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-fead4771-418b-4159-be44-a0a24f263b12 tempest-TestVolumeBootPattern-1304354335 tempest-TestVolumeBootPattern-1304354335-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:48:47.708605 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.policy [None req-fead4771-418b-4159-be44-a0a24f263b12 tempest-TestVolumeBootPattern-1304354335 tempest-TestVolumeBootPattern-1304354335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab469b18ce0444d9884cdddc34ef7247', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fb41c547884511893b768b833f4e90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129322) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:48:47.717595 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: INFO nova.api.openstack.requestlog [None req-fead4771-418b-4159-be44-a0a24f263b12 tempest-TestVolumeBootPattern-1304354335 tempest-TestVolumeBootPattern-1304354335-project] 10.222.0.75 "GET /compute/v2.1/servers/91eb2cfb-795d-4d5c-8921-892b58ae4fa6" status: 200 len: 1266 microversion: 2.1 time: 0.174813 May 26 12:48:47.718210 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: [pid: 129322|app: 0|req: 516/1011] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 26 12:48:47 2022] GET /compute/v2.1/servers/91eb2cfb-795d-4d5c-8921-892b58ae4fa6 => generated 1266 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:48:48.735560 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi [None req-85ebaf5b-5629-462e-af2d-0a2ca798524f tempest-TestVolumeBootPattern-1304354335 tempest-TestVolumeBootPattern-1304354335-project] Calling method '>' {{(pid=129321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:48:48.736330 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.compute.api [None req-85ebaf5b-5629-462e-af2d-0a2ca798524f tempest-TestVolumeBootPattern-1304354335 tempest-TestVolumeBootPattern-1304354335-project] [instance: 91eb2cfb-795d-4d5c-8921-892b58ae4fa6] Fetching instance by UUID {{(pid=129321) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:48:48.743458 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-85ebaf5b-5629-462e-af2d-0a2ca798524f tempest-TestVolumeBootPattern-1304354335 tempest-TestVolumeBootPattern-1304354335-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:48:48.743910 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-85ebaf5b-5629-462e-af2d-0a2ca798524f tempest-TestVolumeBootPattern-1304354335 tempest-TestVolumeBootPattern-1304354335-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:48:48.744903 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-85ebaf5b-5629-462e-af2d-0a2ca798524f tempest-TestVolumeBootPattern-1304354335 tempest-TestVolumeBootPattern-1304354335-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:48:48.745342 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-85ebaf5b-5629-462e-af2d-0a2ca798524f tempest-TestVolumeBootPattern-1304354335 tempest-TestVolumeBootPattern-1304354335-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:48:48.980327 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.policy [None req-85ebaf5b-5629-462e-af2d-0a2ca798524f tempest-TestVolumeBootPattern-1304354335 tempest-TestVolumeBootPattern-1304354335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab469b18ce0444d9884cdddc34ef7247', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fb41c547884511893b768b833f4e90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129321) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:48:48.988587 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: INFO nova.api.openstack.requestlog [None req-85ebaf5b-5629-462e-af2d-0a2ca798524f tempest-TestVolumeBootPattern-1304354335 tempest-TestVolumeBootPattern-1304354335-project] 10.222.0.75 "GET /compute/v2.1/servers/91eb2cfb-795d-4d5c-8921-892b58ae4fa6" status: 200 len: 1266 microversion: 2.1 time: 0.257563 May 26 12:48:48.989401 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: [pid: 129321|app: 0|req: 496/1012] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 26 12:48:48 2022] GET /compute/v2.1/servers/91eb2cfb-795d-4d5c-8921-892b58ae4fa6 => generated 1266 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:48:49.278515 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi [None req-b426b9e8-66d5-442f-b92b-27c1883a2ef1 tempest-TestShelveInstance-546397589 tempest-TestShelveInstance-546397589-project] Calling method '>' {{(pid=129322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:48:49.279080 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.compute.api [None req-b426b9e8-66d5-442f-b92b-27c1883a2ef1 tempest-TestShelveInstance-546397589 tempest-TestShelveInstance-546397589-project] [instance: 05cf529d-df00-4ff9-b0d2-0e27563d2861] Fetching instance by UUID {{(pid=129322) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:48:49.280363 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi [req-5bc8101f-8b53-478e-810a-eda11c9414ab req-1332c1ff-ef25-4200-baa3-119b323cc2b7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "05cf529d-df00-4ff9-b0d2-0e27563d2861", "tag": "6408ddad-3849-44bf-b29b-b7e4852f543d"}]} {{(pid=129321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 12:48:49.285892 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-b426b9e8-66d5-442f-b92b-27c1883a2ef1 tempest-TestShelveInstance-546397589 tempest-TestShelveInstance-546397589-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:48:49.286341 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-b426b9e8-66d5-442f-b92b-27c1883a2ef1 tempest-TestShelveInstance-546397589 tempest-TestShelveInstance-546397589-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:48:49.287093 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-b426b9e8-66d5-442f-b92b-27c1883a2ef1 tempest-TestShelveInstance-546397589 tempest-TestShelveInstance-546397589-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:48:49.287569 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-b426b9e8-66d5-442f-b92b-27c1883a2ef1 tempest-TestShelveInstance-546397589 tempest-TestShelveInstance-546397589-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:48:49.290488 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [req-5bc8101f-8b53-478e-810a-eda11c9414ab req-1332c1ff-ef25-4200-baa3-119b323cc2b7 service nova] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:48:49.291005 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [req-5bc8101f-8b53-478e-810a-eda11c9414ab req-1332c1ff-ef25-4200-baa3-119b323cc2b7 service nova] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:48:49.303679 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: INFO nova.api.openstack.compute.server_external_events [req-5bc8101f-8b53-478e-810a-eda11c9414ab req-1332c1ff-ef25-4200-baa3-119b323cc2b7 service nova] Creating event network-changed:6408ddad-3849-44bf-b29b-b7e4852f543d for instance 05cf529d-df00-4ff9-b0d2-0e27563d2861 on hv-cinder-81966 May 26 12:48:49.309679 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: INFO nova.api.openstack.requestlog [req-5bc8101f-8b53-478e-810a-eda11c9414ab req-1332c1ff-ef25-4200-baa3-119b323cc2b7 service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033036 May 26 12:48:49.310944 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: [pid: 129321|app: 0|req: 497/1013] 10.222.0.75 () {64 vars in 1317 bytes} [Thu May 26 12:48:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 12:48:49.314861 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.compute.api [None req-b426b9e8-66d5-442f-b92b-27c1883a2ef1 tempest-TestShelveInstance-546397589 tempest-TestShelveInstance-546397589-project] [instance: 05cf529d-df00-4ff9-b0d2-0e27563d2861] Going to try to terminate instance {{(pid=129322) delete /opt/stack/nova/nova/compute/api.py:2664}} May 26 12:48:49.406887 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: INFO nova.api.openstack.requestlog [None req-b426b9e8-66d5-442f-b92b-27c1883a2ef1 tempest-TestShelveInstance-546397589 tempest-TestShelveInstance-546397589-project] 10.222.0.75 "DELETE /compute/v2.1/servers/05cf529d-df00-4ff9-b0d2-0e27563d2861" status: 204 len: 0 microversion: 2.1 time: 0.132835 May 26 12:48:49.411259 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: [pid: 129322|app: 0|req: 517/1014] 10.222.0.75 () {58 vars in 1238 bytes} [Thu May 26 12:48:49 2022] DELETE /compute/v2.1/servers/05cf529d-df00-4ff9-b0d2-0e27563d2861 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 26 12:48:49.417207 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi [None req-b36574e5-41b5-4bc3-871d-bc2aa884f109 tempest-TestShelveInstance-546397589 tempest-TestShelveInstance-546397589-project] Calling method '>' {{(pid=129321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:48:49.417934 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.compute.api [None req-b36574e5-41b5-4bc3-871d-bc2aa884f109 tempest-TestShelveInstance-546397589 tempest-TestShelveInstance-546397589-project] [instance: 05cf529d-df00-4ff9-b0d2-0e27563d2861] Fetching instance by UUID {{(pid=129321) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:48:49.425016 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-b36574e5-41b5-4bc3-871d-bc2aa884f109 tempest-TestShelveInstance-546397589 tempest-TestShelveInstance-546397589-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:48:49.425454 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-b36574e5-41b5-4bc3-871d-bc2aa884f109 tempest-TestShelveInstance-546397589 tempest-TestShelveInstance-546397589-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:48:49.426228 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-b36574e5-41b5-4bc3-871d-bc2aa884f109 tempest-TestShelveInstance-546397589 tempest-TestShelveInstance-546397589-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:48:49.426669 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-b36574e5-41b5-4bc3-871d-bc2aa884f109 tempest-TestShelveInstance-546397589 tempest-TestShelveInstance-546397589-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:48:49.579933 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.policy [None req-b36574e5-41b5-4bc3-871d-bc2aa884f109 tempest-TestShelveInstance-546397589 tempest-TestShelveInstance-546397589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d9bf2dcfce24386a1aaf9709d88da45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1f2f503ef674a4b97f848b69f8b63c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129321) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:48:49.587921 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: INFO nova.api.openstack.requestlog [None req-b36574e5-41b5-4bc3-871d-bc2aa884f109 tempest-TestShelveInstance-546397589 tempest-TestShelveInstance-546397589-project] 10.222.0.75 "GET /compute/v2.1/servers/05cf529d-df00-4ff9-b0d2-0e27563d2861" status: 200 len: 1568 microversion: 2.1 time: 0.175171 May 26 12:48:49.588534 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: [pid: 129321|app: 0|req: 498/1015] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 26 12:48:49 2022] GET /compute/v2.1/servers/05cf529d-df00-4ff9-b0d2-0e27563d2861 => generated 1568 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 12:48:50.007091 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi [None req-860ea3de-872d-4264-b359-3da959fc5a6f tempest-TestVolumeBootPattern-1304354335 tempest-TestVolumeBootPattern-1304354335-project] Calling method '>' {{(pid=129322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:48:50.007946 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.compute.api [None req-860ea3de-872d-4264-b359-3da959fc5a6f tempest-TestVolumeBootPattern-1304354335 tempest-TestVolumeBootPattern-1304354335-project] [instance: 91eb2cfb-795d-4d5c-8921-892b58ae4fa6] Fetching instance by UUID {{(pid=129322) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:48:50.015196 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-860ea3de-872d-4264-b359-3da959fc5a6f tempest-TestVolumeBootPattern-1304354335 tempest-TestVolumeBootPattern-1304354335-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:48:50.015779 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-860ea3de-872d-4264-b359-3da959fc5a6f tempest-TestVolumeBootPattern-1304354335 tempest-TestVolumeBootPattern-1304354335-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:48:50.016605 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-860ea3de-872d-4264-b359-3da959fc5a6f tempest-TestVolumeBootPattern-1304354335 tempest-TestVolumeBootPattern-1304354335-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:48:50.017099 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-860ea3de-872d-4264-b359-3da959fc5a6f tempest-TestVolumeBootPattern-1304354335 tempest-TestVolumeBootPattern-1304354335-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:48:50.159444 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.policy [None req-860ea3de-872d-4264-b359-3da959fc5a6f tempest-TestVolumeBootPattern-1304354335 tempest-TestVolumeBootPattern-1304354335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab469b18ce0444d9884cdddc34ef7247', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fb41c547884511893b768b833f4e90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129322) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:48:50.167878 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: INFO nova.api.openstack.requestlog [None req-860ea3de-872d-4264-b359-3da959fc5a6f tempest-TestVolumeBootPattern-1304354335 tempest-TestVolumeBootPattern-1304354335-project] 10.222.0.75 "GET /compute/v2.1/servers/91eb2cfb-795d-4d5c-8921-892b58ae4fa6" status: 200 len: 1266 microversion: 2.1 time: 0.165048 May 26 12:48:50.169200 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: [pid: 129322|app: 0|req: 518/1016] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 26 12:48:50 2022] GET /compute/v2.1/servers/91eb2cfb-795d-4d5c-8921-892b58ae4fa6 => generated 1266 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:48:50.606906 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi [None req-c27d1d8d-e4cc-4b5d-8257-6f8019240afe tempest-TestShelveInstance-546397589 tempest-TestShelveInstance-546397589-project] Calling method '>' {{(pid=129321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:48:50.607832 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.compute.api [None req-c27d1d8d-e4cc-4b5d-8257-6f8019240afe tempest-TestShelveInstance-546397589 tempest-TestShelveInstance-546397589-project] [instance: 05cf529d-df00-4ff9-b0d2-0e27563d2861] Fetching instance by UUID {{(pid=129321) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:48:50.615443 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-c27d1d8d-e4cc-4b5d-8257-6f8019240afe tempest-TestShelveInstance-546397589 tempest-TestShelveInstance-546397589-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:48:50.615926 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-c27d1d8d-e4cc-4b5d-8257-6f8019240afe tempest-TestShelveInstance-546397589 tempest-TestShelveInstance-546397589-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:48:50.616692 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-c27d1d8d-e4cc-4b5d-8257-6f8019240afe tempest-TestShelveInstance-546397589 tempest-TestShelveInstance-546397589-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:48:50.617096 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-c27d1d8d-e4cc-4b5d-8257-6f8019240afe tempest-TestShelveInstance-546397589 tempest-TestShelveInstance-546397589-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:48:50.762039 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.policy [None req-c27d1d8d-e4cc-4b5d-8257-6f8019240afe tempest-TestShelveInstance-546397589 tempest-TestShelveInstance-546397589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d9bf2dcfce24386a1aaf9709d88da45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1f2f503ef674a4b97f848b69f8b63c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129321) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:48:50.771355 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: INFO nova.api.openstack.requestlog [None req-c27d1d8d-e4cc-4b5d-8257-6f8019240afe tempest-TestShelveInstance-546397589 tempest-TestShelveInstance-546397589-project] 10.222.0.75 "GET /compute/v2.1/servers/05cf529d-df00-4ff9-b0d2-0e27563d2861" status: 200 len: 1568 microversion: 2.1 time: 0.167582 May 26 12:48:50.771355 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: [pid: 129321|app: 0|req: 499/1017] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 26 12:48:50 2022] GET /compute/v2.1/servers/05cf529d-df00-4ff9-b0d2-0e27563d2861 => generated 1568 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:48:51.185626 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi [None req-fb04260d-d6ba-4136-8bca-451ce9f0e30b tempest-TestVolumeBootPattern-1304354335 tempest-TestVolumeBootPattern-1304354335-project] Calling method '>' {{(pid=129322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:48:51.186252 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.compute.api [None req-fb04260d-d6ba-4136-8bca-451ce9f0e30b tempest-TestVolumeBootPattern-1304354335 tempest-TestVolumeBootPattern-1304354335-project] [instance: 91eb2cfb-795d-4d5c-8921-892b58ae4fa6] Fetching instance by UUID {{(pid=129322) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:48:51.193468 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-fb04260d-d6ba-4136-8bca-451ce9f0e30b tempest-TestVolumeBootPattern-1304354335 tempest-TestVolumeBootPattern-1304354335-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:48:51.193921 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-fb04260d-d6ba-4136-8bca-451ce9f0e30b tempest-TestVolumeBootPattern-1304354335 tempest-TestVolumeBootPattern-1304354335-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:48:51.194703 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-fb04260d-d6ba-4136-8bca-451ce9f0e30b tempest-TestVolumeBootPattern-1304354335 tempest-TestVolumeBootPattern-1304354335-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:48:51.195138 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-fb04260d-d6ba-4136-8bca-451ce9f0e30b tempest-TestVolumeBootPattern-1304354335 tempest-TestVolumeBootPattern-1304354335-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:48:51.349303 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.policy [None req-fb04260d-d6ba-4136-8bca-451ce9f0e30b tempest-TestVolumeBootPattern-1304354335 tempest-TestVolumeBootPattern-1304354335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab469b18ce0444d9884cdddc34ef7247', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fb41c547884511893b768b833f4e90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129322) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:48:51.352913 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG dbcounter [-] [129322] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:48:51.357909 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: INFO nova.api.openstack.requestlog [None req-fb04260d-d6ba-4136-8bca-451ce9f0e30b tempest-TestVolumeBootPattern-1304354335 tempest-TestVolumeBootPattern-1304354335-project] 10.222.0.75 "GET /compute/v2.1/servers/91eb2cfb-795d-4d5c-8921-892b58ae4fa6" status: 200 len: 1266 microversion: 2.1 time: 0.176274 May 26 12:48:51.358510 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: [pid: 129322|app: 0|req: 519/1018] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 26 12:48:51 2022] GET /compute/v2.1/servers/91eb2cfb-795d-4d5c-8921-892b58ae4fa6 => generated 1266 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:48:51.791870 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi [None req-b58b7fa1-8368-4ddd-8c99-cff369ef8d10 tempest-TestShelveInstance-546397589 tempest-TestShelveInstance-546397589-project] Calling method '>' {{(pid=129321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:48:51.792593 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.compute.api [None req-b58b7fa1-8368-4ddd-8c99-cff369ef8d10 tempest-TestShelveInstance-546397589 tempest-TestShelveInstance-546397589-project] [instance: 05cf529d-df00-4ff9-b0d2-0e27563d2861] Fetching instance by UUID {{(pid=129321) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:48:51.795396 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG dbcounter [-] [129321] Writing DB stats nova_cell0:SELECT=2 {{(pid=129321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:48:51.796465 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG dbcounter [-] [129321] Writing DB stats nova_cell0:SELECT=6 {{(pid=129321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:48:51.806245 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-b58b7fa1-8368-4ddd-8c99-cff369ef8d10 tempest-TestShelveInstance-546397589 tempest-TestShelveInstance-546397589-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:48:51.806891 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-b58b7fa1-8368-4ddd-8c99-cff369ef8d10 tempest-TestShelveInstance-546397589 tempest-TestShelveInstance-546397589-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:48:51.808137 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-b58b7fa1-8368-4ddd-8c99-cff369ef8d10 tempest-TestShelveInstance-546397589 tempest-TestShelveInstance-546397589-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:48:51.808789 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-b58b7fa1-8368-4ddd-8c99-cff369ef8d10 tempest-TestShelveInstance-546397589 tempest-TestShelveInstance-546397589-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:48:51.946900 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.policy [None req-b58b7fa1-8368-4ddd-8c99-cff369ef8d10 tempest-TestShelveInstance-546397589 tempest-TestShelveInstance-546397589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d9bf2dcfce24386a1aaf9709d88da45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1f2f503ef674a4b97f848b69f8b63c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129321) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:48:51.964860 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: INFO nova.api.openstack.requestlog [None req-b58b7fa1-8368-4ddd-8c99-cff369ef8d10 tempest-TestShelveInstance-546397589 tempest-TestShelveInstance-546397589-project] 10.222.0.75 "GET /compute/v2.1/servers/05cf529d-df00-4ff9-b0d2-0e27563d2861" status: 200 len: 1568 microversion: 2.1 time: 0.177920 May 26 12:48:51.965537 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: [pid: 129321|app: 0|req: 500/1019] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 26 12:48:51 2022] GET /compute/v2.1/servers/05cf529d-df00-4ff9-b0d2-0e27563d2861 => generated 1568 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:48:52.377274 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi [None req-f18d85ae-6913-4961-a8fb-fea13e994c1c tempest-TestVolumeBootPattern-1304354335 tempest-TestVolumeBootPattern-1304354335-project] Calling method '>' {{(pid=129322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:48:52.379028 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.compute.api [None req-f18d85ae-6913-4961-a8fb-fea13e994c1c tempest-TestVolumeBootPattern-1304354335 tempest-TestVolumeBootPattern-1304354335-project] [instance: 91eb2cfb-795d-4d5c-8921-892b58ae4fa6] Fetching instance by UUID {{(pid=129322) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:48:52.382263 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG dbcounter [-] [129322] Writing DB stats nova_cell0:SELECT=2 {{(pid=129322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:48:52.391122 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-f18d85ae-6913-4961-a8fb-fea13e994c1c tempest-TestVolumeBootPattern-1304354335 tempest-TestVolumeBootPattern-1304354335-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:48:52.391630 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-f18d85ae-6913-4961-a8fb-fea13e994c1c tempest-TestVolumeBootPattern-1304354335 tempest-TestVolumeBootPattern-1304354335-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:48:52.392596 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-f18d85ae-6913-4961-a8fb-fea13e994c1c tempest-TestVolumeBootPattern-1304354335 tempest-TestVolumeBootPattern-1304354335-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:48:52.393034 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-f18d85ae-6913-4961-a8fb-fea13e994c1c tempest-TestVolumeBootPattern-1304354335 tempest-TestVolumeBootPattern-1304354335-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:48:52.550818 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.policy [None req-f18d85ae-6913-4961-a8fb-fea13e994c1c tempest-TestVolumeBootPattern-1304354335 tempest-TestVolumeBootPattern-1304354335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab469b18ce0444d9884cdddc34ef7247', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fb41c547884511893b768b833f4e90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129322) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:48:52.559960 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: INFO nova.api.openstack.requestlog [None req-f18d85ae-6913-4961-a8fb-fea13e994c1c tempest-TestVolumeBootPattern-1304354335 tempest-TestVolumeBootPattern-1304354335-project] 10.222.0.75 "GET /compute/v2.1/servers/91eb2cfb-795d-4d5c-8921-892b58ae4fa6" status: 200 len: 1266 microversion: 2.1 time: 0.188174 May 26 12:48:52.560654 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: [pid: 129322|app: 0|req: 520/1020] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 26 12:48:52 2022] GET /compute/v2.1/servers/91eb2cfb-795d-4d5c-8921-892b58ae4fa6 => generated 1266 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:48:52.769689 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi [req-9479f53d-bde7-4ded-9aec-372e1e150348 req-25a076e9-79bf-4f58-8648-8b9e5ec106ee service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "05cf529d-df00-4ff9-b0d2-0e27563d2861", "name": "network-vif-deleted", "tag": "6408ddad-3849-44bf-b29b-b7e4852f543d"}]} {{(pid=129321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 12:48:52.780557 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [req-9479f53d-bde7-4ded-9aec-372e1e150348 req-25a076e9-79bf-4f58-8648-8b9e5ec106ee service nova] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:48:52.780950 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [req-9479f53d-bde7-4ded-9aec-372e1e150348 req-25a076e9-79bf-4f58-8648-8b9e5ec106ee service nova] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:48:52.784330 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG dbcounter [-] [129321] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:48:52.796062 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: INFO nova.api.openstack.compute.server_external_events [req-9479f53d-bde7-4ded-9aec-372e1e150348 req-25a076e9-79bf-4f58-8648-8b9e5ec106ee service nova] Creating event network-vif-deleted:6408ddad-3849-44bf-b29b-b7e4852f543d for instance 05cf529d-df00-4ff9-b0d2-0e27563d2861 on hv-cinder-81966 May 26 12:48:52.801203 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: INFO nova.api.openstack.requestlog [req-9479f53d-bde7-4ded-9aec-372e1e150348 req-25a076e9-79bf-4f58-8648-8b9e5ec106ee service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035233 May 26 12:48:52.802124 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: [pid: 129321|app: 0|req: 501/1021] 10.222.0.75 () {64 vars in 1317 bytes} [Thu May 26 12:48:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 12:48:52.984064 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi [None req-5aa033eb-24e4-4c7f-b2c0-727da26ac3e4 tempest-TestShelveInstance-546397589 tempest-TestShelveInstance-546397589-project] Calling method '>' {{(pid=129322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:48:52.984636 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.compute.api [None req-5aa033eb-24e4-4c7f-b2c0-727da26ac3e4 tempest-TestShelveInstance-546397589 tempest-TestShelveInstance-546397589-project] [instance: 05cf529d-df00-4ff9-b0d2-0e27563d2861] Fetching instance by UUID {{(pid=129322) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:48:52.996915 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-5aa033eb-24e4-4c7f-b2c0-727da26ac3e4 tempest-TestShelveInstance-546397589 tempest-TestShelveInstance-546397589-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:48:52.997396 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-5aa033eb-24e4-4c7f-b2c0-727da26ac3e4 tempest-TestShelveInstance-546397589 tempest-TestShelveInstance-546397589-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:48:52.998187 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-5aa033eb-24e4-4c7f-b2c0-727da26ac3e4 tempest-TestShelveInstance-546397589 tempest-TestShelveInstance-546397589-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:48:52.998615 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-5aa033eb-24e4-4c7f-b2c0-727da26ac3e4 tempest-TestShelveInstance-546397589 tempest-TestShelveInstance-546397589-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:48:53.063897 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.policy [None req-5aa033eb-24e4-4c7f-b2c0-727da26ac3e4 tempest-TestShelveInstance-546397589 tempest-TestShelveInstance-546397589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d9bf2dcfce24386a1aaf9709d88da45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1f2f503ef674a4b97f848b69f8b63c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129322) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:48:53.072392 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: INFO nova.api.openstack.requestlog [None req-5aa033eb-24e4-4c7f-b2c0-727da26ac3e4 tempest-TestShelveInstance-546397589 tempest-TestShelveInstance-546397589-project] 10.222.0.75 "GET /compute/v2.1/servers/05cf529d-df00-4ff9-b0d2-0e27563d2861" status: 200 len: 1218 microversion: 2.1 time: 0.093157 May 26 12:48:53.073409 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: [pid: 129322|app: 0|req: 521/1022] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 26 12:48:52 2022] GET /compute/v2.1/servers/05cf529d-df00-4ff9-b0d2-0e27563d2861 => generated 1218 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:48:53.578486 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi [None req-923b6ec8-f9cc-48b4-898f-19579a433d03 tempest-TestVolumeBootPattern-1304354335 tempest-TestVolumeBootPattern-1304354335-project] Calling method '>' {{(pid=129321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:48:53.579640 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.compute.api [None req-923b6ec8-f9cc-48b4-898f-19579a433d03 tempest-TestVolumeBootPattern-1304354335 tempest-TestVolumeBootPattern-1304354335-project] [instance: 91eb2cfb-795d-4d5c-8921-892b58ae4fa6] Fetching instance by UUID {{(pid=129321) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:48:53.588551 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-923b6ec8-f9cc-48b4-898f-19579a433d03 tempest-TestVolumeBootPattern-1304354335 tempest-TestVolumeBootPattern-1304354335-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:48:53.589029 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-923b6ec8-f9cc-48b4-898f-19579a433d03 tempest-TestVolumeBootPattern-1304354335 tempest-TestVolumeBootPattern-1304354335-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:48:53.590641 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-923b6ec8-f9cc-48b4-898f-19579a433d03 tempest-TestVolumeBootPattern-1304354335 tempest-TestVolumeBootPattern-1304354335-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:48:53.591649 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-923b6ec8-f9cc-48b4-898f-19579a433d03 tempest-TestVolumeBootPattern-1304354335 tempest-TestVolumeBootPattern-1304354335-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:48:53.752102 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.policy [None req-923b6ec8-f9cc-48b4-898f-19579a433d03 tempest-TestVolumeBootPattern-1304354335 tempest-TestVolumeBootPattern-1304354335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab469b18ce0444d9884cdddc34ef7247', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fb41c547884511893b768b833f4e90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129321) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:48:53.759882 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: INFO nova.api.openstack.requestlog [None req-923b6ec8-f9cc-48b4-898f-19579a433d03 tempest-TestVolumeBootPattern-1304354335 tempest-TestVolumeBootPattern-1304354335-project] 10.222.0.75 "GET /compute/v2.1/servers/91eb2cfb-795d-4d5c-8921-892b58ae4fa6" status: 200 len: 1266 microversion: 2.1 time: 0.186442 May 26 12:48:53.760634 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: [pid: 129321|app: 0|req: 502/1023] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 26 12:48:53 2022] GET /compute/v2.1/servers/91eb2cfb-795d-4d5c-8921-892b58ae4fa6 => generated 1266 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:48:54.090291 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi [None req-5645502f-189a-4dbc-b221-3651dc219a7b tempest-TestShelveInstance-546397589 tempest-TestShelveInstance-546397589-project] Calling method '>' {{(pid=129322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:48:54.090935 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.compute.api [None req-5645502f-189a-4dbc-b221-3651dc219a7b tempest-TestShelveInstance-546397589 tempest-TestShelveInstance-546397589-project] [instance: 05cf529d-df00-4ff9-b0d2-0e27563d2861] Fetching instance by UUID {{(pid=129322) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:48:54.097993 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-5645502f-189a-4dbc-b221-3651dc219a7b tempest-TestShelveInstance-546397589 tempest-TestShelveInstance-546397589-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:48:54.098443 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-5645502f-189a-4dbc-b221-3651dc219a7b tempest-TestShelveInstance-546397589 tempest-TestShelveInstance-546397589-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:48:54.099209 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-5645502f-189a-4dbc-b221-3651dc219a7b tempest-TestShelveInstance-546397589 tempest-TestShelveInstance-546397589-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:48:54.099682 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-5645502f-189a-4dbc-b221-3651dc219a7b tempest-TestShelveInstance-546397589 tempest-TestShelveInstance-546397589-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:48:54.114201 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: INFO nova.api.openstack.wsgi [None req-5645502f-189a-4dbc-b221-3651dc219a7b tempest-TestShelveInstance-546397589 tempest-TestShelveInstance-546397589-project] HTTP exception thrown: Instance 05cf529d-df00-4ff9-b0d2-0e27563d2861 could not be found. May 26 12:48:54.115954 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi [None req-5645502f-189a-4dbc-b221-3651dc219a7b tempest-TestShelveInstance-546397589 tempest-TestShelveInstance-546397589-project] Request method failure captured: May 26 12:48:54.115954 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: request: GET /compute/v2.1/servers/05cf529d-df00-4ff9-b0d2-0e27563d2861 HTTP/1.1 May 26 12:48:54.115954 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: Accept: application/json May 26 12:48:54.115954 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: Accept-Encoding: identity May 26 12:48:54.115954 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: Connection: close May 26 12:48:54.115954 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: Content-Length: 0 May 26 12:48:54.115954 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: Content-Type: application/json May 26 12:48:54.115954 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: Host: 10.222.0.75 May 26 12:48:54.115954 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: Openstack-System-Scope: None May 26 12:48:54.115954 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: User-Agent: python-urllib3/1.26.9 May 26 12:48:54.115954 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: X-Auth-Token: gAAAAABij3WYaZiSqdlo-rjrs5HxJUuH_I5pDtT7uqaetKtobOJUyTZ2fXDvRuz5k9Rrl11AS27BrFe1zdVPFqCzpu0KuFQPiaSqLjJSccNK5l8QCxU48uIweuYZnzvRICQ5kza35JEutgfvWgweSwyZaRQ5o93IVXY2nIuXl1Ju3BB9tYaXY3E May 26 12:48:54.115954 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: X-Domain-Id: None May 26 12:48:54.115954 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: X-Domain-Name: None May 26 12:48:54.115954 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: X-Identity-Status: Confirmed May 26 12:48:54.115954 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: X-Is-Admin-Project: True May 26 12:48:54.115954 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: X-Project-Domain-Id: default May 26 12:48:54.115954 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: X-Project-Domain-Name: Default May 26 12:48:54.115954 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: X-Project-Id: c1f2f503ef674a4b97f848b69f8b63c5 May 26 12:48:54.115954 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: X-Project-Name: tempest-TestShelveInstance-546397589 May 26 12:48:54.115954 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: X-Role: member,reader May 26 12:48:54.115954 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: X-Roles: member,reader May 26 12:48:54.117524 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/c1f2f503ef674a4b97f848b69f8b63c5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.75:8080", "publicURL": "http://10.222.0.75:8080/v1/AUTH_c1f2f503ef674a4b97f848b69f8b63c5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2/c1f2f503ef674a4b97f848b69f8b63c5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/c1f2f503ef674a4b97f848b69f8b63c5"}]}] May 26 12:48:54.117524 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: X-Tenant: tempest-TestShelveInstance-546397589 May 26 12:48:54.117524 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: X-Tenant-Id: c1f2f503ef674a4b97f848b69f8b63c5 May 26 12:48:54.117524 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: X-Tenant-Name: tempest-TestShelveInstance-546397589 May 26 12:48:54.117524 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: X-User: tempest-TestShelveInstance-546397589-project May 26 12:48:54.117524 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: X-User-Domain-Id: default May 26 12:48:54.117524 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: X-User-Domain-Name: Default May 26 12:48:54.117524 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: X-User-Id: 8d9bf2dcfce24386a1aaf9709d88da45 May 26 12:48:54.117524 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: X-User-Name: tempest-TestShelveInstance-546397589-project May 26 12:48:54.117524 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: method: > May 26 12:48:54.117524 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: exception: Instance 05cf529d-df00-4ff9-b0d2-0e27563d2861 could not be found. May 26 12:48:54.117524 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: action_args: {'id': '05cf529d-df00-4ff9-b0d2-0e27563d2861'} May 26 12:48:54.118580 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: {{(pid=129322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 12:48:54.118580 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 12:48:54.118580 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 26 12:48:54.118580 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 26 12:48:54.118580 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 26 12:48:54.118580 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 26 12:48:54.118580 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 26 12:48:54.118580 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 26 12:48:54.118580 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 26 12:48:54.118580 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 26 12:48:54.118580 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 05cf529d-df00-4ff9-b0d2-0e27563d2861 could not be found. May 26 12:48:54.118580 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi May 26 12:48:54.118580 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 12:48:54.118580 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi May 26 12:48:54.118580 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 12:48:54.118580 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 12:48:54.118580 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 12:48:54.118580 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 12:48:54.118580 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 12:48:54.118580 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 12:48:54.120149 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 12:48:54.120149 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 26 12:48:54.120149 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 26 12:48:54.120149 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 26 12:48:54.120149 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 26 12:48:54.120149 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 26 12:48:54.120149 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 12:48:54.120149 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 05cf529d-df00-4ff9-b0d2-0e27563d2861 could not be found. May 26 12:48:54.120149 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi May 26 12:48:54.120149 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 12:48:54.120149 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi May 26 12:48:54.120149 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 12:48:54.120149 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 12:48:54.120149 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 12:48:54.120149 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 12:48:54.120149 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 12:48:54.120149 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 05cf529d-df00-4ff9-b0d2-0e27563d2861 could not be found. May 26 12:48:54.120149 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi May 26 12:48:54.121673 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi [None req-5645502f-189a-4dbc-b221-3651dc219a7b tempest-TestShelveInstance-546397589 tempest-TestShelveInstance-546397589-project] Returning 404 to user: Instance 05cf529d-df00-4ff9-b0d2-0e27563d2861 could not be found. {{(pid=129322) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 12:48:54.121673 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: INFO nova.api.openstack.requestlog [None req-5645502f-189a-4dbc-b221-3651dc219a7b tempest-TestShelveInstance-546397589 tempest-TestShelveInstance-546397589-project] 10.222.0.75 "GET /compute/v2.1/servers/05cf529d-df00-4ff9-b0d2-0e27563d2861" status: 404 len: 111 microversion: 2.1 time: 0.031157 May 26 12:48:54.121673 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: [pid: 129322|app: 0|req: 522/1024] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 26 12:48:54 2022] GET /compute/v2.1/servers/05cf529d-df00-4ff9-b0d2-0e27563d2861 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 26 12:48:54.291042 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi [None req-9269ff43-0c26-405c-ab72-58fed9b58cf8 tempest-TestShelveInstance-546397589 tempest-TestShelveInstance-546397589-project] Calling method '.version_select at 0x7f8308a48310>' {{(pid=129321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:48:54.311803 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: INFO nova.api.openstack.requestlog [None req-9269ff43-0c26-405c-ab72-58fed9b58cf8 tempest-TestShelveInstance-546397589 tempest-TestShelveInstance-546397589-project] 10.222.0.75 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-59050459" status: 202 len: 0 microversion: 2.1 time: 0.025641 May 26 12:48:54.312694 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: [pid: 129321|app: 0|req: 503/1025] 10.222.0.75 () {58 vars in 1247 bytes} [Thu May 26 12:48:54 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-59050459 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 26 12:48:54.777060 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi [None req-b6ef2475-f216-4455-87ac-86974a7caf3c tempest-TestVolumeBootPattern-1304354335 tempest-TestVolumeBootPattern-1304354335-project] Calling method '>' {{(pid=129322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:48:54.777801 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.compute.api [None req-b6ef2475-f216-4455-87ac-86974a7caf3c tempest-TestVolumeBootPattern-1304354335 tempest-TestVolumeBootPattern-1304354335-project] [instance: 91eb2cfb-795d-4d5c-8921-892b58ae4fa6] Fetching instance by UUID {{(pid=129322) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:48:54.784421 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-b6ef2475-f216-4455-87ac-86974a7caf3c tempest-TestVolumeBootPattern-1304354335 tempest-TestVolumeBootPattern-1304354335-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:48:54.785001 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-b6ef2475-f216-4455-87ac-86974a7caf3c tempest-TestVolumeBootPattern-1304354335 tempest-TestVolumeBootPattern-1304354335-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:48:54.785777 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-b6ef2475-f216-4455-87ac-86974a7caf3c tempest-TestVolumeBootPattern-1304354335 tempest-TestVolumeBootPattern-1304354335-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:48:54.786204 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-b6ef2475-f216-4455-87ac-86974a7caf3c tempest-TestVolumeBootPattern-1304354335 tempest-TestVolumeBootPattern-1304354335-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:48:54.926375 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.policy [None req-b6ef2475-f216-4455-87ac-86974a7caf3c tempest-TestVolumeBootPattern-1304354335 tempest-TestVolumeBootPattern-1304354335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab469b18ce0444d9884cdddc34ef7247', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fb41c547884511893b768b833f4e90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129322) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:48:54.935022 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: INFO nova.api.openstack.requestlog [None req-b6ef2475-f216-4455-87ac-86974a7caf3c tempest-TestVolumeBootPattern-1304354335 tempest-TestVolumeBootPattern-1304354335-project] 10.222.0.75 "GET /compute/v2.1/servers/91eb2cfb-795d-4d5c-8921-892b58ae4fa6" status: 200 len: 1266 microversion: 2.1 time: 0.162061 May 26 12:48:54.935642 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: [pid: 129322|app: 0|req: 523/1026] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 26 12:48:54 2022] GET /compute/v2.1/servers/91eb2cfb-795d-4d5c-8921-892b58ae4fa6 => generated 1266 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:48:55.639172 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi [req-192fa31d-cbe6-48d1-a679-d0b75130e0c9 req-43a6cac3-45fa-452d-8765-347c77372ee5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "91eb2cfb-795d-4d5c-8921-892b58ae4fa6", "name": "network-vif-plugged", "status": "completed", "tag": "fefc8d50-0c80-4088-adf1-045e8ac58366"}]} {{(pid=129321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 12:48:55.649405 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [req-192fa31d-cbe6-48d1-a679-d0b75130e0c9 req-43a6cac3-45fa-452d-8765-347c77372ee5 service nova] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:48:55.650239 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [req-192fa31d-cbe6-48d1-a679-d0b75130e0c9 req-43a6cac3-45fa-452d-8765-347c77372ee5 service nova] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:48:55.672499 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: INFO nova.api.openstack.compute.server_external_events [req-192fa31d-cbe6-48d1-a679-d0b75130e0c9 req-43a6cac3-45fa-452d-8765-347c77372ee5 service nova] Creating event network-vif-plugged:fefc8d50-0c80-4088-adf1-045e8ac58366 for instance 91eb2cfb-795d-4d5c-8921-892b58ae4fa6 on hv-cinder-81966 May 26 12:48:55.678018 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: INFO nova.api.openstack.requestlog [req-192fa31d-cbe6-48d1-a679-d0b75130e0c9 req-43a6cac3-45fa-452d-8765-347c77372ee5 service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043588 May 26 12:48:55.680178 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: [pid: 129321|app: 0|req: 504/1027] 10.222.0.75 () {64 vars in 1317 bytes} [Thu May 26 12:48:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 12:48:55.952079 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi [None req-376a7310-6956-4506-9274-5d3c0aad5e99 tempest-TestVolumeBootPattern-1304354335 tempest-TestVolumeBootPattern-1304354335-project] Calling method '>' {{(pid=129322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:48:55.952683 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.compute.api [None req-376a7310-6956-4506-9274-5d3c0aad5e99 tempest-TestVolumeBootPattern-1304354335 tempest-TestVolumeBootPattern-1304354335-project] [instance: 91eb2cfb-795d-4d5c-8921-892b58ae4fa6] Fetching instance by UUID {{(pid=129322) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:48:55.959822 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-376a7310-6956-4506-9274-5d3c0aad5e99 tempest-TestVolumeBootPattern-1304354335 tempest-TestVolumeBootPattern-1304354335-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:48:55.960596 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-376a7310-6956-4506-9274-5d3c0aad5e99 tempest-TestVolumeBootPattern-1304354335 tempest-TestVolumeBootPattern-1304354335-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:48:55.961419 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-376a7310-6956-4506-9274-5d3c0aad5e99 tempest-TestVolumeBootPattern-1304354335 tempest-TestVolumeBootPattern-1304354335-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:48:55.961849 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-376a7310-6956-4506-9274-5d3c0aad5e99 tempest-TestVolumeBootPattern-1304354335 tempest-TestVolumeBootPattern-1304354335-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:48:56.103978 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.policy [None req-376a7310-6956-4506-9274-5d3c0aad5e99 tempest-TestVolumeBootPattern-1304354335 tempest-TestVolumeBootPattern-1304354335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab469b18ce0444d9884cdddc34ef7247', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fb41c547884511893b768b833f4e90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129322) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:48:56.111863 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: INFO nova.api.openstack.requestlog [None req-376a7310-6956-4506-9274-5d3c0aad5e99 tempest-TestVolumeBootPattern-1304354335 tempest-TestVolumeBootPattern-1304354335-project] 10.222.0.75 "GET /compute/v2.1/servers/91eb2cfb-795d-4d5c-8921-892b58ae4fa6" status: 200 len: 1266 microversion: 2.1 time: 0.164453 May 26 12:48:56.112472 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: [pid: 129322|app: 0|req: 524/1028] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 26 12:48:55 2022] GET /compute/v2.1/servers/91eb2cfb-795d-4d5c-8921-892b58ae4fa6 => generated 1266 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:48:57.129609 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi [None req-11475ae2-6284-4461-873e-a5882551c162 tempest-TestVolumeBootPattern-1304354335 tempest-TestVolumeBootPattern-1304354335-project] Calling method '>' {{(pid=129321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:48:57.130394 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.compute.api [None req-11475ae2-6284-4461-873e-a5882551c162 tempest-TestVolumeBootPattern-1304354335 tempest-TestVolumeBootPattern-1304354335-project] [instance: 91eb2cfb-795d-4d5c-8921-892b58ae4fa6] Fetching instance by UUID {{(pid=129321) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:48:57.137534 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-11475ae2-6284-4461-873e-a5882551c162 tempest-TestVolumeBootPattern-1304354335 tempest-TestVolumeBootPattern-1304354335-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:48:57.138092 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-11475ae2-6284-4461-873e-a5882551c162 tempest-TestVolumeBootPattern-1304354335 tempest-TestVolumeBootPattern-1304354335-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:48:57.138883 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-11475ae2-6284-4461-873e-a5882551c162 tempest-TestVolumeBootPattern-1304354335 tempest-TestVolumeBootPattern-1304354335-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:48:57.139322 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-11475ae2-6284-4461-873e-a5882551c162 tempest-TestVolumeBootPattern-1304354335 tempest-TestVolumeBootPattern-1304354335-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:48:57.281457 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.policy [None req-11475ae2-6284-4461-873e-a5882551c162 tempest-TestVolumeBootPattern-1304354335 tempest-TestVolumeBootPattern-1304354335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab469b18ce0444d9884cdddc34ef7247', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fb41c547884511893b768b833f4e90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129321) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:48:57.293653 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: INFO nova.api.openstack.requestlog [None req-11475ae2-6284-4461-873e-a5882551c162 tempest-TestVolumeBootPattern-1304354335 tempest-TestVolumeBootPattern-1304354335-project] 10.222.0.75 "GET /compute/v2.1/servers/91eb2cfb-795d-4d5c-8921-892b58ae4fa6" status: 200 len: 1266 microversion: 2.1 time: 0.167804 May 26 12:48:57.294472 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: [pid: 129321|app: 0|req: 505/1029] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 26 12:48:57 2022] GET /compute/v2.1/servers/91eb2cfb-795d-4d5c-8921-892b58ae4fa6 => generated 1266 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:48:58.310927 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi [None req-871c1672-6f1e-4239-849a-bb389d5ebd06 tempest-TestVolumeBootPattern-1304354335 tempest-TestVolumeBootPattern-1304354335-project] Calling method '>' {{(pid=129322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:48:58.311574 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.compute.api [None req-871c1672-6f1e-4239-849a-bb389d5ebd06 tempest-TestVolumeBootPattern-1304354335 tempest-TestVolumeBootPattern-1304354335-project] [instance: 91eb2cfb-795d-4d5c-8921-892b58ae4fa6] Fetching instance by UUID {{(pid=129322) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:48:58.318627 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-871c1672-6f1e-4239-849a-bb389d5ebd06 tempest-TestVolumeBootPattern-1304354335 tempest-TestVolumeBootPattern-1304354335-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:48:58.319075 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-871c1672-6f1e-4239-849a-bb389d5ebd06 tempest-TestVolumeBootPattern-1304354335 tempest-TestVolumeBootPattern-1304354335-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:48:58.319897 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-871c1672-6f1e-4239-849a-bb389d5ebd06 tempest-TestVolumeBootPattern-1304354335 tempest-TestVolumeBootPattern-1304354335-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:48:58.320328 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-871c1672-6f1e-4239-849a-bb389d5ebd06 tempest-TestVolumeBootPattern-1304354335 tempest-TestVolumeBootPattern-1304354335-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:48:58.464473 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.policy [None req-871c1672-6f1e-4239-849a-bb389d5ebd06 tempest-TestVolumeBootPattern-1304354335 tempest-TestVolumeBootPattern-1304354335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab469b18ce0444d9884cdddc34ef7247', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fb41c547884511893b768b833f4e90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129322) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:48:58.472814 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: INFO nova.api.openstack.requestlog [None req-871c1672-6f1e-4239-849a-bb389d5ebd06 tempest-TestVolumeBootPattern-1304354335 tempest-TestVolumeBootPattern-1304354335-project] 10.222.0.75 "GET /compute/v2.1/servers/91eb2cfb-795d-4d5c-8921-892b58ae4fa6" status: 200 len: 1453 microversion: 2.1 time: 0.166170 May 26 12:48:58.473574 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: [pid: 129322|app: 0|req: 525/1030] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 26 12:48:58 2022] GET /compute/v2.1/servers/91eb2cfb-795d-4d5c-8921-892b58ae4fa6 => generated 1453 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:48:58.488937 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi [None req-5a0fb38a-d539-47b0-b61e-cf56d3922e07 tempest-TestVolumeBootPattern-1304354335 tempest-TestVolumeBootPattern-1304354335-project] Calling method '>' {{(pid=129321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:48:58.489812 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.compute.api [None req-5a0fb38a-d539-47b0-b61e-cf56d3922e07 tempest-TestVolumeBootPattern-1304354335 tempest-TestVolumeBootPattern-1304354335-project] [instance: 91eb2cfb-795d-4d5c-8921-892b58ae4fa6] Fetching instance by UUID {{(pid=129321) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:48:58.496837 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-5a0fb38a-d539-47b0-b61e-cf56d3922e07 tempest-TestVolumeBootPattern-1304354335 tempest-TestVolumeBootPattern-1304354335-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:48:58.497899 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-5a0fb38a-d539-47b0-b61e-cf56d3922e07 tempest-TestVolumeBootPattern-1304354335 tempest-TestVolumeBootPattern-1304354335-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:48:58.498224 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-5a0fb38a-d539-47b0-b61e-cf56d3922e07 tempest-TestVolumeBootPattern-1304354335 tempest-TestVolumeBootPattern-1304354335-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:48:58.498650 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-5a0fb38a-d539-47b0-b61e-cf56d3922e07 tempest-TestVolumeBootPattern-1304354335 tempest-TestVolumeBootPattern-1304354335-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:48:58.766473 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.policy [None req-5a0fb38a-d539-47b0-b61e-cf56d3922e07 tempest-TestVolumeBootPattern-1304354335 tempest-TestVolumeBootPattern-1304354335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab469b18ce0444d9884cdddc34ef7247', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fb41c547884511893b768b833f4e90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129321) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:48:58.775405 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: INFO nova.api.openstack.requestlog [None req-5a0fb38a-d539-47b0-b61e-cf56d3922e07 tempest-TestVolumeBootPattern-1304354335 tempest-TestVolumeBootPattern-1304354335-project] 10.222.0.75 "GET /compute/v2.1/servers/91eb2cfb-795d-4d5c-8921-892b58ae4fa6" status: 200 len: 1453 microversion: 2.1 time: 0.290279 May 26 12:48:58.784667 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: [pid: 129321|app: 0|req: 506/1031] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 26 12:48:58 2022] GET /compute/v2.1/servers/91eb2cfb-795d-4d5c-8921-892b58ae4fa6 => generated 1453 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:49:00.603929 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi [req-52acc524-091d-4790-8dc7-615e300e9d6a req-f1d60387-6aa0-49d8-a54c-5eb2dc7e6945 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "91eb2cfb-795d-4d5c-8921-892b58ae4fa6", "tag": "fefc8d50-0c80-4088-adf1-045e8ac58366"}]} {{(pid=129322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 12:49:00.613484 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [req-52acc524-091d-4790-8dc7-615e300e9d6a req-f1d60387-6aa0-49d8-a54c-5eb2dc7e6945 service nova] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:49:00.613929 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [req-52acc524-091d-4790-8dc7-615e300e9d6a req-f1d60387-6aa0-49d8-a54c-5eb2dc7e6945 service nova] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:49:00.626520 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: INFO nova.api.openstack.compute.server_external_events [req-52acc524-091d-4790-8dc7-615e300e9d6a req-f1d60387-6aa0-49d8-a54c-5eb2dc7e6945 service nova] Creating event network-changed:fefc8d50-0c80-4088-adf1-045e8ac58366 for instance 91eb2cfb-795d-4d5c-8921-892b58ae4fa6 on hv-cinder-81966 May 26 12:49:00.632229 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: INFO nova.api.openstack.requestlog [req-52acc524-091d-4790-8dc7-615e300e9d6a req-f1d60387-6aa0-49d8-a54c-5eb2dc7e6945 service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032160 May 26 12:49:00.633069 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: [pid: 129322|app: 0|req: 526/1032] 10.222.0.75 () {64 vars in 1317 bytes} [Thu May 26 12:49:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 12:49:01.668658 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi [None req-6e758963-841d-4efa-9233-ab0b9c79f5f5 tempest-AttachVolumeTestJSON-1454716698 tempest-AttachVolumeTestJSON-1454716698-project] Calling method '>' {{(pid=129321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:49:01.669814 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.compute.api [None req-6e758963-841d-4efa-9233-ab0b9c79f5f5 tempest-AttachVolumeTestJSON-1454716698 tempest-AttachVolumeTestJSON-1454716698-project] [instance: 51b4bd5b-19a0-4b50-804d-aff4216e854c] Fetching instance by UUID {{(pid=129321) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:49:01.682207 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-6e758963-841d-4efa-9233-ab0b9c79f5f5 tempest-AttachVolumeTestJSON-1454716698 tempest-AttachVolumeTestJSON-1454716698-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:49:01.687094 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-6e758963-841d-4efa-9233-ab0b9c79f5f5 tempest-AttachVolumeTestJSON-1454716698 tempest-AttachVolumeTestJSON-1454716698-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:49:01.688147 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-6e758963-841d-4efa-9233-ab0b9c79f5f5 tempest-AttachVolumeTestJSON-1454716698 tempest-AttachVolumeTestJSON-1454716698-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:49:01.688697 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-6e758963-841d-4efa-9233-ab0b9c79f5f5 tempest-AttachVolumeTestJSON-1454716698 tempest-AttachVolumeTestJSON-1454716698-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:49:01.730043 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: INFO nova.api.openstack.requestlog [None req-6e758963-841d-4efa-9233-ab0b9c79f5f5 tempest-AttachVolumeTestJSON-1454716698 tempest-AttachVolumeTestJSON-1454716698-project] 10.222.0.75 "GET /compute/v2.1/servers/51b4bd5b-19a0-4b50-804d-aff4216e854c/ips" status: 200 len: 146 microversion: 2.1 time: 0.066076 May 26 12:49:01.736107 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: [pid: 129321|app: 0|req: 507/1033] 10.222.0.75 () {58 vars in 1247 bytes} [Thu May 26 12:49:01 2022] GET /compute/v2.1/servers/51b4bd5b-19a0-4b50-804d-aff4216e854c/ips => generated 146 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 12:49:04.979869 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi [None req-f8c107bc-38ae-411a-862a-20a5d8eb8975 tempest-AttachVolumeTestJSON-1454716698 tempest-AttachVolumeTestJSON-1454716698-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "7e65d8a5-f458-4b8c-8847-8ea74453af87"}} {{(pid=129322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 12:49:04.981011 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.compute.api [None req-f8c107bc-38ae-411a-862a-20a5d8eb8975 tempest-AttachVolumeTestJSON-1454716698 tempest-AttachVolumeTestJSON-1454716698-project] [instance: 51b4bd5b-19a0-4b50-804d-aff4216e854c] Fetching instance by UUID {{(pid=129322) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:49:04.983182 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG dbcounter [-] [129322] Writing DB stats nova_api:SELECT=53,nova_api:UPDATE=1 {{(pid=129322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:49:04.989514 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-f8c107bc-38ae-411a-862a-20a5d8eb8975 tempest-AttachVolumeTestJSON-1454716698 tempest-AttachVolumeTestJSON-1454716698-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:49:04.989947 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-f8c107bc-38ae-411a-862a-20a5d8eb8975 tempest-AttachVolumeTestJSON-1454716698 tempest-AttachVolumeTestJSON-1454716698-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:49:04.990716 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-f8c107bc-38ae-411a-862a-20a5d8eb8975 tempest-AttachVolumeTestJSON-1454716698 tempest-AttachVolumeTestJSON-1454716698-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:49:04.991154 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-f8c107bc-38ae-411a-862a-20a5d8eb8975 tempest-AttachVolumeTestJSON-1454716698 tempest-AttachVolumeTestJSON-1454716698-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:49:05.271348 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: INFO nova.api.openstack.requestlog [None req-f8c107bc-38ae-411a-862a-20a5d8eb8975 tempest-AttachVolumeTestJSON-1454716698 tempest-AttachVolumeTestJSON-1454716698-project] 10.222.0.75 "POST /compute/v2.1/servers/51b4bd5b-19a0-4b50-804d-aff4216e854c/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.296514 May 26 12:49:05.272212 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: [pid: 129322|app: 0|req: 527/1034] 10.222.0.75 () {60 vars in 1322 bytes} [Thu May 26 12:49:04 2022] POST /compute/v2.1/servers/51b4bd5b-19a0-4b50-804d-aff4216e854c/os-volume_attachments => generated 194 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 12:49:12.840356 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi [None req-3633d791-2fca-4b65-aabb-7373f4cc2a2b tempest-AttachVolumeTestJSON-1454716698 tempest-AttachVolumeTestJSON-1454716698-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=129321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 12:49:12.843165 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG dbcounter [-] [129321] Writing DB stats nova_api:SELECT=49,nova_api:INSERT=3,nova_api:DELETE=1 {{(pid=129321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:49:12.843975 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG dbcounter [-] [129321] Writing DB stats nova_cell1:SELECT=25 {{(pid=129321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:49:12.850487 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-3633d791-2fca-4b65-aabb-7373f4cc2a2b tempest-AttachVolumeTestJSON-1454716698 tempest-AttachVolumeTestJSON-1454716698-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:49:12.850952 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-3633d791-2fca-4b65-aabb-7373f4cc2a2b tempest-AttachVolumeTestJSON-1454716698 tempest-AttachVolumeTestJSON-1454716698-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:49:12.917545 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.compute.api [None req-3633d791-2fca-4b65-aabb-7373f4cc2a2b tempest-AttachVolumeTestJSON-1454716698 tempest-AttachVolumeTestJSON-1454716698-project] [instance: 51b4bd5b-19a0-4b50-804d-aff4216e854c] Going to try to stop instance {{(pid=129321) force_stop /opt/stack/nova/nova/compute/api.py:2707}} May 26 12:49:12.963404 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: INFO nova.api.openstack.requestlog [None req-3633d791-2fca-4b65-aabb-7373f4cc2a2b tempest-AttachVolumeTestJSON-1454716698 tempest-AttachVolumeTestJSON-1454716698-project] 10.222.0.75 "POST /compute/v2.1/servers/51b4bd5b-19a0-4b50-804d-aff4216e854c/action" status: 202 len: 0 microversion: 2.1 time: 0.126862 May 26 12:49:12.964226 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: [pid: 129321|app: 0|req: 508/1035] 10.222.0.75 () {60 vars in 1277 bytes} [Thu May 26 12:49:12 2022] POST /compute/v2.1/servers/51b4bd5b-19a0-4b50-804d-aff4216e854c/action => generated 0 bytes in 129 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 26 12:49:12.973180 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi [None req-209b81fe-fc03-425e-a756-a1c0c9b09f88 tempest-AttachVolumeTestJSON-1454716698 tempest-AttachVolumeTestJSON-1454716698-project] Calling method '>' {{(pid=129322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:49:12.973757 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.compute.api [None req-209b81fe-fc03-425e-a756-a1c0c9b09f88 tempest-AttachVolumeTestJSON-1454716698 tempest-AttachVolumeTestJSON-1454716698-project] [instance: 51b4bd5b-19a0-4b50-804d-aff4216e854c] Fetching instance by UUID {{(pid=129322) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:49:12.980718 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-209b81fe-fc03-425e-a756-a1c0c9b09f88 tempest-AttachVolumeTestJSON-1454716698 tempest-AttachVolumeTestJSON-1454716698-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:49:12.981161 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-209b81fe-fc03-425e-a756-a1c0c9b09f88 tempest-AttachVolumeTestJSON-1454716698 tempest-AttachVolumeTestJSON-1454716698-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:49:12.981932 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-209b81fe-fc03-425e-a756-a1c0c9b09f88 tempest-AttachVolumeTestJSON-1454716698 tempest-AttachVolumeTestJSON-1454716698-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:49:12.982426 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-209b81fe-fc03-425e-a756-a1c0c9b09f88 tempest-AttachVolumeTestJSON-1454716698 tempest-AttachVolumeTestJSON-1454716698-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:49:13.134727 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.policy [None req-209b81fe-fc03-425e-a756-a1c0c9b09f88 tempest-AttachVolumeTestJSON-1454716698 tempest-AttachVolumeTestJSON-1454716698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e987a71a29243dbac6c23e337765508', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9f9a22ad1e74798b9b2f7d85f89a4b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129322) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:49:13.147638 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: INFO nova.api.openstack.requestlog [None req-209b81fe-fc03-425e-a756-a1c0c9b09f88 tempest-AttachVolumeTestJSON-1454716698 tempest-AttachVolumeTestJSON-1454716698-project] 10.222.0.75 "GET /compute/v2.1/servers/51b4bd5b-19a0-4b50-804d-aff4216e854c" status: 200 len: 1722 microversion: 2.1 time: 0.178544 May 26 12:49:13.148348 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: [pid: 129322|app: 0|req: 528/1036] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 26 12:49:12 2022] GET /compute/v2.1/servers/51b4bd5b-19a0-4b50-804d-aff4216e854c => generated 1722 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:49:14.168739 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi [None req-673ce6bc-dfb9-48c0-bd55-a39377239463 tempest-AttachVolumeTestJSON-1454716698 tempest-AttachVolumeTestJSON-1454716698-project] Calling method '>' {{(pid=129321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:49:14.169322 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.compute.api [None req-673ce6bc-dfb9-48c0-bd55-a39377239463 tempest-AttachVolumeTestJSON-1454716698 tempest-AttachVolumeTestJSON-1454716698-project] [instance: 51b4bd5b-19a0-4b50-804d-aff4216e854c] Fetching instance by UUID {{(pid=129321) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:49:14.176848 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-673ce6bc-dfb9-48c0-bd55-a39377239463 tempest-AttachVolumeTestJSON-1454716698 tempest-AttachVolumeTestJSON-1454716698-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:49:14.177298 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-673ce6bc-dfb9-48c0-bd55-a39377239463 tempest-AttachVolumeTestJSON-1454716698 tempest-AttachVolumeTestJSON-1454716698-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:49:14.178076 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-673ce6bc-dfb9-48c0-bd55-a39377239463 tempest-AttachVolumeTestJSON-1454716698 tempest-AttachVolumeTestJSON-1454716698-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:49:14.178507 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-673ce6bc-dfb9-48c0-bd55-a39377239463 tempest-AttachVolumeTestJSON-1454716698 tempest-AttachVolumeTestJSON-1454716698-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:49:14.324093 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.policy [None req-673ce6bc-dfb9-48c0-bd55-a39377239463 tempest-AttachVolumeTestJSON-1454716698 tempest-AttachVolumeTestJSON-1454716698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e987a71a29243dbac6c23e337765508', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9f9a22ad1e74798b9b2f7d85f89a4b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129321) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:49:14.333761 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: INFO nova.api.openstack.requestlog [None req-673ce6bc-dfb9-48c0-bd55-a39377239463 tempest-AttachVolumeTestJSON-1454716698 tempest-AttachVolumeTestJSON-1454716698-project] 10.222.0.75 "GET /compute/v2.1/servers/51b4bd5b-19a0-4b50-804d-aff4216e854c" status: 200 len: 1722 microversion: 2.1 time: 0.171618 May 26 12:49:14.334352 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: [pid: 129321|app: 0|req: 509/1037] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 26 12:49:14 2022] GET /compute/v2.1/servers/51b4bd5b-19a0-4b50-804d-aff4216e854c => generated 1722 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:49:15.352335 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi [None req-7f22e1ce-feda-4c69-8e8d-2f05f88cd854 tempest-AttachVolumeTestJSON-1454716698 tempest-AttachVolumeTestJSON-1454716698-project] Calling method '>' {{(pid=129322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:49:15.352915 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.compute.api [None req-7f22e1ce-feda-4c69-8e8d-2f05f88cd854 tempest-AttachVolumeTestJSON-1454716698 tempest-AttachVolumeTestJSON-1454716698-project] [instance: 51b4bd5b-19a0-4b50-804d-aff4216e854c] Fetching instance by UUID {{(pid=129322) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:49:15.361204 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-7f22e1ce-feda-4c69-8e8d-2f05f88cd854 tempest-AttachVolumeTestJSON-1454716698 tempest-AttachVolumeTestJSON-1454716698-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:49:15.361637 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-7f22e1ce-feda-4c69-8e8d-2f05f88cd854 tempest-AttachVolumeTestJSON-1454716698 tempest-AttachVolumeTestJSON-1454716698-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:49:15.362431 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-7f22e1ce-feda-4c69-8e8d-2f05f88cd854 tempest-AttachVolumeTestJSON-1454716698 tempest-AttachVolumeTestJSON-1454716698-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:49:15.362862 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-7f22e1ce-feda-4c69-8e8d-2f05f88cd854 tempest-AttachVolumeTestJSON-1454716698 tempest-AttachVolumeTestJSON-1454716698-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:49:15.507151 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.policy [None req-7f22e1ce-feda-4c69-8e8d-2f05f88cd854 tempest-AttachVolumeTestJSON-1454716698 tempest-AttachVolumeTestJSON-1454716698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e987a71a29243dbac6c23e337765508', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9f9a22ad1e74798b9b2f7d85f89a4b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129322) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:49:15.516152 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: INFO nova.api.openstack.requestlog [None req-7f22e1ce-feda-4c69-8e8d-2f05f88cd854 tempest-AttachVolumeTestJSON-1454716698 tempest-AttachVolumeTestJSON-1454716698-project] 10.222.0.75 "GET /compute/v2.1/servers/51b4bd5b-19a0-4b50-804d-aff4216e854c" status: 200 len: 1722 microversion: 2.1 time: 0.167753 May 26 12:49:15.516736 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: [pid: 129322|app: 0|req: 529/1038] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 26 12:49:15 2022] GET /compute/v2.1/servers/51b4bd5b-19a0-4b50-804d-aff4216e854c => generated 1722 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:49:16.534567 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi [None req-60ae5ee2-bd14-437d-822c-16ccfa978390 tempest-AttachVolumeTestJSON-1454716698 tempest-AttachVolumeTestJSON-1454716698-project] Calling method '>' {{(pid=129321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:49:16.535231 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.compute.api [None req-60ae5ee2-bd14-437d-822c-16ccfa978390 tempest-AttachVolumeTestJSON-1454716698 tempest-AttachVolumeTestJSON-1454716698-project] [instance: 51b4bd5b-19a0-4b50-804d-aff4216e854c] Fetching instance by UUID {{(pid=129321) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:49:16.542410 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-60ae5ee2-bd14-437d-822c-16ccfa978390 tempest-AttachVolumeTestJSON-1454716698 tempest-AttachVolumeTestJSON-1454716698-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:49:16.542857 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-60ae5ee2-bd14-437d-822c-16ccfa978390 tempest-AttachVolumeTestJSON-1454716698 tempest-AttachVolumeTestJSON-1454716698-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:49:16.543660 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-60ae5ee2-bd14-437d-822c-16ccfa978390 tempest-AttachVolumeTestJSON-1454716698 tempest-AttachVolumeTestJSON-1454716698-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:49:16.544094 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-60ae5ee2-bd14-437d-822c-16ccfa978390 tempest-AttachVolumeTestJSON-1454716698 tempest-AttachVolumeTestJSON-1454716698-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:49:16.692976 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.policy [None req-60ae5ee2-bd14-437d-822c-16ccfa978390 tempest-AttachVolumeTestJSON-1454716698 tempest-AttachVolumeTestJSON-1454716698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e987a71a29243dbac6c23e337765508', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9f9a22ad1e74798b9b2f7d85f89a4b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129321) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:49:16.704771 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: INFO nova.api.openstack.requestlog [None req-60ae5ee2-bd14-437d-822c-16ccfa978390 tempest-AttachVolumeTestJSON-1454716698 tempest-AttachVolumeTestJSON-1454716698-project] 10.222.0.75 "GET /compute/v2.1/servers/51b4bd5b-19a0-4b50-804d-aff4216e854c" status: 200 len: 1722 microversion: 2.1 time: 0.173487 May 26 12:49:16.705468 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: [pid: 129321|app: 0|req: 510/1039] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 26 12:49:16 2022] GET /compute/v2.1/servers/51b4bd5b-19a0-4b50-804d-aff4216e854c => generated 1722 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:49:17.722565 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi [None req-e587b363-ffff-4723-bbc2-26d8c1bca427 tempest-AttachVolumeTestJSON-1454716698 tempest-AttachVolumeTestJSON-1454716698-project] Calling method '>' {{(pid=129322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:49:17.723221 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.compute.api [None req-e587b363-ffff-4723-bbc2-26d8c1bca427 tempest-AttachVolumeTestJSON-1454716698 tempest-AttachVolumeTestJSON-1454716698-project] [instance: 51b4bd5b-19a0-4b50-804d-aff4216e854c] Fetching instance by UUID {{(pid=129322) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:49:17.730227 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-e587b363-ffff-4723-bbc2-26d8c1bca427 tempest-AttachVolumeTestJSON-1454716698 tempest-AttachVolumeTestJSON-1454716698-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:49:17.730679 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-e587b363-ffff-4723-bbc2-26d8c1bca427 tempest-AttachVolumeTestJSON-1454716698 tempest-AttachVolumeTestJSON-1454716698-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:49:17.731450 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-e587b363-ffff-4723-bbc2-26d8c1bca427 tempest-AttachVolumeTestJSON-1454716698 tempest-AttachVolumeTestJSON-1454716698-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:49:17.731910 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-e587b363-ffff-4723-bbc2-26d8c1bca427 tempest-AttachVolumeTestJSON-1454716698 tempest-AttachVolumeTestJSON-1454716698-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:49:17.874620 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.policy [None req-e587b363-ffff-4723-bbc2-26d8c1bca427 tempest-AttachVolumeTestJSON-1454716698 tempest-AttachVolumeTestJSON-1454716698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e987a71a29243dbac6c23e337765508', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9f9a22ad1e74798b9b2f7d85f89a4b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129322) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:49:17.885805 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: INFO nova.api.openstack.requestlog [None req-e587b363-ffff-4723-bbc2-26d8c1bca427 tempest-AttachVolumeTestJSON-1454716698 tempest-AttachVolumeTestJSON-1454716698-project] 10.222.0.75 "GET /compute/v2.1/servers/51b4bd5b-19a0-4b50-804d-aff4216e854c" status: 200 len: 1722 microversion: 2.1 time: 0.167256 May 26 12:49:17.886514 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: [pid: 129322|app: 0|req: 530/1040] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 26 12:49:17 2022] GET /compute/v2.1/servers/51b4bd5b-19a0-4b50-804d-aff4216e854c => generated 1722 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:49:18.905697 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi [None req-db98a435-5092-42a6-9330-acd1de86a337 tempest-AttachVolumeTestJSON-1454716698 tempest-AttachVolumeTestJSON-1454716698-project] Calling method '>' {{(pid=129321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:49:18.906287 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.compute.api [None req-db98a435-5092-42a6-9330-acd1de86a337 tempest-AttachVolumeTestJSON-1454716698 tempest-AttachVolumeTestJSON-1454716698-project] [instance: 51b4bd5b-19a0-4b50-804d-aff4216e854c] Fetching instance by UUID {{(pid=129321) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:49:18.913422 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-db98a435-5092-42a6-9330-acd1de86a337 tempest-AttachVolumeTestJSON-1454716698 tempest-AttachVolumeTestJSON-1454716698-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:49:18.913874 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-db98a435-5092-42a6-9330-acd1de86a337 tempest-AttachVolumeTestJSON-1454716698 tempest-AttachVolumeTestJSON-1454716698-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:49:18.914649 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-db98a435-5092-42a6-9330-acd1de86a337 tempest-AttachVolumeTestJSON-1454716698 tempest-AttachVolumeTestJSON-1454716698-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:49:18.915082 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-db98a435-5092-42a6-9330-acd1de86a337 tempest-AttachVolumeTestJSON-1454716698 tempest-AttachVolumeTestJSON-1454716698-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:49:19.056008 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.policy [None req-db98a435-5092-42a6-9330-acd1de86a337 tempest-AttachVolumeTestJSON-1454716698 tempest-AttachVolumeTestJSON-1454716698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e987a71a29243dbac6c23e337765508', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9f9a22ad1e74798b9b2f7d85f89a4b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129321) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:49:19.064875 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: INFO nova.api.openstack.requestlog [None req-db98a435-5092-42a6-9330-acd1de86a337 tempest-AttachVolumeTestJSON-1454716698 tempest-AttachVolumeTestJSON-1454716698-project] 10.222.0.75 "GET /compute/v2.1/servers/51b4bd5b-19a0-4b50-804d-aff4216e854c" status: 200 len: 1722 microversion: 2.1 time: 0.164178 May 26 12:49:19.065507 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: [pid: 129321|app: 0|req: 511/1041] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 26 12:49:18 2022] GET /compute/v2.1/servers/51b4bd5b-19a0-4b50-804d-aff4216e854c => generated 1722 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:49:20.085018 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi [None req-83b63c38-6c49-4308-a5a5-98f5e8c85d57 tempest-AttachVolumeTestJSON-1454716698 tempest-AttachVolumeTestJSON-1454716698-project] Calling method '>' {{(pid=129322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:49:20.085794 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.compute.api [None req-83b63c38-6c49-4308-a5a5-98f5e8c85d57 tempest-AttachVolumeTestJSON-1454716698 tempest-AttachVolumeTestJSON-1454716698-project] [instance: 51b4bd5b-19a0-4b50-804d-aff4216e854c] Fetching instance by UUID {{(pid=129322) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:49:20.095706 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-83b63c38-6c49-4308-a5a5-98f5e8c85d57 tempest-AttachVolumeTestJSON-1454716698 tempest-AttachVolumeTestJSON-1454716698-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:49:20.096151 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-83b63c38-6c49-4308-a5a5-98f5e8c85d57 tempest-AttachVolumeTestJSON-1454716698 tempest-AttachVolumeTestJSON-1454716698-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:49:20.096932 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-83b63c38-6c49-4308-a5a5-98f5e8c85d57 tempest-AttachVolumeTestJSON-1454716698 tempest-AttachVolumeTestJSON-1454716698-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:49:20.097358 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-83b63c38-6c49-4308-a5a5-98f5e8c85d57 tempest-AttachVolumeTestJSON-1454716698 tempest-AttachVolumeTestJSON-1454716698-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:49:20.246946 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.policy [None req-83b63c38-6c49-4308-a5a5-98f5e8c85d57 tempest-AttachVolumeTestJSON-1454716698 tempest-AttachVolumeTestJSON-1454716698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e987a71a29243dbac6c23e337765508', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9f9a22ad1e74798b9b2f7d85f89a4b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129322) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:49:20.255691 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: INFO nova.api.openstack.requestlog [None req-83b63c38-6c49-4308-a5a5-98f5e8c85d57 tempest-AttachVolumeTestJSON-1454716698 tempest-AttachVolumeTestJSON-1454716698-project] 10.222.0.75 "GET /compute/v2.1/servers/51b4bd5b-19a0-4b50-804d-aff4216e854c" status: 200 len: 1722 microversion: 2.1 time: 0.176672 May 26 12:49:20.256291 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: [pid: 129322|app: 0|req: 531/1042] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 26 12:49:20 2022] GET /compute/v2.1/servers/51b4bd5b-19a0-4b50-804d-aff4216e854c => generated 1722 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:49:21.273997 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi [None req-05642ff6-6513-4249-9dcf-6854ac71c44c tempest-AttachVolumeTestJSON-1454716698 tempest-AttachVolumeTestJSON-1454716698-project] Calling method '>' {{(pid=129321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:49:21.274749 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.compute.api [None req-05642ff6-6513-4249-9dcf-6854ac71c44c tempest-AttachVolumeTestJSON-1454716698 tempest-AttachVolumeTestJSON-1454716698-project] [instance: 51b4bd5b-19a0-4b50-804d-aff4216e854c] Fetching instance by UUID {{(pid=129321) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:49:21.285467 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-05642ff6-6513-4249-9dcf-6854ac71c44c tempest-AttachVolumeTestJSON-1454716698 tempest-AttachVolumeTestJSON-1454716698-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:49:21.286230 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-05642ff6-6513-4249-9dcf-6854ac71c44c tempest-AttachVolumeTestJSON-1454716698 tempest-AttachVolumeTestJSON-1454716698-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:49:21.287495 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-05642ff6-6513-4249-9dcf-6854ac71c44c tempest-AttachVolumeTestJSON-1454716698 tempest-AttachVolumeTestJSON-1454716698-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:49:21.288284 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-05642ff6-6513-4249-9dcf-6854ac71c44c tempest-AttachVolumeTestJSON-1454716698 tempest-AttachVolumeTestJSON-1454716698-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:49:21.424502 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.policy [None req-05642ff6-6513-4249-9dcf-6854ac71c44c tempest-AttachVolumeTestJSON-1454716698 tempest-AttachVolumeTestJSON-1454716698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e987a71a29243dbac6c23e337765508', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9f9a22ad1e74798b9b2f7d85f89a4b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129321) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:49:21.433315 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: INFO nova.api.openstack.requestlog [None req-05642ff6-6513-4249-9dcf-6854ac71c44c tempest-AttachVolumeTestJSON-1454716698 tempest-AttachVolumeTestJSON-1454716698-project] 10.222.0.75 "GET /compute/v2.1/servers/51b4bd5b-19a0-4b50-804d-aff4216e854c" status: 200 len: 1722 microversion: 2.1 time: 0.163788 May 26 12:49:21.433893 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: [pid: 129321|app: 0|req: 512/1043] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 26 12:49:21 2022] GET /compute/v2.1/servers/51b4bd5b-19a0-4b50-804d-aff4216e854c => generated 1722 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:49:22.451231 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi [None req-83f315ea-3550-46df-85d2-015615513911 tempest-AttachVolumeTestJSON-1454716698 tempest-AttachVolumeTestJSON-1454716698-project] Calling method '>' {{(pid=129322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:49:22.451987 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.compute.api [None req-83f315ea-3550-46df-85d2-015615513911 tempest-AttachVolumeTestJSON-1454716698 tempest-AttachVolumeTestJSON-1454716698-project] [instance: 51b4bd5b-19a0-4b50-804d-aff4216e854c] Fetching instance by UUID {{(pid=129322) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:49:22.459327 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-83f315ea-3550-46df-85d2-015615513911 tempest-AttachVolumeTestJSON-1454716698 tempest-AttachVolumeTestJSON-1454716698-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:49:22.459806 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-83f315ea-3550-46df-85d2-015615513911 tempest-AttachVolumeTestJSON-1454716698 tempest-AttachVolumeTestJSON-1454716698-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:49:22.461694 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-83f315ea-3550-46df-85d2-015615513911 tempest-AttachVolumeTestJSON-1454716698 tempest-AttachVolumeTestJSON-1454716698-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:49:22.461694 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-83f315ea-3550-46df-85d2-015615513911 tempest-AttachVolumeTestJSON-1454716698 tempest-AttachVolumeTestJSON-1454716698-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:49:22.463967 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG dbcounter [-] [129322] Writing DB stats nova_cell1:SELECT=70,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=129322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:49:22.606545 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.policy [None req-83f315ea-3550-46df-85d2-015615513911 tempest-AttachVolumeTestJSON-1454716698 tempest-AttachVolumeTestJSON-1454716698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e987a71a29243dbac6c23e337765508', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9f9a22ad1e74798b9b2f7d85f89a4b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129322) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:49:22.615419 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: INFO nova.api.openstack.requestlog [None req-83f315ea-3550-46df-85d2-015615513911 tempest-AttachVolumeTestJSON-1454716698 tempest-AttachVolumeTestJSON-1454716698-project] 10.222.0.75 "GET /compute/v2.1/servers/51b4bd5b-19a0-4b50-804d-aff4216e854c" status: 200 len: 1722 microversion: 2.1 time: 0.168110 May 26 12:49:22.616085 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: [pid: 129322|app: 0|req: 532/1044] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 26 12:49:22 2022] GET /compute/v2.1/servers/51b4bd5b-19a0-4b50-804d-aff4216e854c => generated 1722 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:49:23.632902 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi [None req-38d95c32-0264-485c-9258-0b42efbac2d8 tempest-AttachVolumeTestJSON-1454716698 tempest-AttachVolumeTestJSON-1454716698-project] Calling method '>' {{(pid=129321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:49:23.633559 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.compute.api [None req-38d95c32-0264-485c-9258-0b42efbac2d8 tempest-AttachVolumeTestJSON-1454716698 tempest-AttachVolumeTestJSON-1454716698-project] [instance: 51b4bd5b-19a0-4b50-804d-aff4216e854c] Fetching instance by UUID {{(pid=129321) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:49:23.642902 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-38d95c32-0264-485c-9258-0b42efbac2d8 tempest-AttachVolumeTestJSON-1454716698 tempest-AttachVolumeTestJSON-1454716698-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:49:23.643796 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-38d95c32-0264-485c-9258-0b42efbac2d8 tempest-AttachVolumeTestJSON-1454716698 tempest-AttachVolumeTestJSON-1454716698-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:49:23.645395 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-38d95c32-0264-485c-9258-0b42efbac2d8 tempest-AttachVolumeTestJSON-1454716698 tempest-AttachVolumeTestJSON-1454716698-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:49:23.646043 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-38d95c32-0264-485c-9258-0b42efbac2d8 tempest-AttachVolumeTestJSON-1454716698 tempest-AttachVolumeTestJSON-1454716698-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:49:23.796999 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.policy [None req-38d95c32-0264-485c-9258-0b42efbac2d8 tempest-AttachVolumeTestJSON-1454716698 tempest-AttachVolumeTestJSON-1454716698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e987a71a29243dbac6c23e337765508', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9f9a22ad1e74798b9b2f7d85f89a4b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129321) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:49:23.806178 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: INFO nova.api.openstack.requestlog [None req-38d95c32-0264-485c-9258-0b42efbac2d8 tempest-AttachVolumeTestJSON-1454716698 tempest-AttachVolumeTestJSON-1454716698-project] 10.222.0.75 "GET /compute/v2.1/servers/51b4bd5b-19a0-4b50-804d-aff4216e854c" status: 200 len: 1699 microversion: 2.1 time: 0.177228 May 26 12:49:23.806774 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: [pid: 129321|app: 0|req: 513/1045] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 26 12:49:23 2022] GET /compute/v2.1/servers/51b4bd5b-19a0-4b50-804d-aff4216e854c => generated 1699 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:49:23.823416 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi [None req-c5a1b5eb-ae31-4f90-87bc-0d22eefc6599 tempest-AttachVolumeTestJSON-1454716698 tempest-AttachVolumeTestJSON-1454716698-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=129322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 12:49:23.830685 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-c5a1b5eb-ae31-4f90-87bc-0d22eefc6599 tempest-AttachVolumeTestJSON-1454716698 tempest-AttachVolumeTestJSON-1454716698-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:49:23.831125 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-c5a1b5eb-ae31-4f90-87bc-0d22eefc6599 tempest-AttachVolumeTestJSON-1454716698 tempest-AttachVolumeTestJSON-1454716698-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:49:23.892937 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.compute.api [None req-c5a1b5eb-ae31-4f90-87bc-0d22eefc6599 tempest-AttachVolumeTestJSON-1454716698 tempest-AttachVolumeTestJSON-1454716698-project] [instance: 51b4bd5b-19a0-4b50-804d-aff4216e854c] Going to try to start instance {{(pid=129322) start /opt/stack/nova/nova/compute/api.py:2730}} May 26 12:49:23.944609 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: INFO nova.api.openstack.requestlog [None req-c5a1b5eb-ae31-4f90-87bc-0d22eefc6599 tempest-AttachVolumeTestJSON-1454716698 tempest-AttachVolumeTestJSON-1454716698-project] 10.222.0.75 "POST /compute/v2.1/servers/51b4bd5b-19a0-4b50-804d-aff4216e854c/action" status: 202 len: 0 microversion: 2.1 time: 0.124379 May 26 12:49:23.945524 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: [pid: 129322|app: 0|req: 533/1046] 10.222.0.75 () {60 vars in 1277 bytes} [Thu May 26 12:49:23 2022] POST /compute/v2.1/servers/51b4bd5b-19a0-4b50-804d-aff4216e854c/action => generated 0 bytes in 127 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 26 12:49:23.958063 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi [None req-08aa96bc-c522-4dbb-bf1e-47892527b2b6 tempest-AttachVolumeTestJSON-1454716698 tempest-AttachVolumeTestJSON-1454716698-project] Calling method '>' {{(pid=129321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:49:23.958900 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.compute.api [None req-08aa96bc-c522-4dbb-bf1e-47892527b2b6 tempest-AttachVolumeTestJSON-1454716698 tempest-AttachVolumeTestJSON-1454716698-project] [instance: 51b4bd5b-19a0-4b50-804d-aff4216e854c] Fetching instance by UUID {{(pid=129321) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:49:23.967219 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-08aa96bc-c522-4dbb-bf1e-47892527b2b6 tempest-AttachVolumeTestJSON-1454716698 tempest-AttachVolumeTestJSON-1454716698-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:49:23.967762 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-08aa96bc-c522-4dbb-bf1e-47892527b2b6 tempest-AttachVolumeTestJSON-1454716698 tempest-AttachVolumeTestJSON-1454716698-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:49:23.968640 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-08aa96bc-c522-4dbb-bf1e-47892527b2b6 tempest-AttachVolumeTestJSON-1454716698 tempest-AttachVolumeTestJSON-1454716698-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:49:23.969248 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-08aa96bc-c522-4dbb-bf1e-47892527b2b6 tempest-AttachVolumeTestJSON-1454716698 tempest-AttachVolumeTestJSON-1454716698-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:49:24.109244 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.policy [None req-08aa96bc-c522-4dbb-bf1e-47892527b2b6 tempest-AttachVolumeTestJSON-1454716698 tempest-AttachVolumeTestJSON-1454716698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e987a71a29243dbac6c23e337765508', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9f9a22ad1e74798b9b2f7d85f89a4b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129321) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:49:24.118121 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: INFO nova.api.openstack.requestlog [None req-08aa96bc-c522-4dbb-bf1e-47892527b2b6 tempest-AttachVolumeTestJSON-1454716698 tempest-AttachVolumeTestJSON-1454716698-project] 10.222.0.75 "GET /compute/v2.1/servers/51b4bd5b-19a0-4b50-804d-aff4216e854c" status: 200 len: 1708 microversion: 2.1 time: 0.166032 May 26 12:49:24.119021 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: [pid: 129321|app: 0|req: 514/1047] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 26 12:49:23 2022] GET /compute/v2.1/servers/51b4bd5b-19a0-4b50-804d-aff4216e854c => generated 1708 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:49:25.139570 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi [None req-a71d6a25-8d10-429d-9493-36ded4596776 tempest-AttachVolumeTestJSON-1454716698 tempest-AttachVolumeTestJSON-1454716698-project] Calling method '>' {{(pid=129322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:49:25.140278 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.compute.api [None req-a71d6a25-8d10-429d-9493-36ded4596776 tempest-AttachVolumeTestJSON-1454716698 tempest-AttachVolumeTestJSON-1454716698-project] [instance: 51b4bd5b-19a0-4b50-804d-aff4216e854c] Fetching instance by UUID {{(pid=129322) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:49:25.148001 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-a71d6a25-8d10-429d-9493-36ded4596776 tempest-AttachVolumeTestJSON-1454716698 tempest-AttachVolumeTestJSON-1454716698-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:49:25.148449 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-a71d6a25-8d10-429d-9493-36ded4596776 tempest-AttachVolumeTestJSON-1454716698 tempest-AttachVolumeTestJSON-1454716698-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:49:25.149226 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-a71d6a25-8d10-429d-9493-36ded4596776 tempest-AttachVolumeTestJSON-1454716698 tempest-AttachVolumeTestJSON-1454716698-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:49:25.149661 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-a71d6a25-8d10-429d-9493-36ded4596776 tempest-AttachVolumeTestJSON-1454716698 tempest-AttachVolumeTestJSON-1454716698-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:49:25.296365 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.policy [None req-a71d6a25-8d10-429d-9493-36ded4596776 tempest-AttachVolumeTestJSON-1454716698 tempest-AttachVolumeTestJSON-1454716698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e987a71a29243dbac6c23e337765508', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9f9a22ad1e74798b9b2f7d85f89a4b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129322) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:49:25.306111 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: INFO nova.api.openstack.requestlog [None req-a71d6a25-8d10-429d-9493-36ded4596776 tempest-AttachVolumeTestJSON-1454716698 tempest-AttachVolumeTestJSON-1454716698-project] 10.222.0.75 "GET /compute/v2.1/servers/51b4bd5b-19a0-4b50-804d-aff4216e854c" status: 200 len: 1708 microversion: 2.1 time: 0.171864 May 26 12:49:25.306686 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: [pid: 129322|app: 0|req: 534/1048] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 26 12:49:25 2022] GET /compute/v2.1/servers/51b4bd5b-19a0-4b50-804d-aff4216e854c => generated 1708 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:49:26.325156 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi [None req-5d469b2f-0721-4fca-9af3-068580f61a57 tempest-AttachVolumeTestJSON-1454716698 tempest-AttachVolumeTestJSON-1454716698-project] Calling method '>' {{(pid=129321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:49:26.325753 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.compute.api [None req-5d469b2f-0721-4fca-9af3-068580f61a57 tempest-AttachVolumeTestJSON-1454716698 tempest-AttachVolumeTestJSON-1454716698-project] [instance: 51b4bd5b-19a0-4b50-804d-aff4216e854c] Fetching instance by UUID {{(pid=129321) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:49:26.333230 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-5d469b2f-0721-4fca-9af3-068580f61a57 tempest-AttachVolumeTestJSON-1454716698 tempest-AttachVolumeTestJSON-1454716698-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:49:26.333673 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-5d469b2f-0721-4fca-9af3-068580f61a57 tempest-AttachVolumeTestJSON-1454716698 tempest-AttachVolumeTestJSON-1454716698-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:49:26.334438 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-5d469b2f-0721-4fca-9af3-068580f61a57 tempest-AttachVolumeTestJSON-1454716698 tempest-AttachVolumeTestJSON-1454716698-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:49:26.334864 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-5d469b2f-0721-4fca-9af3-068580f61a57 tempest-AttachVolumeTestJSON-1454716698 tempest-AttachVolumeTestJSON-1454716698-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:49:26.485237 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.policy [None req-5d469b2f-0721-4fca-9af3-068580f61a57 tempest-AttachVolumeTestJSON-1454716698 tempest-AttachVolumeTestJSON-1454716698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e987a71a29243dbac6c23e337765508', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9f9a22ad1e74798b9b2f7d85f89a4b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129321) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:49:26.494011 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: INFO nova.api.openstack.requestlog [None req-5d469b2f-0721-4fca-9af3-068580f61a57 tempest-AttachVolumeTestJSON-1454716698 tempest-AttachVolumeTestJSON-1454716698-project] 10.222.0.75 "GET /compute/v2.1/servers/51b4bd5b-19a0-4b50-804d-aff4216e854c" status: 200 len: 1712 microversion: 2.1 time: 0.172854 May 26 12:49:26.494608 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: [pid: 129321|app: 0|req: 515/1049] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 26 12:49:26 2022] GET /compute/v2.1/servers/51b4bd5b-19a0-4b50-804d-aff4216e854c => generated 1712 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:49:38.814511 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi [None req-49baeab2-c0e5-449e-8534-793f9775f1f3 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Calling method '>' {{(pid=129322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:49:38.815499 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.compute.api [None req-49baeab2-c0e5-449e-8534-793f9775f1f3 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] [instance: f44f180b-9143-43d6-b9cd-ced0c42fd928] Fetching instance by UUID {{(pid=129322) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:49:38.818231 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG dbcounter [-] [129322] Writing DB stats nova_api:SELECT=15 {{(pid=129322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:49:38.818866 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG dbcounter [-] [129322] Writing DB stats nova_cell1:SELECT=21,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:49:38.825266 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-49baeab2-c0e5-449e-8534-793f9775f1f3 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:49:38.825711 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-49baeab2-c0e5-449e-8534-793f9775f1f3 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:49:38.826481 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-49baeab2-c0e5-449e-8534-793f9775f1f3 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:49:38.826917 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-49baeab2-c0e5-449e-8534-793f9775f1f3 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:49:38.861650 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: INFO nova.api.openstack.requestlog [None req-49baeab2-c0e5-449e-8534-793f9775f1f3 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] 10.222.0.75 "GET /compute/v2.1/servers/f44f180b-9143-43d6-b9cd-ced0c42fd928/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.050998 May 26 12:49:38.862220 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: [pid: 129322|app: 0|req: 535/1050] 10.222.0.75 () {60 vars in 1342 bytes} [Thu May 26 12:49:38 2022] GET /compute/v2.1/servers/f44f180b-9143-43d6-b9cd-ced0c42fd928/os-volume_attachments => generated 25 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:49:38.934699 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi [None req-ee4fa391-1ede-4997-b3d9-0436c9cb3db5 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Calling method '>' {{(pid=129321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:49:38.935324 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.compute.api [None req-ee4fa391-1ede-4997-b3d9-0436c9cb3db5 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] [instance: f44f180b-9143-43d6-b9cd-ced0c42fd928] Fetching instance by UUID {{(pid=129321) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:49:38.938935 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG dbcounter [-] [129321] Writing DB stats nova_api:SELECT=16 {{(pid=129321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:49:38.939605 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG dbcounter [-] [129321] Writing DB stats nova_cell1:SELECT=52,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:49:38.947485 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-ee4fa391-1ede-4997-b3d9-0436c9cb3db5 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:49:38.948143 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-ee4fa391-1ede-4997-b3d9-0436c9cb3db5 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:49:38.949207 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-ee4fa391-1ede-4997-b3d9-0436c9cb3db5 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:49:38.952367 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-ee4fa391-1ede-4997-b3d9-0436c9cb3db5 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:49:38.978800 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.compute.api [None req-ee4fa391-1ede-4997-b3d9-0436c9cb3db5 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] [instance: f44f180b-9143-43d6-b9cd-ced0c42fd928] Going to try to terminate instance {{(pid=129321) delete /opt/stack/nova/nova/compute/api.py:2664}} May 26 12:49:39.074334 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: INFO nova.api.openstack.requestlog [None req-ee4fa391-1ede-4997-b3d9-0436c9cb3db5 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] 10.222.0.75 "DELETE /compute/v2.1/servers/f44f180b-9143-43d6-b9cd-ced0c42fd928" status: 204 len: 0 microversion: 2.20 time: 0.145698 May 26 12:49:39.075085 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: [pid: 129321|app: 0|req: 516/1051] 10.222.0.75 () {60 vars in 1279 bytes} [Thu May 26 12:49:38 2022] DELETE /compute/v2.1/servers/f44f180b-9143-43d6-b9cd-ced0c42fd928 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) May 26 12:49:39.084740 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi [None req-db401bb9-5788-4eec-bb49-6014854ae78e tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Calling method '>' {{(pid=129322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:49:39.085372 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.compute.api [None req-db401bb9-5788-4eec-bb49-6014854ae78e tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] [instance: f44f180b-9143-43d6-b9cd-ced0c42fd928] Fetching instance by UUID {{(pid=129322) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:49:39.091765 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-db401bb9-5788-4eec-bb49-6014854ae78e tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:49:39.092225 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-db401bb9-5788-4eec-bb49-6014854ae78e tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:49:39.092988 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-db401bb9-5788-4eec-bb49-6014854ae78e tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:49:39.093425 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-db401bb9-5788-4eec-bb49-6014854ae78e tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:49:39.230665 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.policy [None req-db401bb9-5788-4eec-bb49-6014854ae78e tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e811736979c44b02b14fecb74c6bd7ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675272fb40d4847819f83ec04afecef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129322) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:49:39.243348 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.policy [None req-db401bb9-5788-4eec-bb49-6014854ae78e tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e811736979c44b02b14fecb74c6bd7ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675272fb40d4847819f83ec04afecef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129322) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:49:39.245756 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.policy [None req-db401bb9-5788-4eec-bb49-6014854ae78e tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e811736979c44b02b14fecb74c6bd7ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675272fb40d4847819f83ec04afecef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129322) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:49:39.247610 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: INFO nova.api.openstack.requestlog [None req-db401bb9-5788-4eec-bb49-6014854ae78e tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] 10.222.0.75 "GET /compute/v2.1/servers/f44f180b-9143-43d6-b9cd-ced0c42fd928" status: 200 len: 1725 microversion: 2.20 time: 0.167605 May 26 12:49:39.248379 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: [pid: 129322|app: 0|req: 536/1052] 10.222.0.75 () {60 vars in 1276 bytes} [Thu May 26 12:49:39 2022] GET /compute/v2.1/servers/f44f180b-9143-43d6-b9cd-ced0c42fd928 => generated 1725 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 12:49:40.271879 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi [None req-c4257253-08ae-4975-94b8-869b0c057ab0 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Calling method '>' {{(pid=129321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:49:40.272932 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.compute.api [None req-c4257253-08ae-4975-94b8-869b0c057ab0 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] [instance: f44f180b-9143-43d6-b9cd-ced0c42fd928] Fetching instance by UUID {{(pid=129321) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:49:40.283810 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-c4257253-08ae-4975-94b8-869b0c057ab0 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:49:40.284281 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-c4257253-08ae-4975-94b8-869b0c057ab0 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:49:40.285046 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-c4257253-08ae-4975-94b8-869b0c057ab0 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:49:40.285470 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-c4257253-08ae-4975-94b8-869b0c057ab0 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:49:40.429404 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.policy [None req-c4257253-08ae-4975-94b8-869b0c057ab0 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e811736979c44b02b14fecb74c6bd7ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675272fb40d4847819f83ec04afecef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129321) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:49:40.437729 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.policy [None req-c4257253-08ae-4975-94b8-869b0c057ab0 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e811736979c44b02b14fecb74c6bd7ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675272fb40d4847819f83ec04afecef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129321) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:49:40.439290 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.policy [None req-c4257253-08ae-4975-94b8-869b0c057ab0 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e811736979c44b02b14fecb74c6bd7ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675272fb40d4847819f83ec04afecef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129321) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:49:40.440512 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: INFO nova.api.openstack.requestlog [None req-c4257253-08ae-4975-94b8-869b0c057ab0 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] 10.222.0.75 "GET /compute/v2.1/servers/f44f180b-9143-43d6-b9cd-ced0c42fd928" status: 200 len: 1725 microversion: 2.20 time: 0.175896 May 26 12:49:40.441085 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: [pid: 129321|app: 0|req: 517/1053] 10.222.0.75 () {60 vars in 1276 bytes} [Thu May 26 12:49:40 2022] GET /compute/v2.1/servers/f44f180b-9143-43d6-b9cd-ced0c42fd928 => generated 1725 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 12:49:41.458684 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi [None req-12aa394a-1c91-4d4c-a76c-5c4041a4eed4 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Calling method '>' {{(pid=129322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:49:41.459342 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.compute.api [None req-12aa394a-1c91-4d4c-a76c-5c4041a4eed4 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] [instance: f44f180b-9143-43d6-b9cd-ced0c42fd928] Fetching instance by UUID {{(pid=129322) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:49:41.466567 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-12aa394a-1c91-4d4c-a76c-5c4041a4eed4 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:49:41.467020 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-12aa394a-1c91-4d4c-a76c-5c4041a4eed4 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:49:41.467830 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-12aa394a-1c91-4d4c-a76c-5c4041a4eed4 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:49:41.468266 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-12aa394a-1c91-4d4c-a76c-5c4041a4eed4 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:49:41.616268 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.policy [None req-12aa394a-1c91-4d4c-a76c-5c4041a4eed4 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e811736979c44b02b14fecb74c6bd7ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675272fb40d4847819f83ec04afecef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129322) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:49:41.625704 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.policy [None req-12aa394a-1c91-4d4c-a76c-5c4041a4eed4 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e811736979c44b02b14fecb74c6bd7ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675272fb40d4847819f83ec04afecef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129322) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:49:41.627748 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.policy [None req-12aa394a-1c91-4d4c-a76c-5c4041a4eed4 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e811736979c44b02b14fecb74c6bd7ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675272fb40d4847819f83ec04afecef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129322) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:49:41.628869 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: INFO nova.api.openstack.requestlog [None req-12aa394a-1c91-4d4c-a76c-5c4041a4eed4 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] 10.222.0.75 "GET /compute/v2.1/servers/f44f180b-9143-43d6-b9cd-ced0c42fd928" status: 200 len: 1725 microversion: 2.20 time: 0.174247 May 26 12:49:41.640472 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: [pid: 129322|app: 0|req: 537/1054] 10.222.0.75 () {60 vars in 1276 bytes} [Thu May 26 12:49:41 2022] GET /compute/v2.1/servers/f44f180b-9143-43d6-b9cd-ced0c42fd928 => generated 1725 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 12:49:41.920383 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi [req-80ef1c0d-a34d-4c3c-9191-caeaa5b23aca req-0f9217e8-cee8-4bbd-a908-51b16385a3d8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f44f180b-9143-43d6-b9cd-ced0c42fd928", "name": "network-vif-deleted", "tag": "f9559056-2d17-4245-b9b6-e29db32c9ee2"}]} {{(pid=129321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 12:49:41.931425 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [req-80ef1c0d-a34d-4c3c-9191-caeaa5b23aca req-0f9217e8-cee8-4bbd-a908-51b16385a3d8 service nova] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:49:41.931921 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [req-80ef1c0d-a34d-4c3c-9191-caeaa5b23aca req-0f9217e8-cee8-4bbd-a908-51b16385a3d8 service nova] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:49:41.944126 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: INFO nova.api.openstack.compute.server_external_events [req-80ef1c0d-a34d-4c3c-9191-caeaa5b23aca req-0f9217e8-cee8-4bbd-a908-51b16385a3d8 service nova] Creating event network-vif-deleted:f9559056-2d17-4245-b9b6-e29db32c9ee2 for instance f44f180b-9143-43d6-b9cd-ced0c42fd928 on hv-cinder-81966 May 26 12:49:41.951719 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: INFO nova.api.openstack.requestlog [req-80ef1c0d-a34d-4c3c-9191-caeaa5b23aca req-0f9217e8-cee8-4bbd-a908-51b16385a3d8 service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033307 May 26 12:49:41.952376 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: [pid: 129321|app: 0|req: 518/1055] 10.222.0.75 () {64 vars in 1317 bytes} [Thu May 26 12:49:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 12:49:42.649315 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi [None req-0a54ac9d-4960-4c0d-9eb6-5e007968b3e5 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Calling method '>' {{(pid=129322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:49:42.649902 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.compute.api [None req-0a54ac9d-4960-4c0d-9eb6-5e007968b3e5 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] [instance: f44f180b-9143-43d6-b9cd-ced0c42fd928] Fetching instance by UUID {{(pid=129322) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:49:42.656690 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-0a54ac9d-4960-4c0d-9eb6-5e007968b3e5 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:49:42.657177 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-0a54ac9d-4960-4c0d-9eb6-5e007968b3e5 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:49:42.657924 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-0a54ac9d-4960-4c0d-9eb6-5e007968b3e5 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:49:42.658418 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-0a54ac9d-4960-4c0d-9eb6-5e007968b3e5 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:49:42.672838 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: INFO nova.api.openstack.wsgi [None req-0a54ac9d-4960-4c0d-9eb6-5e007968b3e5 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] HTTP exception thrown: Instance f44f180b-9143-43d6-b9cd-ced0c42fd928 could not be found. May 26 12:49:42.674714 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi [None req-0a54ac9d-4960-4c0d-9eb6-5e007968b3e5 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Request method failure captured: May 26 12:49:42.674714 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: request: GET /compute/v2.1/servers/f44f180b-9143-43d6-b9cd-ced0c42fd928 HTTP/1.1 May 26 12:49:42.674714 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: Accept: application/json May 26 12:49:42.674714 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: Accept-Encoding: identity May 26 12:49:42.674714 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: Connection: close May 26 12:49:42.674714 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: Content-Length: 0 May 26 12:49:42.674714 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: Content-Type: application/json May 26 12:49:42.674714 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: Host: 10.222.0.75 May 26 12:49:42.674714 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: Openstack-System-Scope: None May 26 12:49:42.674714 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: User-Agent: python-urllib3/1.26.9 May 26 12:49:42.674714 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: X-Auth-Token: gAAAAABij3Sy8x7VV7VbECm0oEshoygvVRqWfKgNcFRrHFj9mPSXKcXMQg8tIDkBA2P8iWFUbZBbkZzGIVXR8vvKmlK1yee67frqgDXV0AqNB-hRFdphj0XmjeijkCFuTITZvKDXJc1QXfRaH7-s7Z1FsQJ8w5ORPhObMUWuv1bJTbuUJB-nFHE May 26 12:49:42.674714 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: X-Domain-Id: None May 26 12:49:42.674714 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: X-Domain-Name: None May 26 12:49:42.674714 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: X-Identity-Status: Confirmed May 26 12:49:42.674714 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: X-Is-Admin-Project: True May 26 12:49:42.674714 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: X-Openstack-Nova-Api-Version: 2.20 May 26 12:49:42.674714 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: X-Project-Domain-Id: default May 26 12:49:42.674714 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: X-Project-Domain-Name: Default May 26 12:49:42.674714 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: X-Project-Id: 2675272fb40d4847819f83ec04afecef May 26 12:49:42.674714 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-777401856 May 26 12:49:42.674714 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: X-Role: member,reader May 26 12:49:42.674714 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: X-Roles: member,reader May 26 12:49:42.676461 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/2675272fb40d4847819f83ec04afecef"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.75:8080", "publicURL": "http://10.222.0.75:8080/v1/AUTH_2675272fb40d4847819f83ec04afecef"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2/2675272fb40d4847819f83ec04afecef"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/2675272fb40d4847819f83ec04afecef"}]}] May 26 12:49:42.676461 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: X-Tenant: tempest-AttachVolumeShelveTestJSON-777401856 May 26 12:49:42.676461 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: X-Tenant-Id: 2675272fb40d4847819f83ec04afecef May 26 12:49:42.676461 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-777401856 May 26 12:49:42.676461 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: X-User: tempest-AttachVolumeShelveTestJSON-777401856-project May 26 12:49:42.676461 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: X-User-Domain-Id: default May 26 12:49:42.676461 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: X-User-Domain-Name: Default May 26 12:49:42.676461 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: X-User-Id: e811736979c44b02b14fecb74c6bd7ab May 26 12:49:42.676461 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: X-User-Name: tempest-AttachVolumeShelveTestJSON-777401856-project May 26 12:49:42.676461 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: method: > May 26 12:49:42.676461 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: exception: Instance f44f180b-9143-43d6-b9cd-ced0c42fd928 could not be found. May 26 12:49:42.676461 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: action_args: {'id': 'f44f180b-9143-43d6-b9cd-ced0c42fd928'} May 26 12:49:42.677369 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: {{(pid=129322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 12:49:42.677369 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 12:49:42.677369 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 26 12:49:42.677369 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 26 12:49:42.677369 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 26 12:49:42.677369 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 26 12:49:42.677369 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 26 12:49:42.677369 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 26 12:49:42.677369 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 26 12:49:42.677369 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 26 12:49:42.677369 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f44f180b-9143-43d6-b9cd-ced0c42fd928 could not be found. May 26 12:49:42.677369 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi May 26 12:49:42.677369 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 12:49:42.677369 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi May 26 12:49:42.677369 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 12:49:42.677369 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 12:49:42.677369 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 12:49:42.677369 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 12:49:42.677369 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 12:49:42.677369 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 12:49:42.678880 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 12:49:42.678880 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 26 12:49:42.678880 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 26 12:49:42.678880 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 26 12:49:42.678880 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 26 12:49:42.678880 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 26 12:49:42.678880 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 12:49:42.678880 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f44f180b-9143-43d6-b9cd-ced0c42fd928 could not be found. May 26 12:49:42.678880 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi May 26 12:49:42.678880 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 12:49:42.678880 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi May 26 12:49:42.678880 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 12:49:42.678880 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 12:49:42.678880 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 12:49:42.678880 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 12:49:42.678880 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 12:49:42.678880 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f44f180b-9143-43d6-b9cd-ced0c42fd928 could not be found. May 26 12:49:42.678880 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi May 26 12:49:42.680607 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi [None req-0a54ac9d-4960-4c0d-9eb6-5e007968b3e5 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Returning 404 to user: Instance f44f180b-9143-43d6-b9cd-ced0c42fd928 could not be found. {{(pid=129322) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 12:49:42.680607 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: INFO nova.api.openstack.requestlog [None req-0a54ac9d-4960-4c0d-9eb6-5e007968b3e5 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] 10.222.0.75 "GET /compute/v2.1/servers/f44f180b-9143-43d6-b9cd-ced0c42fd928" status: 404 len: 111 microversion: 2.20 time: 0.031116 May 26 12:49:42.681546 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: [pid: 129322|app: 0|req: 538/1056] 10.222.0.75 () {60 vars in 1276 bytes} [Thu May 26 12:49:42 2022] GET /compute/v2.1/servers/f44f180b-9143-43d6-b9cd-ced0c42fd928 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 26 12:49:42.686516 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi [None req-60273e62-755d-4d32-829d-279c14b7d4b1 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Calling method '.version_select at 0x7f830817cb80>' {{(pid=129321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:49:42.710793 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: INFO nova.api.openstack.requestlog [None req-60273e62-755d-4d32-829d-279c14b7d4b1 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] 10.222.0.75 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1648631296" status: 204 len: 0 microversion: 2.20 time: 0.028444 May 26 12:49:42.711389 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: [pid: 129321|app: 0|req: 519/1057] 10.222.0.75 () {60 vars in 1261 bytes} [Thu May 26 12:49:42 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1648631296 => generated 0 bytes in 30 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) May 26 12:49:44.535724 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi [None req-03bfa485-3891-4ef0-bf1e-d61c2e092edd tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Calling method '>' {{(pid=129322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:49:44.536315 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.compute.api [None req-03bfa485-3891-4ef0-bf1e-d61c2e092edd tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] [instance: f44f180b-9143-43d6-b9cd-ced0c42fd928] Fetching instance by UUID {{(pid=129322) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:49:44.544532 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-03bfa485-3891-4ef0-bf1e-d61c2e092edd tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:49:44.545295 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-03bfa485-3891-4ef0-bf1e-d61c2e092edd tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:49:44.546523 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-03bfa485-3891-4ef0-bf1e-d61c2e092edd tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:49:44.547220 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-03bfa485-3891-4ef0-bf1e-d61c2e092edd tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:49:44.563707 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: INFO nova.api.openstack.wsgi [None req-03bfa485-3891-4ef0-bf1e-d61c2e092edd tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] HTTP exception thrown: Instance f44f180b-9143-43d6-b9cd-ced0c42fd928 could not be found. May 26 12:49:44.565393 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi [None req-03bfa485-3891-4ef0-bf1e-d61c2e092edd tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Request method failure captured: May 26 12:49:44.565393 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: request: DELETE /compute/v2.1/servers/f44f180b-9143-43d6-b9cd-ced0c42fd928 HTTP/1.1 May 26 12:49:44.565393 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: Accept: application/json May 26 12:49:44.565393 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: Accept-Encoding: identity May 26 12:49:44.565393 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: Connection: close May 26 12:49:44.565393 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: Content-Length: 0 May 26 12:49:44.565393 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: Content-Type: application/json May 26 12:49:44.565393 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: Host: 10.222.0.75 May 26 12:49:44.565393 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: Openstack-System-Scope: None May 26 12:49:44.565393 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: User-Agent: python-urllib3/1.26.9 May 26 12:49:44.565393 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: X-Auth-Token: gAAAAABij3Sy8x7VV7VbECm0oEshoygvVRqWfKgNcFRrHFj9mPSXKcXMQg8tIDkBA2P8iWFUbZBbkZzGIVXR8vvKmlK1yee67frqgDXV0AqNB-hRFdphj0XmjeijkCFuTITZvKDXJc1QXfRaH7-s7Z1FsQJ8w5ORPhObMUWuv1bJTbuUJB-nFHE May 26 12:49:44.565393 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: X-Domain-Id: None May 26 12:49:44.565393 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: X-Domain-Name: None May 26 12:49:44.565393 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: X-Identity-Status: Confirmed May 26 12:49:44.565393 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: X-Is-Admin-Project: True May 26 12:49:44.565393 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: X-Openstack-Nova-Api-Version: 2.20 May 26 12:49:44.565393 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: X-Project-Domain-Id: default May 26 12:49:44.565393 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: X-Project-Domain-Name: Default May 26 12:49:44.565393 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: X-Project-Id: 2675272fb40d4847819f83ec04afecef May 26 12:49:44.565393 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-777401856 May 26 12:49:44.565393 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: X-Role: member,reader May 26 12:49:44.565393 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: X-Roles: member,reader May 26 12:49:44.567236 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/2675272fb40d4847819f83ec04afecef"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.75:8080", "publicURL": "http://10.222.0.75:8080/v1/AUTH_2675272fb40d4847819f83ec04afecef"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2/2675272fb40d4847819f83ec04afecef"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/2675272fb40d4847819f83ec04afecef"}]}] May 26 12:49:44.567236 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: X-Tenant: tempest-AttachVolumeShelveTestJSON-777401856 May 26 12:49:44.567236 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: X-Tenant-Id: 2675272fb40d4847819f83ec04afecef May 26 12:49:44.567236 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-777401856 May 26 12:49:44.567236 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: X-User: tempest-AttachVolumeShelveTestJSON-777401856-project May 26 12:49:44.567236 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: X-User-Domain-Id: default May 26 12:49:44.567236 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: X-User-Domain-Name: Default May 26 12:49:44.567236 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: X-User-Id: e811736979c44b02b14fecb74c6bd7ab May 26 12:49:44.567236 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: X-User-Name: tempest-AttachVolumeShelveTestJSON-777401856-project May 26 12:49:44.567236 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: method: > May 26 12:49:44.567236 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: exception: Instance f44f180b-9143-43d6-b9cd-ced0c42fd928 could not be found. May 26 12:49:44.567236 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: action_args: {'id': 'f44f180b-9143-43d6-b9cd-ced0c42fd928'} May 26 12:49:44.572160 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: {{(pid=129322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 12:49:44.572160 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 12:49:44.572160 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 26 12:49:44.572160 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 26 12:49:44.572160 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 26 12:49:44.572160 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 26 12:49:44.572160 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 26 12:49:44.572160 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 26 12:49:44.572160 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 26 12:49:44.572160 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 26 12:49:44.572160 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f44f180b-9143-43d6-b9cd-ced0c42fd928 could not be found. May 26 12:49:44.572160 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi May 26 12:49:44.572160 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 12:49:44.572160 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi May 26 12:49:44.572160 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 12:49:44.572160 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 12:49:44.572160 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 12:49:44.572160 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 12:49:44.572160 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 12:49:44.572160 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 12:49:44.573606 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 12:49:44.573606 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 26 12:49:44.573606 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 26 12:49:44.573606 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 26 12:49:44.573606 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 26 12:49:44.573606 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 26 12:49:44.573606 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 26 12:49:44.573606 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 26 12:49:44.573606 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 12:49:44.573606 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f44f180b-9143-43d6-b9cd-ced0c42fd928 could not be found. May 26 12:49:44.573606 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi May 26 12:49:44.573606 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 12:49:44.573606 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi May 26 12:49:44.573606 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 12:49:44.573606 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 12:49:44.573606 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 12:49:44.573606 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 12:49:44.573606 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 12:49:44.573606 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f44f180b-9143-43d6-b9cd-ced0c42fd928 could not be found. May 26 12:49:44.573606 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi May 26 12:49:44.574868 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi [None req-03bfa485-3891-4ef0-bf1e-d61c2e092edd tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Returning 404 to user: Instance f44f180b-9143-43d6-b9cd-ced0c42fd928 could not be found. {{(pid=129322) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 12:49:44.574868 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: INFO nova.api.openstack.requestlog [None req-03bfa485-3891-4ef0-bf1e-d61c2e092edd tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] 10.222.0.75 "DELETE /compute/v2.1/servers/f44f180b-9143-43d6-b9cd-ced0c42fd928" status: 404 len: 111 microversion: 2.20 time: 0.035747 May 26 12:49:44.574868 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: [pid: 129322|app: 0|req: 539/1058] 10.222.0.75 () {60 vars in 1279 bytes} [Thu May 26 12:49:44 2022] DELETE /compute/v2.1/servers/f44f180b-9143-43d6-b9cd-ced0c42fd928 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 26 12:49:44.578024 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi [None req-9cb3951a-c799-42a4-b52e-fc689e5d4601 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Calling method '>' {{(pid=129321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:49:44.578763 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.compute.api [None req-9cb3951a-c799-42a4-b52e-fc689e5d4601 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] [instance: f44f180b-9143-43d6-b9cd-ced0c42fd928] Fetching instance by UUID {{(pid=129321) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:49:44.587078 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-9cb3951a-c799-42a4-b52e-fc689e5d4601 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:49:44.591179 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-9cb3951a-c799-42a4-b52e-fc689e5d4601 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:49:44.591179 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-9cb3951a-c799-42a4-b52e-fc689e5d4601 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:49:44.591179 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-9cb3951a-c799-42a4-b52e-fc689e5d4601 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:49:44.605061 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: INFO nova.api.openstack.wsgi [None req-9cb3951a-c799-42a4-b52e-fc689e5d4601 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] HTTP exception thrown: Instance f44f180b-9143-43d6-b9cd-ced0c42fd928 could not be found. May 26 12:49:44.606790 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi [None req-9cb3951a-c799-42a4-b52e-fc689e5d4601 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Request method failure captured: May 26 12:49:44.606790 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: request: GET /compute/v2.1/servers/f44f180b-9143-43d6-b9cd-ced0c42fd928 HTTP/1.1 May 26 12:49:44.606790 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: Accept: application/json May 26 12:49:44.606790 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: Accept-Encoding: identity May 26 12:49:44.606790 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: Connection: close May 26 12:49:44.606790 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: Content-Length: 0 May 26 12:49:44.606790 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: Content-Type: application/json May 26 12:49:44.606790 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: Host: 10.222.0.75 May 26 12:49:44.606790 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: Openstack-System-Scope: None May 26 12:49:44.606790 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: User-Agent: python-urllib3/1.26.9 May 26 12:49:44.606790 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: X-Auth-Token: gAAAAABij3Sy8x7VV7VbECm0oEshoygvVRqWfKgNcFRrHFj9mPSXKcXMQg8tIDkBA2P8iWFUbZBbkZzGIVXR8vvKmlK1yee67frqgDXV0AqNB-hRFdphj0XmjeijkCFuTITZvKDXJc1QXfRaH7-s7Z1FsQJ8w5ORPhObMUWuv1bJTbuUJB-nFHE May 26 12:49:44.606790 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: X-Domain-Id: None May 26 12:49:44.606790 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: X-Domain-Name: None May 26 12:49:44.606790 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: X-Identity-Status: Confirmed May 26 12:49:44.606790 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: X-Is-Admin-Project: True May 26 12:49:44.606790 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: X-Openstack-Nova-Api-Version: 2.20 May 26 12:49:44.606790 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: X-Project-Domain-Id: default May 26 12:49:44.606790 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: X-Project-Domain-Name: Default May 26 12:49:44.606790 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: X-Project-Id: 2675272fb40d4847819f83ec04afecef May 26 12:49:44.606790 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-777401856 May 26 12:49:44.606790 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: X-Role: member,reader May 26 12:49:44.606790 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: X-Roles: member,reader May 26 12:49:44.608434 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/2675272fb40d4847819f83ec04afecef"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.75:8080", "publicURL": "http://10.222.0.75:8080/v1/AUTH_2675272fb40d4847819f83ec04afecef"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2/2675272fb40d4847819f83ec04afecef"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/2675272fb40d4847819f83ec04afecef"}]}] May 26 12:49:44.608434 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: X-Tenant: tempest-AttachVolumeShelveTestJSON-777401856 May 26 12:49:44.608434 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: X-Tenant-Id: 2675272fb40d4847819f83ec04afecef May 26 12:49:44.608434 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-777401856 May 26 12:49:44.608434 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: X-User: tempest-AttachVolumeShelveTestJSON-777401856-project May 26 12:49:44.608434 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: X-User-Domain-Id: default May 26 12:49:44.608434 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: X-User-Domain-Name: Default May 26 12:49:44.608434 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: X-User-Id: e811736979c44b02b14fecb74c6bd7ab May 26 12:49:44.608434 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: X-User-Name: tempest-AttachVolumeShelveTestJSON-777401856-project May 26 12:49:44.608434 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: method: > May 26 12:49:44.608434 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: exception: Instance f44f180b-9143-43d6-b9cd-ced0c42fd928 could not be found. May 26 12:49:44.608434 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: action_args: {'id': 'f44f180b-9143-43d6-b9cd-ced0c42fd928'} May 26 12:49:44.612477 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: {{(pid=129321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 12:49:44.612477 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 12:49:44.612477 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 26 12:49:44.612477 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 26 12:49:44.612477 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 26 12:49:44.612477 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 26 12:49:44.612477 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 26 12:49:44.612477 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 26 12:49:44.612477 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 26 12:49:44.612477 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 26 12:49:44.612477 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f44f180b-9143-43d6-b9cd-ced0c42fd928 could not be found. May 26 12:49:44.612477 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi May 26 12:49:44.612477 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 12:49:44.612477 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi May 26 12:49:44.612477 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 12:49:44.612477 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 12:49:44.612477 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 12:49:44.612477 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 12:49:44.612477 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 12:49:44.612477 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 12:49:44.614045 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 12:49:44.614045 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 26 12:49:44.614045 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 26 12:49:44.614045 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 26 12:49:44.614045 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 26 12:49:44.614045 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 26 12:49:44.614045 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 12:49:44.614045 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f44f180b-9143-43d6-b9cd-ced0c42fd928 could not be found. May 26 12:49:44.614045 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi May 26 12:49:44.614045 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 12:49:44.614045 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi May 26 12:49:44.614045 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 12:49:44.614045 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 12:49:44.614045 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 12:49:44.614045 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 12:49:44.614045 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 12:49:44.614045 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f44f180b-9143-43d6-b9cd-ced0c42fd928 could not be found. May 26 12:49:44.614045 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi May 26 12:49:44.616387 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi [None req-9cb3951a-c799-42a4-b52e-fc689e5d4601 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Returning 404 to user: Instance f44f180b-9143-43d6-b9cd-ced0c42fd928 could not be found. {{(pid=129321) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 12:49:44.616387 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: INFO nova.api.openstack.requestlog [None req-9cb3951a-c799-42a4-b52e-fc689e5d4601 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] 10.222.0.75 "GET /compute/v2.1/servers/f44f180b-9143-43d6-b9cd-ced0c42fd928" status: 404 len: 111 microversion: 2.20 time: 0.035152 May 26 12:49:44.616387 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: [pid: 129321|app: 0|req: 520/1059] 10.222.0.75 () {60 vars in 1276 bytes} [Thu May 26 12:49:44 2022] GET /compute/v2.1/servers/f44f180b-9143-43d6-b9cd-ced0c42fd928 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 26 12:49:45.757489 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi [None req-88ec85f0-ad31-4b67-86bb-1b23ae88b4d6 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Calling method '>' {{(pid=129322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:49:45.758138 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.compute.api [None req-88ec85f0-ad31-4b67-86bb-1b23ae88b4d6 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] [instance: bf2f6303-22b9-4cfa-8d4d-61d2503bc554] Fetching instance by UUID {{(pid=129322) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:49:45.769341 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-88ec85f0-ad31-4b67-86bb-1b23ae88b4d6 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:49:45.769786 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-88ec85f0-ad31-4b67-86bb-1b23ae88b4d6 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:49:45.770592 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-88ec85f0-ad31-4b67-86bb-1b23ae88b4d6 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:49:45.771023 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-88ec85f0-ad31-4b67-86bb-1b23ae88b4d6 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:49:45.788589 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: INFO nova.api.openstack.wsgi [None req-88ec85f0-ad31-4b67-86bb-1b23ae88b4d6 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] HTTP exception thrown: Instance bf2f6303-22b9-4cfa-8d4d-61d2503bc554 could not be found. May 26 12:49:45.790539 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi [None req-88ec85f0-ad31-4b67-86bb-1b23ae88b4d6 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Request method failure captured: May 26 12:49:45.790539 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: request: DELETE /compute/v2.1/servers/bf2f6303-22b9-4cfa-8d4d-61d2503bc554 HTTP/1.1 May 26 12:49:45.790539 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: Accept: application/json May 26 12:49:45.790539 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: Accept-Encoding: identity May 26 12:49:45.790539 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: Connection: close May 26 12:49:45.790539 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: Content-Length: 0 May 26 12:49:45.790539 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: Content-Type: application/json May 26 12:49:45.790539 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: Host: 10.222.0.75 May 26 12:49:45.790539 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: Openstack-System-Scope: None May 26 12:49:45.790539 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: User-Agent: python-urllib3/1.26.9 May 26 12:49:45.790539 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: X-Auth-Token: gAAAAABij3Sy8x7VV7VbECm0oEshoygvVRqWfKgNcFRrHFj9mPSXKcXMQg8tIDkBA2P8iWFUbZBbkZzGIVXR8vvKmlK1yee67frqgDXV0AqNB-hRFdphj0XmjeijkCFuTITZvKDXJc1QXfRaH7-s7Z1FsQJ8w5ORPhObMUWuv1bJTbuUJB-nFHE May 26 12:49:45.790539 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: X-Domain-Id: None May 26 12:49:45.790539 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: X-Domain-Name: None May 26 12:49:45.790539 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: X-Identity-Status: Confirmed May 26 12:49:45.790539 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: X-Is-Admin-Project: True May 26 12:49:45.790539 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: X-Openstack-Nova-Api-Version: 2.20 May 26 12:49:45.790539 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: X-Project-Domain-Id: default May 26 12:49:45.790539 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: X-Project-Domain-Name: Default May 26 12:49:45.790539 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: X-Project-Id: 2675272fb40d4847819f83ec04afecef May 26 12:49:45.790539 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-777401856 May 26 12:49:45.790539 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: X-Role: member,reader May 26 12:49:45.790539 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: X-Roles: member,reader May 26 12:49:45.792360 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/2675272fb40d4847819f83ec04afecef"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.75:8080", "publicURL": "http://10.222.0.75:8080/v1/AUTH_2675272fb40d4847819f83ec04afecef"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2/2675272fb40d4847819f83ec04afecef"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/2675272fb40d4847819f83ec04afecef"}]}] May 26 12:49:45.792360 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: X-Tenant: tempest-AttachVolumeShelveTestJSON-777401856 May 26 12:49:45.792360 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: X-Tenant-Id: 2675272fb40d4847819f83ec04afecef May 26 12:49:45.792360 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-777401856 May 26 12:49:45.792360 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: X-User: tempest-AttachVolumeShelveTestJSON-777401856-project May 26 12:49:45.792360 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: X-User-Domain-Id: default May 26 12:49:45.792360 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: X-User-Domain-Name: Default May 26 12:49:45.792360 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: X-User-Id: e811736979c44b02b14fecb74c6bd7ab May 26 12:49:45.792360 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: X-User-Name: tempest-AttachVolumeShelveTestJSON-777401856-project May 26 12:49:45.792360 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: method: > May 26 12:49:45.792360 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: exception: Instance bf2f6303-22b9-4cfa-8d4d-61d2503bc554 could not be found. May 26 12:49:45.792360 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: action_args: {'id': 'bf2f6303-22b9-4cfa-8d4d-61d2503bc554'} May 26 12:49:45.793234 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: {{(pid=129322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 12:49:45.793234 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 12:49:45.793234 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 26 12:49:45.793234 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 26 12:49:45.793234 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 26 12:49:45.793234 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 26 12:49:45.793234 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 26 12:49:45.793234 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 26 12:49:45.793234 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 26 12:49:45.793234 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 26 12:49:45.793234 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bf2f6303-22b9-4cfa-8d4d-61d2503bc554 could not be found. May 26 12:49:45.793234 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi May 26 12:49:45.793234 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 12:49:45.793234 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi May 26 12:49:45.793234 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 12:49:45.793234 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 12:49:45.793234 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 12:49:45.793234 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 12:49:45.793234 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 12:49:45.793234 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 12:49:45.794716 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 12:49:45.794716 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 26 12:49:45.794716 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 26 12:49:45.794716 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 26 12:49:45.794716 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 26 12:49:45.794716 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 26 12:49:45.794716 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 26 12:49:45.794716 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 26 12:49:45.794716 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 12:49:45.794716 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bf2f6303-22b9-4cfa-8d4d-61d2503bc554 could not be found. May 26 12:49:45.794716 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi May 26 12:49:45.794716 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 12:49:45.794716 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi May 26 12:49:45.794716 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 12:49:45.794716 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 12:49:45.794716 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 12:49:45.794716 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 12:49:45.794716 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 12:49:45.794716 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bf2f6303-22b9-4cfa-8d4d-61d2503bc554 could not be found. May 26 12:49:45.794716 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi May 26 12:49:45.796370 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi [None req-88ec85f0-ad31-4b67-86bb-1b23ae88b4d6 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Returning 404 to user: Instance bf2f6303-22b9-4cfa-8d4d-61d2503bc554 could not be found. {{(pid=129322) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 12:49:45.796370 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: INFO nova.api.openstack.requestlog [None req-88ec85f0-ad31-4b67-86bb-1b23ae88b4d6 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] 10.222.0.75 "DELETE /compute/v2.1/servers/bf2f6303-22b9-4cfa-8d4d-61d2503bc554" status: 404 len: 111 microversion: 2.20 time: 0.038712 May 26 12:49:45.796370 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: [pid: 129322|app: 0|req: 540/1060] 10.222.0.75 () {60 vars in 1279 bytes} [Thu May 26 12:49:45 2022] DELETE /compute/v2.1/servers/bf2f6303-22b9-4cfa-8d4d-61d2503bc554 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 26 12:49:45.801639 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi [None req-19865dce-f369-497a-80d4-9e2a9beb3b34 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Calling method '>' {{(pid=129321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:49:45.802250 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.compute.api [None req-19865dce-f369-497a-80d4-9e2a9beb3b34 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] [instance: bf2f6303-22b9-4cfa-8d4d-61d2503bc554] Fetching instance by UUID {{(pid=129321) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:49:45.809165 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-19865dce-f369-497a-80d4-9e2a9beb3b34 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:49:45.809613 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-19865dce-f369-497a-80d4-9e2a9beb3b34 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:49:45.810415 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-19865dce-f369-497a-80d4-9e2a9beb3b34 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:49:45.810860 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-19865dce-f369-497a-80d4-9e2a9beb3b34 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:49:45.825730 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: INFO nova.api.openstack.wsgi [None req-19865dce-f369-497a-80d4-9e2a9beb3b34 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] HTTP exception thrown: Instance bf2f6303-22b9-4cfa-8d4d-61d2503bc554 could not be found. May 26 12:49:45.827218 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi [None req-19865dce-f369-497a-80d4-9e2a9beb3b34 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Request method failure captured: May 26 12:49:45.827218 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: request: GET /compute/v2.1/servers/bf2f6303-22b9-4cfa-8d4d-61d2503bc554 HTTP/1.1 May 26 12:49:45.827218 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: Accept: application/json May 26 12:49:45.827218 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: Accept-Encoding: identity May 26 12:49:45.827218 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: Connection: close May 26 12:49:45.827218 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: Content-Length: 0 May 26 12:49:45.827218 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: Content-Type: application/json May 26 12:49:45.827218 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: Host: 10.222.0.75 May 26 12:49:45.827218 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: Openstack-System-Scope: None May 26 12:49:45.827218 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: User-Agent: python-urllib3/1.26.9 May 26 12:49:45.827218 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: X-Auth-Token: gAAAAABij3Sy8x7VV7VbECm0oEshoygvVRqWfKgNcFRrHFj9mPSXKcXMQg8tIDkBA2P8iWFUbZBbkZzGIVXR8vvKmlK1yee67frqgDXV0AqNB-hRFdphj0XmjeijkCFuTITZvKDXJc1QXfRaH7-s7Z1FsQJ8w5ORPhObMUWuv1bJTbuUJB-nFHE May 26 12:49:45.827218 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: X-Domain-Id: None May 26 12:49:45.827218 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: X-Domain-Name: None May 26 12:49:45.827218 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: X-Identity-Status: Confirmed May 26 12:49:45.827218 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: X-Is-Admin-Project: True May 26 12:49:45.827218 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: X-Openstack-Nova-Api-Version: 2.20 May 26 12:49:45.827218 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: X-Project-Domain-Id: default May 26 12:49:45.827218 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: X-Project-Domain-Name: Default May 26 12:49:45.827218 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: X-Project-Id: 2675272fb40d4847819f83ec04afecef May 26 12:49:45.827218 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-777401856 May 26 12:49:45.827218 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: X-Role: member,reader May 26 12:49:45.827218 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: X-Roles: member,reader May 26 12:49:45.828919 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/2675272fb40d4847819f83ec04afecef"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.75:8080", "publicURL": "http://10.222.0.75:8080/v1/AUTH_2675272fb40d4847819f83ec04afecef"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2/2675272fb40d4847819f83ec04afecef"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/2675272fb40d4847819f83ec04afecef"}]}] May 26 12:49:45.828919 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: X-Tenant: tempest-AttachVolumeShelveTestJSON-777401856 May 26 12:49:45.828919 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: X-Tenant-Id: 2675272fb40d4847819f83ec04afecef May 26 12:49:45.828919 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-777401856 May 26 12:49:45.828919 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: X-User: tempest-AttachVolumeShelveTestJSON-777401856-project May 26 12:49:45.828919 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: X-User-Domain-Id: default May 26 12:49:45.828919 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: X-User-Domain-Name: Default May 26 12:49:45.828919 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: X-User-Id: e811736979c44b02b14fecb74c6bd7ab May 26 12:49:45.828919 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: X-User-Name: tempest-AttachVolumeShelveTestJSON-777401856-project May 26 12:49:45.828919 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: method: > May 26 12:49:45.828919 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: exception: Instance bf2f6303-22b9-4cfa-8d4d-61d2503bc554 could not be found. May 26 12:49:45.828919 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: action_args: {'id': 'bf2f6303-22b9-4cfa-8d4d-61d2503bc554'} May 26 12:49:45.829797 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: {{(pid=129321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 12:49:45.829797 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 12:49:45.829797 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 26 12:49:45.829797 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 26 12:49:45.829797 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 26 12:49:45.829797 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 26 12:49:45.829797 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 26 12:49:45.829797 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 26 12:49:45.829797 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 26 12:49:45.829797 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 26 12:49:45.829797 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bf2f6303-22b9-4cfa-8d4d-61d2503bc554 could not be found. May 26 12:49:45.829797 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi May 26 12:49:45.829797 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 12:49:45.829797 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi May 26 12:49:45.829797 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 12:49:45.829797 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 12:49:45.829797 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 12:49:45.829797 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 12:49:45.829797 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 12:49:45.829797 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 12:49:45.831942 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 12:49:45.831942 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 26 12:49:45.831942 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 26 12:49:45.831942 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 26 12:49:45.831942 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 26 12:49:45.831942 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 26 12:49:45.831942 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 12:49:45.831942 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bf2f6303-22b9-4cfa-8d4d-61d2503bc554 could not be found. May 26 12:49:45.831942 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi May 26 12:49:45.831942 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 12:49:45.831942 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi May 26 12:49:45.831942 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 12:49:45.831942 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 12:49:45.831942 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 12:49:45.831942 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 12:49:45.831942 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 12:49:45.831942 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bf2f6303-22b9-4cfa-8d4d-61d2503bc554 could not be found. May 26 12:49:45.831942 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi May 26 12:49:45.833135 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi [None req-19865dce-f369-497a-80d4-9e2a9beb3b34 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] Returning 404 to user: Instance bf2f6303-22b9-4cfa-8d4d-61d2503bc554 could not be found. {{(pid=129321) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 12:49:45.833135 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: INFO nova.api.openstack.requestlog [None req-19865dce-f369-497a-80d4-9e2a9beb3b34 tempest-AttachVolumeShelveTestJSON-777401856 tempest-AttachVolumeShelveTestJSON-777401856-project] 10.222.0.75 "GET /compute/v2.1/servers/bf2f6303-22b9-4cfa-8d4d-61d2503bc554" status: 404 len: 111 microversion: 2.20 time: 0.031466 May 26 12:49:45.833135 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: [pid: 129321|app: 0|req: 521/1061] 10.222.0.75 () {60 vars in 1276 bytes} [Thu May 26 12:49:45 2022] GET /compute/v2.1/servers/bf2f6303-22b9-4cfa-8d4d-61d2503bc554 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 26 12:49:50.780809 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 26 12:49:50.780809 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: Thu May 26 12:49:50 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 26 12:49:55.067487 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi [None req-1214a506-7b08-4456-b530-8e59da424b1f tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] Action: 'create', calling method: .version_select at 0x7f82fbf975e0>, body: {"keypair": {"name": "tempest-keypair-1508501543", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAj5ygCvgPm7KCXtCR0YKMa0Gp5MChIU8AqBGscYlXADfbEYalewcxNkrcdMgCo8OGTX5JMcskj4U9aMTplyxSHRg94zct+dEnnL8Q7FHXyKJhwwJLvIte1TBXdsCg4oyA=="}} {{(pid=129322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 12:49:55.083240 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.quota [None req-1214a506-7b08-4456-b530-8e59da424b1f tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] Getting quotas for project 93d5b6bba38643bfb76f083e230b3d22. Resources: {'key_pairs'} {{(pid=129322) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 26 12:49:55.087700 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.quota [None req-1214a506-7b08-4456-b530-8e59da424b1f tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] Getting quotas for user eddc5d9ac2a74507bca19e06f0051ae1 and project 93d5b6bba38643bfb76f083e230b3d22. Resources: {'key_pairs'} {{(pid=129322) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 26 12:49:55.122689 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: INFO nova.api.openstack.requestlog [None req-1214a506-7b08-4456-b530-8e59da424b1f tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] 10.222.0.75 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.214188 May 26 12:49:55.124452 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: [pid: 129322|app: 0|req: 541/1062] 10.222.0.75 () {60 vars in 1158 bytes} [Thu May 26 12:49:54 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 12:49:56.775983 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi [None req-ed9e6443-a8db-489a-a0b8-c3b9b5e7cc6d tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1284559519", "imageRef": "1e3c323d-d797-4e6d-bd9a-482d90084b0c", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "0b8803cb-8e70-473c-b131-a8a5b912880c"}], "security_groups": [{"name": "tempest-securitygroup--404668144"}], "key_name": "tempest-keypair-1508501543", "user_data": "}} {{(pid=129321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 12:49:56.783384 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG dbcounter [-] [129321] Writing DB stats nova_api:SELECT=18,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=129321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:49:56.784426 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG dbcounter [-] [129321] Writing DB stats nova_cell1:SELECT=26,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:49:56.903125 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.network.neutron [None req-ed9e6443-a8db-489a-a0b8-c3b9b5e7cc6d tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] validate_networks() for [('0b8803cb-8e70-473c-b131-a8a5b912880c', None, None, None, None, None)] {{(pid=129321) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 26 12:49:57.324651 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.virt.hardware [None req-ed9e6443-a8db-489a-a0b8-c3b9b5e7cc6d tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] Flavor limits 0:0:0 {{(pid=129321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 26 12:49:57.325079 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.virt.hardware [None req-ed9e6443-a8db-489a-a0b8-c3b9b5e7cc6d tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] Image limits 0:0:0 {{(pid=129321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 26 12:49:57.325550 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.virt.hardware [None req-ed9e6443-a8db-489a-a0b8-c3b9b5e7cc6d tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] Flavor pref 0:0:0 {{(pid=129321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 26 12:49:57.326161 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.virt.hardware [None req-ed9e6443-a8db-489a-a0b8-c3b9b5e7cc6d tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] Image pref 0:0:0 {{(pid=129321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 26 12:49:57.326571 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.virt.hardware [None req-ed9e6443-a8db-489a-a0b8-c3b9b5e7cc6d tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 26 12:49:57.337367 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-ed9e6443-a8db-489a-a0b8-c3b9b5e7cc6d tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:49:57.338161 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-ed9e6443-a8db-489a-a0b8-c3b9b5e7cc6d tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:49:57.338962 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-ed9e6443-a8db-489a-a0b8-c3b9b5e7cc6d tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:49:57.339589 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-ed9e6443-a8db-489a-a0b8-c3b9b5e7cc6d tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:49:57.358547 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.quota [None req-ed9e6443-a8db-489a-a0b8-c3b9b5e7cc6d tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] Getting quotas for project 93d5b6bba38643bfb76f083e230b3d22. Resources: {'instances', 'cores', 'ram'} {{(pid=129321) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 26 12:49:57.363159 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.quota [None req-ed9e6443-a8db-489a-a0b8-c3b9b5e7cc6d tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] Getting quotas for user eddc5d9ac2a74507bca19e06f0051ae1 and project 93d5b6bba38643bfb76f083e230b3d22. Resources: {'instances', 'cores', 'ram'} {{(pid=129321) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 26 12:49:57.375634 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.compute.api [None req-ed9e6443-a8db-489a-a0b8-c3b9b5e7cc6d tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] Going to run 1 instances... {{(pid=129321) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 26 12:49:57.378188 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.compute.api [None req-ed9e6443-a8db-489a-a0b8-c3b9b5e7cc6d tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] [instance: 88867ead-523a-4d55-9311-bdddd200c270] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1e3c323d-d797-4e6d-bd9a-482d90084b0c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129321) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 26 12:49:57.441161 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: INFO nova.api.openstack.requestlog [None req-ed9e6443-a8db-489a-a0b8-c3b9b5e7cc6d tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] 10.222.0.75 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.669679 May 26 12:49:57.448157 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: [pid: 129321|app: 0|req: 522/1063] 10.222.0.75 () {60 vars in 1146 bytes} [Thu May 26 12:49:56 2022] POST /compute/v2.1/servers => generated 401 bytes in 677 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 26 12:49:57.455394 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG dbcounter [-] [129322] Writing DB stats nova_cell1:SELECT=24 {{(pid=129322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:49:57.460532 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi [None req-fe98747f-f893-489c-b58f-78d034645a49 tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] Calling method '>' {{(pid=129322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:49:57.461157 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.compute.api [None req-fe98747f-f893-489c-b58f-78d034645a49 tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] [instance: 88867ead-523a-4d55-9311-bdddd200c270] Fetching instance by UUID {{(pid=129322) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:49:57.536467 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.policy [None req-fe98747f-f893-489c-b58f-78d034645a49 tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eddc5d9ac2a74507bca19e06f0051ae1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93d5b6bba38643bfb76f083e230b3d22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129322) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:49:57.544485 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: INFO nova.api.openstack.requestlog [None req-fe98747f-f893-489c-b58f-78d034645a49 tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] 10.222.0.75 "GET /compute/v2.1/servers/88867ead-523a-4d55-9311-bdddd200c270" status: 200 len: 1242 microversion: 2.1 time: 0.089885 May 26 12:49:57.554721 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: [pid: 129322|app: 0|req: 542/1064] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 26 12:49:57 2022] GET /compute/v2.1/servers/88867ead-523a-4d55-9311-bdddd200c270 => generated 1242 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:49:58.566453 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi [None req-b58d3435-5781-4666-ac8c-3755b1dd5825 tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] Calling method '>' {{(pid=129321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:49:58.567797 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.compute.api [None req-b58d3435-5781-4666-ac8c-3755b1dd5825 tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] [instance: 88867ead-523a-4d55-9311-bdddd200c270] Fetching instance by UUID {{(pid=129321) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:49:58.577917 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-b58d3435-5781-4666-ac8c-3755b1dd5825 tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:49:58.578777 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-b58d3435-5781-4666-ac8c-3755b1dd5825 tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:49:58.579844 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-b58d3435-5781-4666-ac8c-3755b1dd5825 tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:49:58.580628 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-b58d3435-5781-4666-ac8c-3755b1dd5825 tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:49:58.677162 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.policy [None req-b58d3435-5781-4666-ac8c-3755b1dd5825 tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eddc5d9ac2a74507bca19e06f0051ae1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93d5b6bba38643bfb76f083e230b3d22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129321) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:49:58.686185 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: INFO nova.api.openstack.requestlog [None req-b58d3435-5781-4666-ac8c-3755b1dd5825 tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] 10.222.0.75 "GET /compute/v2.1/servers/88867ead-523a-4d55-9311-bdddd200c270" status: 200 len: 1294 microversion: 2.1 time: 0.125965 May 26 12:49:58.687433 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: [pid: 129321|app: 0|req: 523/1065] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 26 12:49:58 2022] GET /compute/v2.1/servers/88867ead-523a-4d55-9311-bdddd200c270 => generated 1294 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:49:59.704288 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi [None req-1a4472b9-6e0c-4c7f-8e1e-73959a54e94f tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] Calling method '>' {{(pid=129322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:49:59.705009 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.compute.api [None req-1a4472b9-6e0c-4c7f-8e1e-73959a54e94f tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] [instance: 88867ead-523a-4d55-9311-bdddd200c270] Fetching instance by UUID {{(pid=129322) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:49:59.712435 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-1a4472b9-6e0c-4c7f-8e1e-73959a54e94f tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:49:59.712981 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-1a4472b9-6e0c-4c7f-8e1e-73959a54e94f tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:49:59.713831 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-1a4472b9-6e0c-4c7f-8e1e-73959a54e94f tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:49:59.714340 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-1a4472b9-6e0c-4c7f-8e1e-73959a54e94f tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:49:59.876367 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.policy [None req-1a4472b9-6e0c-4c7f-8e1e-73959a54e94f tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eddc5d9ac2a74507bca19e06f0051ae1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93d5b6bba38643bfb76f083e230b3d22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129322) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:49:59.884794 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: INFO nova.api.openstack.requestlog [None req-1a4472b9-6e0c-4c7f-8e1e-73959a54e94f tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] 10.222.0.75 "GET /compute/v2.1/servers/88867ead-523a-4d55-9311-bdddd200c270" status: 200 len: 1367 microversion: 2.1 time: 0.184495 May 26 12:49:59.885369 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: [pid: 129322|app: 0|req: 543/1066] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 26 12:49:59 2022] GET /compute/v2.1/servers/88867ead-523a-4d55-9311-bdddd200c270 => generated 1367 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:50:00.296201 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi [req-0dd69254-1d15-4ea7-943a-d50f72213600 req-f33b7d24-c0b5-4c82-a30a-81c857e74149 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "88867ead-523a-4d55-9311-bdddd200c270", "tag": "7c579d53-90ff-485d-b901-e248a1c762b2"}]} {{(pid=129321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 12:50:00.312407 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [req-0dd69254-1d15-4ea7-943a-d50f72213600 req-f33b7d24-c0b5-4c82-a30a-81c857e74149 service nova] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:50:00.313219 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [req-0dd69254-1d15-4ea7-943a-d50f72213600 req-f33b7d24-c0b5-4c82-a30a-81c857e74149 service nova] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:50:00.326095 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: INFO nova.api.openstack.compute.server_external_events [req-0dd69254-1d15-4ea7-943a-d50f72213600 req-f33b7d24-c0b5-4c82-a30a-81c857e74149 service nova] Creating event network-changed:7c579d53-90ff-485d-b901-e248a1c762b2 for instance 88867ead-523a-4d55-9311-bdddd200c270 on hv-cinder-81966 May 26 12:50:00.332704 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: INFO nova.api.openstack.requestlog [req-0dd69254-1d15-4ea7-943a-d50f72213600 req-f33b7d24-c0b5-4c82-a30a-81c857e74149 service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041209 May 26 12:50:00.333496 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: [pid: 129321|app: 0|req: 524/1067] 10.222.0.75 () {64 vars in 1317 bytes} [Thu May 26 12:50:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 12:50:00.906497 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi [None req-50488ee8-5d3b-433e-bbb7-40586a1f45cc tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] Calling method '>' {{(pid=129322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:50:00.907118 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.compute.api [None req-50488ee8-5d3b-433e-bbb7-40586a1f45cc tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] [instance: 88867ead-523a-4d55-9311-bdddd200c270] Fetching instance by UUID {{(pid=129322) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:50:00.914522 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-50488ee8-5d3b-433e-bbb7-40586a1f45cc tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:50:00.914946 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-50488ee8-5d3b-433e-bbb7-40586a1f45cc tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:50:00.915774 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-50488ee8-5d3b-433e-bbb7-40586a1f45cc tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:50:00.916258 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-50488ee8-5d3b-433e-bbb7-40586a1f45cc tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:50:01.052210 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.policy [None req-50488ee8-5d3b-433e-bbb7-40586a1f45cc tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eddc5d9ac2a74507bca19e06f0051ae1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93d5b6bba38643bfb76f083e230b3d22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129322) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:50:01.060354 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: INFO nova.api.openstack.requestlog [None req-50488ee8-5d3b-433e-bbb7-40586a1f45cc tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] 10.222.0.75 "GET /compute/v2.1/servers/88867ead-523a-4d55-9311-bdddd200c270" status: 200 len: 1367 microversion: 2.1 time: 0.159326 May 26 12:50:01.060947 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: [pid: 129322|app: 0|req: 544/1068] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 26 12:50:00 2022] GET /compute/v2.1/servers/88867ead-523a-4d55-9311-bdddd200c270 => generated 1367 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:50:02.079916 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi [None req-7b936fb8-f625-4162-986b-ad8fce7fe2c9 tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] Calling method '>' {{(pid=129321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:50:02.081326 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.compute.api [None req-7b936fb8-f625-4162-986b-ad8fce7fe2c9 tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] [instance: 88867ead-523a-4d55-9311-bdddd200c270] Fetching instance by UUID {{(pid=129321) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:50:02.089039 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-7b936fb8-f625-4162-986b-ad8fce7fe2c9 tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:50:02.089495 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-7b936fb8-f625-4162-986b-ad8fce7fe2c9 tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:50:02.090279 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-7b936fb8-f625-4162-986b-ad8fce7fe2c9 tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:50:02.090682 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-7b936fb8-f625-4162-986b-ad8fce7fe2c9 tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:50:02.234134 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.policy [None req-7b936fb8-f625-4162-986b-ad8fce7fe2c9 tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eddc5d9ac2a74507bca19e06f0051ae1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93d5b6bba38643bfb76f083e230b3d22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129321) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:50:02.242159 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: INFO nova.api.openstack.requestlog [None req-7b936fb8-f625-4162-986b-ad8fce7fe2c9 tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] 10.222.0.75 "GET /compute/v2.1/servers/88867ead-523a-4d55-9311-bdddd200c270" status: 200 len: 1367 microversion: 2.1 time: 0.168085 May 26 12:50:02.242749 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: [pid: 129321|app: 0|req: 525/1069] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 26 12:50:02 2022] GET /compute/v2.1/servers/88867ead-523a-4d55-9311-bdddd200c270 => generated 1367 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:50:03.261647 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi [None req-72e17aaf-19fd-41c8-858a-9eeb41f7b6e8 tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] Calling method '>' {{(pid=129322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:50:03.262432 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.compute.api [None req-72e17aaf-19fd-41c8-858a-9eeb41f7b6e8 tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] [instance: 88867ead-523a-4d55-9311-bdddd200c270] Fetching instance by UUID {{(pid=129322) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:50:03.270009 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-72e17aaf-19fd-41c8-858a-9eeb41f7b6e8 tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:50:03.270494 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-72e17aaf-19fd-41c8-858a-9eeb41f7b6e8 tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:50:03.271273 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-72e17aaf-19fd-41c8-858a-9eeb41f7b6e8 tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:50:03.271755 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-72e17aaf-19fd-41c8-858a-9eeb41f7b6e8 tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:50:03.415711 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.policy [None req-72e17aaf-19fd-41c8-858a-9eeb41f7b6e8 tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eddc5d9ac2a74507bca19e06f0051ae1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93d5b6bba38643bfb76f083e230b3d22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129322) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:50:03.423273 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: INFO nova.api.openstack.requestlog [None req-72e17aaf-19fd-41c8-858a-9eeb41f7b6e8 tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] 10.222.0.75 "GET /compute/v2.1/servers/88867ead-523a-4d55-9311-bdddd200c270" status: 200 len: 1367 microversion: 2.1 time: 0.165604 May 26 12:50:03.424324 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: [pid: 129322|app: 0|req: 545/1070] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 26 12:50:03 2022] GET /compute/v2.1/servers/88867ead-523a-4d55-9311-bdddd200c270 => generated 1367 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:50:04.440597 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi [None req-3ba71527-5c41-4c9d-bad8-7d3194276702 tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] Calling method '>' {{(pid=129321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:50:04.441479 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.compute.api [None req-3ba71527-5c41-4c9d-bad8-7d3194276702 tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] [instance: 88867ead-523a-4d55-9311-bdddd200c270] Fetching instance by UUID {{(pid=129321) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:50:04.450997 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-3ba71527-5c41-4c9d-bad8-7d3194276702 tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:50:04.451595 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-3ba71527-5c41-4c9d-bad8-7d3194276702 tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:50:04.452837 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-3ba71527-5c41-4c9d-bad8-7d3194276702 tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:50:04.453470 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-3ba71527-5c41-4c9d-bad8-7d3194276702 tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:50:04.594429 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.policy [None req-3ba71527-5c41-4c9d-bad8-7d3194276702 tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eddc5d9ac2a74507bca19e06f0051ae1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93d5b6bba38643bfb76f083e230b3d22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129321) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:50:04.602526 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: INFO nova.api.openstack.requestlog [None req-3ba71527-5c41-4c9d-bad8-7d3194276702 tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] 10.222.0.75 "GET /compute/v2.1/servers/88867ead-523a-4d55-9311-bdddd200c270" status: 200 len: 1367 microversion: 2.1 time: 0.165932 May 26 12:50:04.603056 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: [pid: 129321|app: 0|req: 526/1071] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 26 12:50:04 2022] GET /compute/v2.1/servers/88867ead-523a-4d55-9311-bdddd200c270 => generated 1367 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:50:05.620722 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi [None req-dd06b4f4-c613-4b49-9786-5abad8d45f6a tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] Calling method '>' {{(pid=129322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:50:05.621323 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.compute.api [None req-dd06b4f4-c613-4b49-9786-5abad8d45f6a tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] [instance: 88867ead-523a-4d55-9311-bdddd200c270] Fetching instance by UUID {{(pid=129322) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:50:05.628761 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-dd06b4f4-c613-4b49-9786-5abad8d45f6a tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:50:05.629270 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-dd06b4f4-c613-4b49-9786-5abad8d45f6a tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:50:05.630051 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-dd06b4f4-c613-4b49-9786-5abad8d45f6a tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:50:05.630491 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-dd06b4f4-c613-4b49-9786-5abad8d45f6a tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:50:05.775508 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.policy [None req-dd06b4f4-c613-4b49-9786-5abad8d45f6a tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eddc5d9ac2a74507bca19e06f0051ae1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93d5b6bba38643bfb76f083e230b3d22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129322) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:50:05.787182 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: INFO nova.api.openstack.requestlog [None req-dd06b4f4-c613-4b49-9786-5abad8d45f6a tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] 10.222.0.75 "GET /compute/v2.1/servers/88867ead-523a-4d55-9311-bdddd200c270" status: 200 len: 1367 microversion: 2.1 time: 0.167561 May 26 12:50:05.787182 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: [pid: 129322|app: 0|req: 546/1072] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 26 12:50:05 2022] GET /compute/v2.1/servers/88867ead-523a-4d55-9311-bdddd200c270 => generated 1367 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:50:05.995079 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi [req-f81ba2a3-2684-4d01-a509-fd70878ac8c0 req-e9bad78c-c5bb-4740-b1a8-1c08653e2d9b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "88867ead-523a-4d55-9311-bdddd200c270", "name": "network-vif-plugged", "status": "completed", "tag": "7c579d53-90ff-485d-b901-e248a1c762b2"}]} {{(pid=129321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 12:50:06.006684 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [req-f81ba2a3-2684-4d01-a509-fd70878ac8c0 req-e9bad78c-c5bb-4740-b1a8-1c08653e2d9b service nova] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:50:06.007139 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [req-f81ba2a3-2684-4d01-a509-fd70878ac8c0 req-e9bad78c-c5bb-4740-b1a8-1c08653e2d9b service nova] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:50:06.020031 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: INFO nova.api.openstack.compute.server_external_events [req-f81ba2a3-2684-4d01-a509-fd70878ac8c0 req-e9bad78c-c5bb-4740-b1a8-1c08653e2d9b service nova] Creating event network-vif-plugged:7c579d53-90ff-485d-b901-e248a1c762b2 for instance 88867ead-523a-4d55-9311-bdddd200c270 on hv-cinder-81966 May 26 12:50:06.025267 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: INFO nova.api.openstack.requestlog [req-f81ba2a3-2684-4d01-a509-fd70878ac8c0 req-e9bad78c-c5bb-4740-b1a8-1c08653e2d9b service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.100336 May 26 12:50:06.026027 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: [pid: 129321|app: 0|req: 527/1073] 10.222.0.75 () {64 vars in 1317 bytes} [Thu May 26 12:50:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 12:50:06.801896 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi [None req-56773f86-d311-406c-8c38-1b0bca32b1cb tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] Calling method '>' {{(pid=129322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:50:06.802493 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.compute.api [None req-56773f86-d311-406c-8c38-1b0bca32b1cb tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] [instance: 88867ead-523a-4d55-9311-bdddd200c270] Fetching instance by UUID {{(pid=129322) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:50:06.809861 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-56773f86-d311-406c-8c38-1b0bca32b1cb tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:50:06.810306 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-56773f86-d311-406c-8c38-1b0bca32b1cb tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:50:06.811097 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-56773f86-d311-406c-8c38-1b0bca32b1cb tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:50:06.811562 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-56773f86-d311-406c-8c38-1b0bca32b1cb tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:50:06.951863 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.policy [None req-56773f86-d311-406c-8c38-1b0bca32b1cb tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eddc5d9ac2a74507bca19e06f0051ae1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93d5b6bba38643bfb76f083e230b3d22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129322) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:50:06.960195 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: INFO nova.api.openstack.requestlog [None req-56773f86-d311-406c-8c38-1b0bca32b1cb tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] 10.222.0.75 "GET /compute/v2.1/servers/88867ead-523a-4d55-9311-bdddd200c270" status: 200 len: 1367 microversion: 2.1 time: 0.162431 May 26 12:50:06.960816 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: [pid: 129322|app: 0|req: 547/1074] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 26 12:50:06 2022] GET /compute/v2.1/servers/88867ead-523a-4d55-9311-bdddd200c270 => generated 1367 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:50:07.978833 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi [None req-4443f8a2-274e-4375-b2f1-0d8d66187057 tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] Calling method '>' {{(pid=129321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:50:07.979591 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.compute.api [None req-4443f8a2-274e-4375-b2f1-0d8d66187057 tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] [instance: 88867ead-523a-4d55-9311-bdddd200c270] Fetching instance by UUID {{(pid=129321) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:50:07.982067 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG dbcounter [-] [129321] Writing DB stats nova_cell0:SELECT=2 {{(pid=129321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:50:07.982741 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG dbcounter [-] [129321] Writing DB stats nova_cell0:SELECT=6 {{(pid=129321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:50:07.989266 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-4443f8a2-274e-4375-b2f1-0d8d66187057 tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:50:07.989712 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-4443f8a2-274e-4375-b2f1-0d8d66187057 tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:50:07.990492 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-4443f8a2-274e-4375-b2f1-0d8d66187057 tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:50:07.990923 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-4443f8a2-274e-4375-b2f1-0d8d66187057 tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:50:08.130934 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.policy [None req-4443f8a2-274e-4375-b2f1-0d8d66187057 tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eddc5d9ac2a74507bca19e06f0051ae1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93d5b6bba38643bfb76f083e230b3d22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129321) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:50:08.141504 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: INFO nova.api.openstack.requestlog [None req-4443f8a2-274e-4375-b2f1-0d8d66187057 tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] 10.222.0.75 "GET /compute/v2.1/servers/88867ead-523a-4d55-9311-bdddd200c270" status: 200 len: 1367 microversion: 2.1 time: 0.166728 May 26 12:50:08.142325 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: [pid: 129321|app: 0|req: 528/1075] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 26 12:50:07 2022] GET /compute/v2.1/servers/88867ead-523a-4d55-9311-bdddd200c270 => generated 1367 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:50:09.160146 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi [None req-36072288-cbf6-4da9-ae37-c2a724e2a25a tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] Calling method '>' {{(pid=129322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:50:09.160775 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.compute.api [None req-36072288-cbf6-4da9-ae37-c2a724e2a25a tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] [instance: 88867ead-523a-4d55-9311-bdddd200c270] Fetching instance by UUID {{(pid=129322) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:50:09.162750 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG dbcounter [-] [129322] Writing DB stats nova_cell0:SELECT=6 {{(pid=129322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:50:09.163949 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG dbcounter [-] [129322] Writing DB stats nova_api:SELECT=38,nova_api:INSERT=1 {{(pid=129322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:50:09.170065 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-36072288-cbf6-4da9-ae37-c2a724e2a25a tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:50:09.170508 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-36072288-cbf6-4da9-ae37-c2a724e2a25a tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:50:09.171326 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-36072288-cbf6-4da9-ae37-c2a724e2a25a tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:50:09.171788 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-36072288-cbf6-4da9-ae37-c2a724e2a25a tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:50:09.325630 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.policy [None req-36072288-cbf6-4da9-ae37-c2a724e2a25a tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eddc5d9ac2a74507bca19e06f0051ae1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93d5b6bba38643bfb76f083e230b3d22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129322) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:50:09.333877 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: INFO nova.api.openstack.requestlog [None req-36072288-cbf6-4da9-ae37-c2a724e2a25a tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] 10.222.0.75 "GET /compute/v2.1/servers/88867ead-523a-4d55-9311-bdddd200c270" status: 200 len: 1557 microversion: 2.1 time: 0.178202 May 26 12:50:09.334461 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: [pid: 129322|app: 0|req: 548/1076] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 26 12:50:09 2022] GET /compute/v2.1/servers/88867ead-523a-4d55-9311-bdddd200c270 => generated 1557 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:50:09.355742 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi [None req-bd3026b1-b155-49b8-b38a-141943ef90e9 tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] Calling method '>' {{(pid=129321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:50:09.356351 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.compute.api [None req-bd3026b1-b155-49b8-b38a-141943ef90e9 tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] [instance: 88867ead-523a-4d55-9311-bdddd200c270] Fetching instance by UUID {{(pid=129321) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:50:09.363443 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-bd3026b1-b155-49b8-b38a-141943ef90e9 tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:50:09.364113 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-bd3026b1-b155-49b8-b38a-141943ef90e9 tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:50:09.364985 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-bd3026b1-b155-49b8-b38a-141943ef90e9 tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:50:09.365427 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-bd3026b1-b155-49b8-b38a-141943ef90e9 tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:50:09.462382 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: INFO nova.api.openstack.requestlog [None req-bd3026b1-b155-49b8-b38a-141943ef90e9 tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] 10.222.0.75 "GET /compute/v2.1/servers/88867ead-523a-4d55-9311-bdddd200c270/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.110569 May 26 12:50:09.462993 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: [pid: 129321|app: 0|req: 529/1077] 10.222.0.75 () {58 vars in 1274 bytes} [Thu May 26 12:50:09 2022] GET /compute/v2.1/servers/88867ead-523a-4d55-9311-bdddd200c270/os-interface => generated 284 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 12:50:10.527323 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi [req-64d81787-8c78-42e7-a346-4c06fd0a511d req-95f04c60-cef2-4281-95bb-706db56ad3c9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "88867ead-523a-4d55-9311-bdddd200c270", "tag": "7c579d53-90ff-485d-b901-e248a1c762b2"}]} {{(pid=129322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 12:50:10.536336 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [req-64d81787-8c78-42e7-a346-4c06fd0a511d req-95f04c60-cef2-4281-95bb-706db56ad3c9 service nova] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:50:10.536863 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [req-64d81787-8c78-42e7-a346-4c06fd0a511d req-95f04c60-cef2-4281-95bb-706db56ad3c9 service nova] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:50:10.548702 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: INFO nova.api.openstack.compute.server_external_events [req-64d81787-8c78-42e7-a346-4c06fd0a511d req-95f04c60-cef2-4281-95bb-706db56ad3c9 service nova] Creating event network-changed:7c579d53-90ff-485d-b901-e248a1c762b2 for instance 88867ead-523a-4d55-9311-bdddd200c270 on hv-cinder-81966 May 26 12:50:10.554468 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: INFO nova.api.openstack.requestlog [req-64d81787-8c78-42e7-a346-4c06fd0a511d req-95f04c60-cef2-4281-95bb-706db56ad3c9 service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030794 May 26 12:50:10.555201 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: [pid: 129322|app: 0|req: 549/1078] 10.222.0.75 () {64 vars in 1317 bytes} [Thu May 26 12:50:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 12:50:29.659160 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG dbcounter [-] [129321] Writing DB stats nova_api:SELECT=29,nova_api:INSERT=3 {{(pid=129321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:50:29.659855 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG dbcounter [-] [129321] Writing DB stats nova_cell1:SELECT=34 {{(pid=129321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:50:29.664745 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi [None req-313c8d8c-bb57-4af8-841e-48df1d644e51 tempest-AttachVolumeTestJSON-1454716698 tempest-AttachVolumeTestJSON-1454716698-project] Calling method '>' {{(pid=129321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:50:29.665242 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.compute.api [None req-313c8d8c-bb57-4af8-841e-48df1d644e51 tempest-AttachVolumeTestJSON-1454716698 tempest-AttachVolumeTestJSON-1454716698-project] [instance: 51b4bd5b-19a0-4b50-804d-aff4216e854c] Fetching instance by UUID {{(pid=129321) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:50:29.673445 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-313c8d8c-bb57-4af8-841e-48df1d644e51 tempest-AttachVolumeTestJSON-1454716698 tempest-AttachVolumeTestJSON-1454716698-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:50:29.674322 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-313c8d8c-bb57-4af8-841e-48df1d644e51 tempest-AttachVolumeTestJSON-1454716698 tempest-AttachVolumeTestJSON-1454716698-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:50:29.676003 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-313c8d8c-bb57-4af8-841e-48df1d644e51 tempest-AttachVolumeTestJSON-1454716698 tempest-AttachVolumeTestJSON-1454716698-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:50:29.676861 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-313c8d8c-bb57-4af8-841e-48df1d644e51 tempest-AttachVolumeTestJSON-1454716698 tempest-AttachVolumeTestJSON-1454716698-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:50:29.774805 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.objects.instance [None req-313c8d8c-bb57-4af8-841e-48df1d644e51 tempest-AttachVolumeTestJSON-1454716698 tempest-AttachVolumeTestJSON-1454716698-project] Lazy-loading 'services' on Instance uuid 51b4bd5b-19a0-4b50-804d-aff4216e854c {{(pid=129321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 26 12:50:29.860820 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: INFO nova.api.openstack.requestlog [None req-313c8d8c-bb57-4af8-841e-48df1d644e51 tempest-AttachVolumeTestJSON-1454716698 tempest-AttachVolumeTestJSON-1454716698-project] 10.222.0.75 "DELETE /compute/v2.1/servers/51b4bd5b-19a0-4b50-804d-aff4216e854c/os-volume_attachments/7e65d8a5-f458-4b8c-8847-8ea74453af87" status: 202 len: 0 microversion: 2.1 time: 0.202730 May 26 12:50:29.862019 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: [pid: 129321|app: 0|req: 530/1079] 10.222.0.75 () {58 vars in 1415 bytes} [Thu May 26 12:50:29 2022] DELETE /compute/v2.1/servers/51b4bd5b-19a0-4b50-804d-aff4216e854c/os-volume_attachments/7e65d8a5-f458-4b8c-8847-8ea74453af87 => generated 0 bytes in 205 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 26 12:50:30.979740 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG dbcounter [-] [129322] Writing DB stats nova_api:SELECT=3 {{(pid=129322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:50:30.980475 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG dbcounter [-] [129322] Writing DB stats nova_cell1:SELECT=38 {{(pid=129322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:50:30.985410 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi [None req-7bd720b7-d549-486e-bd31-a20a3703afcb tempest-AttachVolumeTestJSON-1454716698 tempest-AttachVolumeTestJSON-1454716698-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=129322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 12:50:30.995342 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-7bd720b7-d549-486e-bd31-a20a3703afcb tempest-AttachVolumeTestJSON-1454716698 tempest-AttachVolumeTestJSON-1454716698-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:50:30.995959 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-7bd720b7-d549-486e-bd31-a20a3703afcb tempest-AttachVolumeTestJSON-1454716698 tempest-AttachVolumeTestJSON-1454716698-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:50:31.024616 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.compute.api [None req-7bd720b7-d549-486e-bd31-a20a3703afcb tempest-AttachVolumeTestJSON-1454716698 tempest-AttachVolumeTestJSON-1454716698-project] [instance: 51b4bd5b-19a0-4b50-804d-aff4216e854c] Going to try to stop instance {{(pid=129322) force_stop /opt/stack/nova/nova/compute/api.py:2707}} May 26 12:50:31.083415 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: INFO nova.api.openstack.requestlog [None req-7bd720b7-d549-486e-bd31-a20a3703afcb tempest-AttachVolumeTestJSON-1454716698 tempest-AttachVolumeTestJSON-1454716698-project] 10.222.0.75 "POST /compute/v2.1/servers/51b4bd5b-19a0-4b50-804d-aff4216e854c/action" status: 202 len: 0 microversion: 2.1 time: 0.104316 May 26 12:50:31.084130 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: [pid: 129322|app: 0|req: 550/1080] 10.222.0.75 () {60 vars in 1277 bytes} [Thu May 26 12:50:30 2022] POST /compute/v2.1/servers/51b4bd5b-19a0-4b50-804d-aff4216e854c/action => generated 0 bytes in 107 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 26 12:50:31.094364 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi [None req-bf8d64bb-a298-429c-b4aa-63f0780a561e tempest-AttachVolumeTestJSON-1454716698 tempest-AttachVolumeTestJSON-1454716698-project] Calling method '>' {{(pid=129321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:50:31.095130 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.compute.api [None req-bf8d64bb-a298-429c-b4aa-63f0780a561e tempest-AttachVolumeTestJSON-1454716698 tempest-AttachVolumeTestJSON-1454716698-project] [instance: 51b4bd5b-19a0-4b50-804d-aff4216e854c] Fetching instance by UUID {{(pid=129321) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:50:31.104104 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-bf8d64bb-a298-429c-b4aa-63f0780a561e tempest-AttachVolumeTestJSON-1454716698 tempest-AttachVolumeTestJSON-1454716698-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:50:31.104539 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-bf8d64bb-a298-429c-b4aa-63f0780a561e tempest-AttachVolumeTestJSON-1454716698 tempest-AttachVolumeTestJSON-1454716698-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:50:31.105322 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-bf8d64bb-a298-429c-b4aa-63f0780a561e tempest-AttachVolumeTestJSON-1454716698 tempest-AttachVolumeTestJSON-1454716698-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:50:31.105748 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-bf8d64bb-a298-429c-b4aa-63f0780a561e tempest-AttachVolumeTestJSON-1454716698 tempest-AttachVolumeTestJSON-1454716698-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:50:31.249330 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.policy [None req-bf8d64bb-a298-429c-b4aa-63f0780a561e tempest-AttachVolumeTestJSON-1454716698 tempest-AttachVolumeTestJSON-1454716698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e987a71a29243dbac6c23e337765508', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9f9a22ad1e74798b9b2f7d85f89a4b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129321) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:50:31.257519 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: INFO nova.api.openstack.requestlog [None req-bf8d64bb-a298-429c-b4aa-63f0780a561e tempest-AttachVolumeTestJSON-1454716698 tempest-AttachVolumeTestJSON-1454716698-project] 10.222.0.75 "GET /compute/v2.1/servers/51b4bd5b-19a0-4b50-804d-aff4216e854c" status: 200 len: 1676 microversion: 2.1 time: 0.167786 May 26 12:50:31.258087 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: [pid: 129321|app: 0|req: 531/1081] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 26 12:50:31 2022] GET /compute/v2.1/servers/51b4bd5b-19a0-4b50-804d-aff4216e854c => generated 1676 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:50:32.280873 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi [None req-c889af7c-2ee6-4cc0-9c3b-9af9cf8c590a tempest-AttachVolumeTestJSON-1454716698 tempest-AttachVolumeTestJSON-1454716698-project] Calling method '>' {{(pid=129322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:50:32.282013 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.compute.api [None req-c889af7c-2ee6-4cc0-9c3b-9af9cf8c590a tempest-AttachVolumeTestJSON-1454716698 tempest-AttachVolumeTestJSON-1454716698-project] [instance: 51b4bd5b-19a0-4b50-804d-aff4216e854c] Fetching instance by UUID {{(pid=129322) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:50:32.290829 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-c889af7c-2ee6-4cc0-9c3b-9af9cf8c590a tempest-AttachVolumeTestJSON-1454716698 tempest-AttachVolumeTestJSON-1454716698-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:50:32.291276 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-c889af7c-2ee6-4cc0-9c3b-9af9cf8c590a tempest-AttachVolumeTestJSON-1454716698 tempest-AttachVolumeTestJSON-1454716698-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:50:32.292080 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-c889af7c-2ee6-4cc0-9c3b-9af9cf8c590a tempest-AttachVolumeTestJSON-1454716698 tempest-AttachVolumeTestJSON-1454716698-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:50:32.292510 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-c889af7c-2ee6-4cc0-9c3b-9af9cf8c590a tempest-AttachVolumeTestJSON-1454716698 tempest-AttachVolumeTestJSON-1454716698-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:50:32.437766 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.policy [None req-c889af7c-2ee6-4cc0-9c3b-9af9cf8c590a tempest-AttachVolumeTestJSON-1454716698 tempest-AttachVolumeTestJSON-1454716698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e987a71a29243dbac6c23e337765508', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9f9a22ad1e74798b9b2f7d85f89a4b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129322) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:50:32.447321 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: INFO nova.api.openstack.requestlog [None req-c889af7c-2ee6-4cc0-9c3b-9af9cf8c590a tempest-AttachVolumeTestJSON-1454716698 tempest-AttachVolumeTestJSON-1454716698-project] 10.222.0.75 "GET /compute/v2.1/servers/51b4bd5b-19a0-4b50-804d-aff4216e854c" status: 200 len: 1676 microversion: 2.1 time: 0.173164 May 26 12:50:32.448329 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: [pid: 129322|app: 0|req: 551/1082] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 26 12:50:32 2022] GET /compute/v2.1/servers/51b4bd5b-19a0-4b50-804d-aff4216e854c => generated 1676 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:50:33.466511 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi [None req-1c6737b0-3e14-45af-a3c2-1667fab0d944 tempest-AttachVolumeTestJSON-1454716698 tempest-AttachVolumeTestJSON-1454716698-project] Calling method '>' {{(pid=129321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:50:33.467173 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.compute.api [None req-1c6737b0-3e14-45af-a3c2-1667fab0d944 tempest-AttachVolumeTestJSON-1454716698 tempest-AttachVolumeTestJSON-1454716698-project] [instance: 51b4bd5b-19a0-4b50-804d-aff4216e854c] Fetching instance by UUID {{(pid=129321) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:50:33.474254 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-1c6737b0-3e14-45af-a3c2-1667fab0d944 tempest-AttachVolumeTestJSON-1454716698 tempest-AttachVolumeTestJSON-1454716698-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:50:33.474762 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-1c6737b0-3e14-45af-a3c2-1667fab0d944 tempest-AttachVolumeTestJSON-1454716698 tempest-AttachVolumeTestJSON-1454716698-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:50:33.475681 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-1c6737b0-3e14-45af-a3c2-1667fab0d944 tempest-AttachVolumeTestJSON-1454716698 tempest-AttachVolumeTestJSON-1454716698-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:50:33.476115 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-1c6737b0-3e14-45af-a3c2-1667fab0d944 tempest-AttachVolumeTestJSON-1454716698 tempest-AttachVolumeTestJSON-1454716698-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:50:33.610320 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.policy [None req-1c6737b0-3e14-45af-a3c2-1667fab0d944 tempest-AttachVolumeTestJSON-1454716698 tempest-AttachVolumeTestJSON-1454716698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e987a71a29243dbac6c23e337765508', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9f9a22ad1e74798b9b2f7d85f89a4b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129321) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:50:33.619695 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: INFO nova.api.openstack.requestlog [None req-1c6737b0-3e14-45af-a3c2-1667fab0d944 tempest-AttachVolumeTestJSON-1454716698 tempest-AttachVolumeTestJSON-1454716698-project] 10.222.0.75 "GET /compute/v2.1/servers/51b4bd5b-19a0-4b50-804d-aff4216e854c" status: 200 len: 1676 microversion: 2.1 time: 0.156799 May 26 12:50:33.620278 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: [pid: 129321|app: 0|req: 532/1083] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 26 12:50:33 2022] GET /compute/v2.1/servers/51b4bd5b-19a0-4b50-804d-aff4216e854c => generated 1676 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:50:34.637789 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi [None req-1da37ec7-d006-41e1-8301-677bbb91f8de tempest-AttachVolumeTestJSON-1454716698 tempest-AttachVolumeTestJSON-1454716698-project] Calling method '>' {{(pid=129322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:50:34.638437 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.compute.api [None req-1da37ec7-d006-41e1-8301-677bbb91f8de tempest-AttachVolumeTestJSON-1454716698 tempest-AttachVolumeTestJSON-1454716698-project] [instance: 51b4bd5b-19a0-4b50-804d-aff4216e854c] Fetching instance by UUID {{(pid=129322) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:50:34.646153 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-1da37ec7-d006-41e1-8301-677bbb91f8de tempest-AttachVolumeTestJSON-1454716698 tempest-AttachVolumeTestJSON-1454716698-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:50:34.646616 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-1da37ec7-d006-41e1-8301-677bbb91f8de tempest-AttachVolumeTestJSON-1454716698 tempest-AttachVolumeTestJSON-1454716698-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:50:34.647397 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-1da37ec7-d006-41e1-8301-677bbb91f8de tempest-AttachVolumeTestJSON-1454716698 tempest-AttachVolumeTestJSON-1454716698-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:50:34.647864 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-1da37ec7-d006-41e1-8301-677bbb91f8de tempest-AttachVolumeTestJSON-1454716698 tempest-AttachVolumeTestJSON-1454716698-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:50:34.786993 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.policy [None req-1da37ec7-d006-41e1-8301-677bbb91f8de tempest-AttachVolumeTestJSON-1454716698 tempest-AttachVolumeTestJSON-1454716698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e987a71a29243dbac6c23e337765508', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9f9a22ad1e74798b9b2f7d85f89a4b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129322) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:50:34.796402 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: INFO nova.api.openstack.requestlog [None req-1da37ec7-d006-41e1-8301-677bbb91f8de tempest-AttachVolumeTestJSON-1454716698 tempest-AttachVolumeTestJSON-1454716698-project] 10.222.0.75 "GET /compute/v2.1/servers/51b4bd5b-19a0-4b50-804d-aff4216e854c" status: 200 len: 1676 microversion: 2.1 time: 0.162682 May 26 12:50:34.797037 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: [pid: 129322|app: 0|req: 552/1084] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 26 12:50:34 2022] GET /compute/v2.1/servers/51b4bd5b-19a0-4b50-804d-aff4216e854c => generated 1676 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:50:35.814091 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi [None req-7e550196-b4af-4b67-acc5-bc38bf15c619 tempest-AttachVolumeTestJSON-1454716698 tempest-AttachVolumeTestJSON-1454716698-project] Calling method '>' {{(pid=129321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:50:35.814699 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.compute.api [None req-7e550196-b4af-4b67-acc5-bc38bf15c619 tempest-AttachVolumeTestJSON-1454716698 tempest-AttachVolumeTestJSON-1454716698-project] [instance: 51b4bd5b-19a0-4b50-804d-aff4216e854c] Fetching instance by UUID {{(pid=129321) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:50:35.823095 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-7e550196-b4af-4b67-acc5-bc38bf15c619 tempest-AttachVolumeTestJSON-1454716698 tempest-AttachVolumeTestJSON-1454716698-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:50:35.823574 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-7e550196-b4af-4b67-acc5-bc38bf15c619 tempest-AttachVolumeTestJSON-1454716698 tempest-AttachVolumeTestJSON-1454716698-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:50:35.824343 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-7e550196-b4af-4b67-acc5-bc38bf15c619 tempest-AttachVolumeTestJSON-1454716698 tempest-AttachVolumeTestJSON-1454716698-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:50:35.824766 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-7e550196-b4af-4b67-acc5-bc38bf15c619 tempest-AttachVolumeTestJSON-1454716698 tempest-AttachVolumeTestJSON-1454716698-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:50:35.963155 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.policy [None req-7e550196-b4af-4b67-acc5-bc38bf15c619 tempest-AttachVolumeTestJSON-1454716698 tempest-AttachVolumeTestJSON-1454716698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e987a71a29243dbac6c23e337765508', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9f9a22ad1e74798b9b2f7d85f89a4b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129321) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:50:35.971593 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: INFO nova.api.openstack.requestlog [None req-7e550196-b4af-4b67-acc5-bc38bf15c619 tempest-AttachVolumeTestJSON-1454716698 tempest-AttachVolumeTestJSON-1454716698-project] 10.222.0.75 "GET /compute/v2.1/servers/51b4bd5b-19a0-4b50-804d-aff4216e854c" status: 200 len: 1676 microversion: 2.1 time: 0.161300 May 26 12:50:35.972228 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: [pid: 129321|app: 0|req: 533/1085] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 26 12:50:35 2022] GET /compute/v2.1/servers/51b4bd5b-19a0-4b50-804d-aff4216e854c => generated 1676 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:50:36.991598 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi [None req-68e1a4f1-c148-4c3f-a552-e02e50116601 tempest-AttachVolumeTestJSON-1454716698 tempest-AttachVolumeTestJSON-1454716698-project] Calling method '>' {{(pid=129322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:50:36.992248 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.compute.api [None req-68e1a4f1-c148-4c3f-a552-e02e50116601 tempest-AttachVolumeTestJSON-1454716698 tempest-AttachVolumeTestJSON-1454716698-project] [instance: 51b4bd5b-19a0-4b50-804d-aff4216e854c] Fetching instance by UUID {{(pid=129322) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:50:37.000506 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-68e1a4f1-c148-4c3f-a552-e02e50116601 tempest-AttachVolumeTestJSON-1454716698 tempest-AttachVolumeTestJSON-1454716698-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:50:37.000506 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-68e1a4f1-c148-4c3f-a552-e02e50116601 tempest-AttachVolumeTestJSON-1454716698 tempest-AttachVolumeTestJSON-1454716698-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:50:37.000506 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-68e1a4f1-c148-4c3f-a552-e02e50116601 tempest-AttachVolumeTestJSON-1454716698 tempest-AttachVolumeTestJSON-1454716698-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:50:37.000904 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-68e1a4f1-c148-4c3f-a552-e02e50116601 tempest-AttachVolumeTestJSON-1454716698 tempest-AttachVolumeTestJSON-1454716698-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:50:37.150672 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.policy [None req-68e1a4f1-c148-4c3f-a552-e02e50116601 tempest-AttachVolumeTestJSON-1454716698 tempest-AttachVolumeTestJSON-1454716698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e987a71a29243dbac6c23e337765508', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9f9a22ad1e74798b9b2f7d85f89a4b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129322) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:50:37.158941 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: INFO nova.api.openstack.requestlog [None req-68e1a4f1-c148-4c3f-a552-e02e50116601 tempest-AttachVolumeTestJSON-1454716698 tempest-AttachVolumeTestJSON-1454716698-project] 10.222.0.75 "GET /compute/v2.1/servers/51b4bd5b-19a0-4b50-804d-aff4216e854c" status: 200 len: 1676 microversion: 2.1 time: 0.172730 May 26 12:50:37.159522 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: [pid: 129322|app: 0|req: 553/1086] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 26 12:50:36 2022] GET /compute/v2.1/servers/51b4bd5b-19a0-4b50-804d-aff4216e854c => generated 1676 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:50:38.176412 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi [None req-1fe9750d-dcd0-4333-8bee-76f66169ed7c tempest-AttachVolumeTestJSON-1454716698 tempest-AttachVolumeTestJSON-1454716698-project] Calling method '>' {{(pid=129321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:50:38.176998 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.compute.api [None req-1fe9750d-dcd0-4333-8bee-76f66169ed7c tempest-AttachVolumeTestJSON-1454716698 tempest-AttachVolumeTestJSON-1454716698-project] [instance: 51b4bd5b-19a0-4b50-804d-aff4216e854c] Fetching instance by UUID {{(pid=129321) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:50:38.185050 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-1fe9750d-dcd0-4333-8bee-76f66169ed7c tempest-AttachVolumeTestJSON-1454716698 tempest-AttachVolumeTestJSON-1454716698-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:50:38.185763 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-1fe9750d-dcd0-4333-8bee-76f66169ed7c tempest-AttachVolumeTestJSON-1454716698 tempest-AttachVolumeTestJSON-1454716698-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:50:38.186823 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-1fe9750d-dcd0-4333-8bee-76f66169ed7c tempest-AttachVolumeTestJSON-1454716698 tempest-AttachVolumeTestJSON-1454716698-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:50:38.187251 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-1fe9750d-dcd0-4333-8bee-76f66169ed7c tempest-AttachVolumeTestJSON-1454716698 tempest-AttachVolumeTestJSON-1454716698-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:50:38.324951 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.policy [None req-1fe9750d-dcd0-4333-8bee-76f66169ed7c tempest-AttachVolumeTestJSON-1454716698 tempest-AttachVolumeTestJSON-1454716698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e987a71a29243dbac6c23e337765508', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9f9a22ad1e74798b9b2f7d85f89a4b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129321) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:50:38.335032 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: INFO nova.api.openstack.requestlog [None req-1fe9750d-dcd0-4333-8bee-76f66169ed7c tempest-AttachVolumeTestJSON-1454716698 tempest-AttachVolumeTestJSON-1454716698-project] 10.222.0.75 "GET /compute/v2.1/servers/51b4bd5b-19a0-4b50-804d-aff4216e854c" status: 200 len: 1676 microversion: 2.1 time: 0.162544 May 26 12:50:38.335639 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: [pid: 129321|app: 0|req: 534/1087] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 26 12:50:38 2022] GET /compute/v2.1/servers/51b4bd5b-19a0-4b50-804d-aff4216e854c => generated 1676 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:50:39.352407 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi [None req-bfba4705-997b-4c4f-9fa2-3c6aaba57228 tempest-AttachVolumeTestJSON-1454716698 tempest-AttachVolumeTestJSON-1454716698-project] Calling method '>' {{(pid=129322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:50:39.353037 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.compute.api [None req-bfba4705-997b-4c4f-9fa2-3c6aaba57228 tempest-AttachVolumeTestJSON-1454716698 tempest-AttachVolumeTestJSON-1454716698-project] [instance: 51b4bd5b-19a0-4b50-804d-aff4216e854c] Fetching instance by UUID {{(pid=129322) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:50:39.362095 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-bfba4705-997b-4c4f-9fa2-3c6aaba57228 tempest-AttachVolumeTestJSON-1454716698 tempest-AttachVolumeTestJSON-1454716698-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:50:39.362536 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-bfba4705-997b-4c4f-9fa2-3c6aaba57228 tempest-AttachVolumeTestJSON-1454716698 tempest-AttachVolumeTestJSON-1454716698-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:50:39.363298 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-bfba4705-997b-4c4f-9fa2-3c6aaba57228 tempest-AttachVolumeTestJSON-1454716698 tempest-AttachVolumeTestJSON-1454716698-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:50:39.363771 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-bfba4705-997b-4c4f-9fa2-3c6aaba57228 tempest-AttachVolumeTestJSON-1454716698 tempest-AttachVolumeTestJSON-1454716698-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:50:39.506293 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.policy [None req-bfba4705-997b-4c4f-9fa2-3c6aaba57228 tempest-AttachVolumeTestJSON-1454716698 tempest-AttachVolumeTestJSON-1454716698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e987a71a29243dbac6c23e337765508', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9f9a22ad1e74798b9b2f7d85f89a4b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129322) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:50:39.514433 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: INFO nova.api.openstack.requestlog [None req-bfba4705-997b-4c4f-9fa2-3c6aaba57228 tempest-AttachVolumeTestJSON-1454716698 tempest-AttachVolumeTestJSON-1454716698-project] 10.222.0.75 "GET /compute/v2.1/servers/51b4bd5b-19a0-4b50-804d-aff4216e854c" status: 200 len: 1676 microversion: 2.1 time: 0.166041 May 26 12:50:39.515027 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: [pid: 129322|app: 0|req: 554/1088] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 26 12:50:39 2022] GET /compute/v2.1/servers/51b4bd5b-19a0-4b50-804d-aff4216e854c => generated 1676 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:50:40.532019 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi [None req-eb13bdd7-7bef-4fe7-acc7-ce591fc150cb tempest-AttachVolumeTestJSON-1454716698 tempest-AttachVolumeTestJSON-1454716698-project] Calling method '>' {{(pid=129321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:50:40.532642 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.compute.api [None req-eb13bdd7-7bef-4fe7-acc7-ce591fc150cb tempest-AttachVolumeTestJSON-1454716698 tempest-AttachVolumeTestJSON-1454716698-project] [instance: 51b4bd5b-19a0-4b50-804d-aff4216e854c] Fetching instance by UUID {{(pid=129321) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:50:40.540163 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-eb13bdd7-7bef-4fe7-acc7-ce591fc150cb tempest-AttachVolumeTestJSON-1454716698 tempest-AttachVolumeTestJSON-1454716698-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:50:40.540672 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-eb13bdd7-7bef-4fe7-acc7-ce591fc150cb tempest-AttachVolumeTestJSON-1454716698 tempest-AttachVolumeTestJSON-1454716698-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:50:40.541746 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-eb13bdd7-7bef-4fe7-acc7-ce591fc150cb tempest-AttachVolumeTestJSON-1454716698 tempest-AttachVolumeTestJSON-1454716698-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:50:40.541907 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-eb13bdd7-7bef-4fe7-acc7-ce591fc150cb tempest-AttachVolumeTestJSON-1454716698 tempest-AttachVolumeTestJSON-1454716698-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:50:40.678725 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.policy [None req-eb13bdd7-7bef-4fe7-acc7-ce591fc150cb tempest-AttachVolumeTestJSON-1454716698 tempest-AttachVolumeTestJSON-1454716698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e987a71a29243dbac6c23e337765508', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9f9a22ad1e74798b9b2f7d85f89a4b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129321) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:50:40.688260 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: INFO nova.api.openstack.requestlog [None req-eb13bdd7-7bef-4fe7-acc7-ce591fc150cb tempest-AttachVolumeTestJSON-1454716698 tempest-AttachVolumeTestJSON-1454716698-project] 10.222.0.75 "GET /compute/v2.1/servers/51b4bd5b-19a0-4b50-804d-aff4216e854c" status: 200 len: 1676 microversion: 2.1 time: 0.160099 May 26 12:50:40.688818 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: [pid: 129321|app: 0|req: 535/1089] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 26 12:50:40 2022] GET /compute/v2.1/servers/51b4bd5b-19a0-4b50-804d-aff4216e854c => generated 1676 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:50:41.706687 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi [None req-dca2d5ff-6409-4475-9f28-6c5aa2b78bb4 tempest-AttachVolumeTestJSON-1454716698 tempest-AttachVolumeTestJSON-1454716698-project] Calling method '>' {{(pid=129322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:50:41.707279 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.compute.api [None req-dca2d5ff-6409-4475-9f28-6c5aa2b78bb4 tempest-AttachVolumeTestJSON-1454716698 tempest-AttachVolumeTestJSON-1454716698-project] [instance: 51b4bd5b-19a0-4b50-804d-aff4216e854c] Fetching instance by UUID {{(pid=129322) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:50:41.714363 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-dca2d5ff-6409-4475-9f28-6c5aa2b78bb4 tempest-AttachVolumeTestJSON-1454716698 tempest-AttachVolumeTestJSON-1454716698-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:50:41.714812 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-dca2d5ff-6409-4475-9f28-6c5aa2b78bb4 tempest-AttachVolumeTestJSON-1454716698 tempest-AttachVolumeTestJSON-1454716698-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:50:41.715742 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-dca2d5ff-6409-4475-9f28-6c5aa2b78bb4 tempest-AttachVolumeTestJSON-1454716698 tempest-AttachVolumeTestJSON-1454716698-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:50:41.716119 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-dca2d5ff-6409-4475-9f28-6c5aa2b78bb4 tempest-AttachVolumeTestJSON-1454716698 tempest-AttachVolumeTestJSON-1454716698-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:50:41.871083 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.policy [None req-dca2d5ff-6409-4475-9f28-6c5aa2b78bb4 tempest-AttachVolumeTestJSON-1454716698 tempest-AttachVolumeTestJSON-1454716698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e987a71a29243dbac6c23e337765508', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9f9a22ad1e74798b9b2f7d85f89a4b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129322) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:50:41.879720 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: INFO nova.api.openstack.requestlog [None req-dca2d5ff-6409-4475-9f28-6c5aa2b78bb4 tempest-AttachVolumeTestJSON-1454716698 tempest-AttachVolumeTestJSON-1454716698-project] 10.222.0.75 "GET /compute/v2.1/servers/51b4bd5b-19a0-4b50-804d-aff4216e854c" status: 200 len: 1653 microversion: 2.1 time: 0.177004 May 26 12:50:41.880392 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: [pid: 129322|app: 0|req: 555/1090] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 26 12:50:41 2022] GET /compute/v2.1/servers/51b4bd5b-19a0-4b50-804d-aff4216e854c => generated 1653 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:50:41.902270 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi [None req-fc02f9e7-99c9-4b4b-9290-20ab4dbfdb4e tempest-AttachVolumeTestJSON-1454716698 tempest-AttachVolumeTestJSON-1454716698-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=129321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 12:50:41.909349 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-fc02f9e7-99c9-4b4b-9290-20ab4dbfdb4e tempest-AttachVolumeTestJSON-1454716698 tempest-AttachVolumeTestJSON-1454716698-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:50:41.909796 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-fc02f9e7-99c9-4b4b-9290-20ab4dbfdb4e tempest-AttachVolumeTestJSON-1454716698 tempest-AttachVolumeTestJSON-1454716698-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:50:41.934469 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.compute.api [None req-fc02f9e7-99c9-4b4b-9290-20ab4dbfdb4e tempest-AttachVolumeTestJSON-1454716698 tempest-AttachVolumeTestJSON-1454716698-project] [instance: 51b4bd5b-19a0-4b50-804d-aff4216e854c] Going to try to start instance {{(pid=129321) start /opt/stack/nova/nova/compute/api.py:2730}} May 26 12:50:41.984042 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: INFO nova.api.openstack.requestlog [None req-fc02f9e7-99c9-4b4b-9290-20ab4dbfdb4e tempest-AttachVolumeTestJSON-1454716698 tempest-AttachVolumeTestJSON-1454716698-project] 10.222.0.75 "POST /compute/v2.1/servers/51b4bd5b-19a0-4b50-804d-aff4216e854c/action" status: 202 len: 0 microversion: 2.1 time: 0.085487 May 26 12:50:41.984580 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: [pid: 129321|app: 0|req: 536/1091] 10.222.0.75 () {60 vars in 1277 bytes} [Thu May 26 12:50:41 2022] POST /compute/v2.1/servers/51b4bd5b-19a0-4b50-804d-aff4216e854c/action => generated 0 bytes in 87 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 26 12:50:41.992874 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi [None req-b8c9b348-250a-4213-9fe9-7db36495dfcb tempest-AttachVolumeTestJSON-1454716698 tempest-AttachVolumeTestJSON-1454716698-project] Calling method '>' {{(pid=129322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:50:41.993493 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.compute.api [None req-b8c9b348-250a-4213-9fe9-7db36495dfcb tempest-AttachVolumeTestJSON-1454716698 tempest-AttachVolumeTestJSON-1454716698-project] [instance: 51b4bd5b-19a0-4b50-804d-aff4216e854c] Fetching instance by UUID {{(pid=129322) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:50:42.000327 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-b8c9b348-250a-4213-9fe9-7db36495dfcb tempest-AttachVolumeTestJSON-1454716698 tempest-AttachVolumeTestJSON-1454716698-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:50:42.000792 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-b8c9b348-250a-4213-9fe9-7db36495dfcb tempest-AttachVolumeTestJSON-1454716698 tempest-AttachVolumeTestJSON-1454716698-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:50:42.001590 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-b8c9b348-250a-4213-9fe9-7db36495dfcb tempest-AttachVolumeTestJSON-1454716698 tempest-AttachVolumeTestJSON-1454716698-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:50:42.002003 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-b8c9b348-250a-4213-9fe9-7db36495dfcb tempest-AttachVolumeTestJSON-1454716698 tempest-AttachVolumeTestJSON-1454716698-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:50:42.141144 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.policy [None req-b8c9b348-250a-4213-9fe9-7db36495dfcb tempest-AttachVolumeTestJSON-1454716698 tempest-AttachVolumeTestJSON-1454716698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e987a71a29243dbac6c23e337765508', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9f9a22ad1e74798b9b2f7d85f89a4b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129322) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:50:42.149606 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: INFO nova.api.openstack.requestlog [None req-b8c9b348-250a-4213-9fe9-7db36495dfcb tempest-AttachVolumeTestJSON-1454716698 tempest-AttachVolumeTestJSON-1454716698-project] 10.222.0.75 "GET /compute/v2.1/servers/51b4bd5b-19a0-4b50-804d-aff4216e854c" status: 200 len: 1662 microversion: 2.1 time: 0.160649 May 26 12:50:42.150230 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: [pid: 129322|app: 0|req: 556/1092] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 26 12:50:41 2022] GET /compute/v2.1/servers/51b4bd5b-19a0-4b50-804d-aff4216e854c => generated 1662 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:50:43.172044 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi [None req-f6c4b276-9968-4c67-9fd5-bf3067790d5b tempest-AttachVolumeTestJSON-1454716698 tempest-AttachVolumeTestJSON-1454716698-project] Calling method '>' {{(pid=129321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:50:43.172798 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.compute.api [None req-f6c4b276-9968-4c67-9fd5-bf3067790d5b tempest-AttachVolumeTestJSON-1454716698 tempest-AttachVolumeTestJSON-1454716698-project] [instance: 51b4bd5b-19a0-4b50-804d-aff4216e854c] Fetching instance by UUID {{(pid=129321) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:50:43.181528 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-f6c4b276-9968-4c67-9fd5-bf3067790d5b tempest-AttachVolumeTestJSON-1454716698 tempest-AttachVolumeTestJSON-1454716698-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:50:43.181965 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-f6c4b276-9968-4c67-9fd5-bf3067790d5b tempest-AttachVolumeTestJSON-1454716698 tempest-AttachVolumeTestJSON-1454716698-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:50:43.182736 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-f6c4b276-9968-4c67-9fd5-bf3067790d5b tempest-AttachVolumeTestJSON-1454716698 tempest-AttachVolumeTestJSON-1454716698-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:50:43.183167 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-f6c4b276-9968-4c67-9fd5-bf3067790d5b tempest-AttachVolumeTestJSON-1454716698 tempest-AttachVolumeTestJSON-1454716698-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:50:43.330974 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.policy [None req-f6c4b276-9968-4c67-9fd5-bf3067790d5b tempest-AttachVolumeTestJSON-1454716698 tempest-AttachVolumeTestJSON-1454716698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e987a71a29243dbac6c23e337765508', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9f9a22ad1e74798b9b2f7d85f89a4b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129321) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:50:43.340097 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: INFO nova.api.openstack.requestlog [None req-f6c4b276-9968-4c67-9fd5-bf3067790d5b tempest-AttachVolumeTestJSON-1454716698 tempest-AttachVolumeTestJSON-1454716698-project] 10.222.0.75 "GET /compute/v2.1/servers/51b4bd5b-19a0-4b50-804d-aff4216e854c" status: 200 len: 1662 microversion: 2.1 time: 0.175419 May 26 12:50:43.340717 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: [pid: 129321|app: 0|req: 537/1093] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 26 12:50:43 2022] GET /compute/v2.1/servers/51b4bd5b-19a0-4b50-804d-aff4216e854c => generated 1662 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:50:44.365418 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi [None req-c3e94ecc-cd13-42f8-89cc-108893200166 tempest-AttachVolumeTestJSON-1454716698 tempest-AttachVolumeTestJSON-1454716698-project] Calling method '>' {{(pid=129322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:50:44.366065 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.compute.api [None req-c3e94ecc-cd13-42f8-89cc-108893200166 tempest-AttachVolumeTestJSON-1454716698 tempest-AttachVolumeTestJSON-1454716698-project] [instance: 51b4bd5b-19a0-4b50-804d-aff4216e854c] Fetching instance by UUID {{(pid=129322) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:50:44.373333 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-c3e94ecc-cd13-42f8-89cc-108893200166 tempest-AttachVolumeTestJSON-1454716698 tempest-AttachVolumeTestJSON-1454716698-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:50:44.373826 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-c3e94ecc-cd13-42f8-89cc-108893200166 tempest-AttachVolumeTestJSON-1454716698 tempest-AttachVolumeTestJSON-1454716698-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:50:44.374604 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-c3e94ecc-cd13-42f8-89cc-108893200166 tempest-AttachVolumeTestJSON-1454716698 tempest-AttachVolumeTestJSON-1454716698-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:50:44.375036 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-c3e94ecc-cd13-42f8-89cc-108893200166 tempest-AttachVolumeTestJSON-1454716698 tempest-AttachVolumeTestJSON-1454716698-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:50:44.512204 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.policy [None req-c3e94ecc-cd13-42f8-89cc-108893200166 tempest-AttachVolumeTestJSON-1454716698 tempest-AttachVolumeTestJSON-1454716698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e987a71a29243dbac6c23e337765508', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9f9a22ad1e74798b9b2f7d85f89a4b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129322) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:50:44.520931 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: INFO nova.api.openstack.requestlog [None req-c3e94ecc-cd13-42f8-89cc-108893200166 tempest-AttachVolumeTestJSON-1454716698 tempest-AttachVolumeTestJSON-1454716698-project] 10.222.0.75 "GET /compute/v2.1/servers/51b4bd5b-19a0-4b50-804d-aff4216e854c" status: 200 len: 1666 microversion: 2.1 time: 0.161454 May 26 12:50:44.521690 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: [pid: 129322|app: 0|req: 557/1094] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 26 12:50:44 2022] GET /compute/v2.1/servers/51b4bd5b-19a0-4b50-804d-aff4216e854c => generated 1666 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:51:15.239718 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi [None req-99242bd0-025b-4551-9ac4-379b6781977a tempest-TestVolumeBootPattern-1304354335 tempest-TestVolumeBootPattern-1304354335-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-2120785304", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-172235393", "security_groups": [{"name": "tempest-secgroup-smoke-1960816556"}], "block_device_mapping_v2": [{"uuid": "5468c460-6f96-4597-8de3-70df4a110784", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "7eee456a-a9f6-42d0-bed8-fc7419b250fe"}]}} {{(pid=129321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 12:51:15.248886 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG dbcounter [-] [129321] Writing DB stats nova_api:SELECT=16 {{(pid=129321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:51:15.249519 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG dbcounter [-] [129321] Writing DB stats nova_cell1:SELECT=55,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=129321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:51:15.371425 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.network.neutron [None req-99242bd0-025b-4551-9ac4-379b6781977a tempest-TestVolumeBootPattern-1304354335 tempest-TestVolumeBootPattern-1304354335-project] validate_networks() for [('7eee456a-a9f6-42d0-bed8-fc7419b250fe', None, None, None, None, None)] {{(pid=129321) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 26 12:51:15.766771 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.virt.hardware [None req-99242bd0-025b-4551-9ac4-379b6781977a tempest-TestVolumeBootPattern-1304354335 tempest-TestVolumeBootPattern-1304354335-project] Flavor limits 0:0:0 {{(pid=129321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 26 12:51:15.767198 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.virt.hardware [None req-99242bd0-025b-4551-9ac4-379b6781977a tempest-TestVolumeBootPattern-1304354335 tempest-TestVolumeBootPattern-1304354335-project] Image limits 0:0:0 {{(pid=129321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 26 12:51:15.768074 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.virt.hardware [None req-99242bd0-025b-4551-9ac4-379b6781977a tempest-TestVolumeBootPattern-1304354335 tempest-TestVolumeBootPattern-1304354335-project] Flavor pref 0:0:0 {{(pid=129321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 26 12:51:15.768539 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.virt.hardware [None req-99242bd0-025b-4551-9ac4-379b6781977a tempest-TestVolumeBootPattern-1304354335 tempest-TestVolumeBootPattern-1304354335-project] Image pref 0:0:0 {{(pid=129321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 26 12:51:15.769163 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.virt.hardware [None req-99242bd0-025b-4551-9ac4-379b6781977a tempest-TestVolumeBootPattern-1304354335 tempest-TestVolumeBootPattern-1304354335-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 26 12:51:15.779688 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-99242bd0-025b-4551-9ac4-379b6781977a tempest-TestVolumeBootPattern-1304354335 tempest-TestVolumeBootPattern-1304354335-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:51:15.780140 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-99242bd0-025b-4551-9ac4-379b6781977a tempest-TestVolumeBootPattern-1304354335 tempest-TestVolumeBootPattern-1304354335-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:51:15.780938 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-99242bd0-025b-4551-9ac4-379b6781977a tempest-TestVolumeBootPattern-1304354335 tempest-TestVolumeBootPattern-1304354335-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:51:15.781369 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-99242bd0-025b-4551-9ac4-379b6781977a tempest-TestVolumeBootPattern-1304354335 tempest-TestVolumeBootPattern-1304354335-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:51:15.800117 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.quota [None req-99242bd0-025b-4551-9ac4-379b6781977a tempest-TestVolumeBootPattern-1304354335 tempest-TestVolumeBootPattern-1304354335-project] Getting quotas for project d6fb41c547884511893b768b833f4e90. Resources: {'instances', 'cores', 'ram'} {{(pid=129321) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 26 12:51:15.804550 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.quota [None req-99242bd0-025b-4551-9ac4-379b6781977a tempest-TestVolumeBootPattern-1304354335 tempest-TestVolumeBootPattern-1304354335-project] Getting quotas for user ab469b18ce0444d9884cdddc34ef7247 and project d6fb41c547884511893b768b833f4e90. Resources: {'instances', 'cores', 'ram'} {{(pid=129321) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 26 12:51:15.863473 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.compute.api [None req-99242bd0-025b-4551-9ac4-379b6781977a tempest-TestVolumeBootPattern-1304354335 tempest-TestVolumeBootPattern-1304354335-project] Going to run 1 instances... {{(pid=129321) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 26 12:51:15.866052 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.compute.api [None req-99242bd0-025b-4551-9ac4-379b6781977a tempest-TestVolumeBootPattern-1304354335 tempest-TestVolumeBootPattern-1304354335-project] [instance: 657f7e4e-0bc0-4594-8210-767d8e63dfec] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='5468c460-6f96-4597-8de3-70df4a110784',volume_size=None,volume_type=None)] {{(pid=129321) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 26 12:51:16.004723 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: INFO nova.api.openstack.requestlog [None req-99242bd0-025b-4551-9ac4-379b6781977a tempest-TestVolumeBootPattern-1304354335 tempest-TestVolumeBootPattern-1304354335-project] 10.222.0.75 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.769571 May 26 12:51:16.005377 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: [pid: 129321|app: 0|req: 538/1095] 10.222.0.75 () {60 vars in 1146 bytes} [Thu May 26 12:51:15 2022] POST /compute/v2.1/servers => generated 406 bytes in 771 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) May 26 12:51:16.016240 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi [None req-8a8b74ae-98e4-40d1-b6a7-185381d3589b tempest-TestVolumeBootPattern-1304354335 tempest-TestVolumeBootPattern-1304354335-project] Calling method '>' {{(pid=129322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:51:16.017009 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.compute.api [None req-8a8b74ae-98e4-40d1-b6a7-185381d3589b tempest-TestVolumeBootPattern-1304354335 tempest-TestVolumeBootPattern-1304354335-project] [instance: 657f7e4e-0bc0-4594-8210-767d8e63dfec] Fetching instance by UUID {{(pid=129322) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:51:16.019758 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG dbcounter [-] [129322] Writing DB stats nova_api:SELECT=16 {{(pid=129322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:51:16.020431 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG dbcounter [-] [129322] Writing DB stats nova_cell1:SELECT=52,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:51:16.090877 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.policy [None req-8a8b74ae-98e4-40d1-b6a7-185381d3589b tempest-TestVolumeBootPattern-1304354335 tempest-TestVolumeBootPattern-1304354335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab469b18ce0444d9884cdddc34ef7247', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fb41c547884511893b768b833f4e90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129322) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:51:16.098465 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: INFO nova.api.openstack.requestlog [None req-8a8b74ae-98e4-40d1-b6a7-185381d3589b tempest-TestVolumeBootPattern-1304354335 tempest-TestVolumeBootPattern-1304354335-project] 10.222.0.75 "GET /compute/v2.1/servers/657f7e4e-0bc0-4594-8210-767d8e63dfec" status: 200 len: 1094 microversion: 2.1 time: 0.086122 May 26 12:51:16.099312 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: [pid: 129322|app: 0|req: 558/1096] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 26 12:51:16 2022] GET /compute/v2.1/servers/657f7e4e-0bc0-4594-8210-767d8e63dfec => generated 1094 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:51:17.119280 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi [None req-580c1687-c0a3-4e29-a588-873e8ab566a5 tempest-TestVolumeBootPattern-1304354335 tempest-TestVolumeBootPattern-1304354335-project] Calling method '>' {{(pid=129321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:51:17.119946 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.compute.api [None req-580c1687-c0a3-4e29-a588-873e8ab566a5 tempest-TestVolumeBootPattern-1304354335 tempest-TestVolumeBootPattern-1304354335-project] [instance: 657f7e4e-0bc0-4594-8210-767d8e63dfec] Fetching instance by UUID {{(pid=129321) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:51:17.129413 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-580c1687-c0a3-4e29-a588-873e8ab566a5 tempest-TestVolumeBootPattern-1304354335 tempest-TestVolumeBootPattern-1304354335-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:51:17.130149 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-580c1687-c0a3-4e29-a588-873e8ab566a5 tempest-TestVolumeBootPattern-1304354335 tempest-TestVolumeBootPattern-1304354335-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:51:17.131908 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-580c1687-c0a3-4e29-a588-873e8ab566a5 tempest-TestVolumeBootPattern-1304354335 tempest-TestVolumeBootPattern-1304354335-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:51:17.132360 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-580c1687-c0a3-4e29-a588-873e8ab566a5 tempest-TestVolumeBootPattern-1304354335 tempest-TestVolumeBootPattern-1304354335-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:51:17.196995 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.policy [None req-580c1687-c0a3-4e29-a588-873e8ab566a5 tempest-TestVolumeBootPattern-1304354335 tempest-TestVolumeBootPattern-1304354335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab469b18ce0444d9884cdddc34ef7247', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fb41c547884511893b768b833f4e90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129321) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:51:17.205262 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: INFO nova.api.openstack.requestlog [None req-580c1687-c0a3-4e29-a588-873e8ab566a5 tempest-TestVolumeBootPattern-1304354335 tempest-TestVolumeBootPattern-1304354335-project] 10.222.0.75 "GET /compute/v2.1/servers/657f7e4e-0bc0-4594-8210-767d8e63dfec" status: 200 len: 1200 microversion: 2.1 time: 0.090516 May 26 12:51:17.205856 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: [pid: 129321|app: 0|req: 539/1097] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 26 12:51:17 2022] GET /compute/v2.1/servers/657f7e4e-0bc0-4594-8210-767d8e63dfec => generated 1200 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:51:18.222921 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi [None req-b1033d8d-3545-46d7-8631-3db611d458d8 tempest-TestVolumeBootPattern-1304354335 tempest-TestVolumeBootPattern-1304354335-project] Calling method '>' {{(pid=129322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:51:18.223503 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.compute.api [None req-b1033d8d-3545-46d7-8631-3db611d458d8 tempest-TestVolumeBootPattern-1304354335 tempest-TestVolumeBootPattern-1304354335-project] [instance: 657f7e4e-0bc0-4594-8210-767d8e63dfec] Fetching instance by UUID {{(pid=129322) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:51:18.231759 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-b1033d8d-3545-46d7-8631-3db611d458d8 tempest-TestVolumeBootPattern-1304354335 tempest-TestVolumeBootPattern-1304354335-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:51:18.232325 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-b1033d8d-3545-46d7-8631-3db611d458d8 tempest-TestVolumeBootPattern-1304354335 tempest-TestVolumeBootPattern-1304354335-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:51:18.233176 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-b1033d8d-3545-46d7-8631-3db611d458d8 tempest-TestVolumeBootPattern-1304354335 tempest-TestVolumeBootPattern-1304354335-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:51:18.233674 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-b1033d8d-3545-46d7-8631-3db611d458d8 tempest-TestVolumeBootPattern-1304354335 tempest-TestVolumeBootPattern-1304354335-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:51:18.385080 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.policy [None req-b1033d8d-3545-46d7-8631-3db611d458d8 tempest-TestVolumeBootPattern-1304354335 tempest-TestVolumeBootPattern-1304354335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab469b18ce0444d9884cdddc34ef7247', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fb41c547884511893b768b833f4e90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129322) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:51:18.395828 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: INFO nova.api.openstack.requestlog [None req-b1033d8d-3545-46d7-8631-3db611d458d8 tempest-TestVolumeBootPattern-1304354335 tempest-TestVolumeBootPattern-1304354335-project] 10.222.0.75 "GET /compute/v2.1/servers/657f7e4e-0bc0-4594-8210-767d8e63dfec" status: 200 len: 1278 microversion: 2.1 time: 0.176871 May 26 12:51:18.396824 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: [pid: 129322|app: 0|req: 559/1098] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 26 12:51:18 2022] GET /compute/v2.1/servers/657f7e4e-0bc0-4594-8210-767d8e63dfec => generated 1278 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:51:19.402572 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi [req-58e59d56-1e16-42dc-9c3d-48d12a487678 req-bcbfb52b-4c32-43e2-952a-49736af7942d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "657f7e4e-0bc0-4594-8210-767d8e63dfec", "tag": "c9abc1b1-291f-4a53-ba39-f482d780eca0"}]} {{(pid=129321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 12:51:19.419339 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi [None req-bb7f14dd-809e-44bf-b066-34a8bfc06333 tempest-TestVolumeBootPattern-1304354335 tempest-TestVolumeBootPattern-1304354335-project] Calling method '>' {{(pid=129322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:51:19.421411 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.compute.api [None req-bb7f14dd-809e-44bf-b066-34a8bfc06333 tempest-TestVolumeBootPattern-1304354335 tempest-TestVolumeBootPattern-1304354335-project] [instance: 657f7e4e-0bc0-4594-8210-767d8e63dfec] Fetching instance by UUID {{(pid=129322) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:51:19.431850 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [req-58e59d56-1e16-42dc-9c3d-48d12a487678 req-bcbfb52b-4c32-43e2-952a-49736af7942d service nova] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:51:19.431850 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [req-58e59d56-1e16-42dc-9c3d-48d12a487678 req-bcbfb52b-4c32-43e2-952a-49736af7942d service nova] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:51:19.446059 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: INFO nova.api.openstack.compute.server_external_events [req-58e59d56-1e16-42dc-9c3d-48d12a487678 req-bcbfb52b-4c32-43e2-952a-49736af7942d service nova] Creating event network-changed:c9abc1b1-291f-4a53-ba39-f482d780eca0 for instance 657f7e4e-0bc0-4594-8210-767d8e63dfec on hv-cinder-81966 May 26 12:51:19.453680 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: INFO nova.api.openstack.requestlog [req-58e59d56-1e16-42dc-9c3d-48d12a487678 req-bcbfb52b-4c32-43e2-952a-49736af7942d service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.067200 May 26 12:51:19.454558 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: [pid: 129321|app: 0|req: 540/1099] 10.222.0.75 () {64 vars in 1317 bytes} [Thu May 26 12:51:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 12:51:19.461980 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-bb7f14dd-809e-44bf-b066-34a8bfc06333 tempest-TestVolumeBootPattern-1304354335 tempest-TestVolumeBootPattern-1304354335-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:51:19.462744 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-bb7f14dd-809e-44bf-b066-34a8bfc06333 tempest-TestVolumeBootPattern-1304354335 tempest-TestVolumeBootPattern-1304354335-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:51:19.464088 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-bb7f14dd-809e-44bf-b066-34a8bfc06333 tempest-TestVolumeBootPattern-1304354335 tempest-TestVolumeBootPattern-1304354335-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:51:19.464803 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-bb7f14dd-809e-44bf-b066-34a8bfc06333 tempest-TestVolumeBootPattern-1304354335 tempest-TestVolumeBootPattern-1304354335-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:51:19.649489 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.policy [None req-bb7f14dd-809e-44bf-b066-34a8bfc06333 tempest-TestVolumeBootPattern-1304354335 tempest-TestVolumeBootPattern-1304354335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab469b18ce0444d9884cdddc34ef7247', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fb41c547884511893b768b833f4e90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129322) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:51:19.657606 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: INFO nova.api.openstack.requestlog [None req-bb7f14dd-809e-44bf-b066-34a8bfc06333 tempest-TestVolumeBootPattern-1304354335 tempest-TestVolumeBootPattern-1304354335-project] 10.222.0.75 "GET /compute/v2.1/servers/657f7e4e-0bc0-4594-8210-767d8e63dfec" status: 200 len: 1266 microversion: 2.1 time: 0.245525 May 26 12:51:19.658198 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: [pid: 129322|app: 0|req: 560/1100] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 26 12:51:19 2022] GET /compute/v2.1/servers/657f7e4e-0bc0-4594-8210-767d8e63dfec => generated 1266 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:51:20.679554 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi [None req-a567469c-0c84-42c8-a679-a9aa191ff478 tempest-TestVolumeBootPattern-1304354335 tempest-TestVolumeBootPattern-1304354335-project] Calling method '>' {{(pid=129321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:51:20.680272 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.compute.api [None req-a567469c-0c84-42c8-a679-a9aa191ff478 tempest-TestVolumeBootPattern-1304354335 tempest-TestVolumeBootPattern-1304354335-project] [instance: 657f7e4e-0bc0-4594-8210-767d8e63dfec] Fetching instance by UUID {{(pid=129321) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:51:20.687018 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-a567469c-0c84-42c8-a679-a9aa191ff478 tempest-TestVolumeBootPattern-1304354335 tempest-TestVolumeBootPattern-1304354335-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:51:20.687427 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-a567469c-0c84-42c8-a679-a9aa191ff478 tempest-TestVolumeBootPattern-1304354335 tempest-TestVolumeBootPattern-1304354335-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:51:20.688245 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-a567469c-0c84-42c8-a679-a9aa191ff478 tempest-TestVolumeBootPattern-1304354335 tempest-TestVolumeBootPattern-1304354335-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:51:20.688668 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-a567469c-0c84-42c8-a679-a9aa191ff478 tempest-TestVolumeBootPattern-1304354335 tempest-TestVolumeBootPattern-1304354335-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:51:20.838288 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.policy [None req-a567469c-0c84-42c8-a679-a9aa191ff478 tempest-TestVolumeBootPattern-1304354335 tempest-TestVolumeBootPattern-1304354335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab469b18ce0444d9884cdddc34ef7247', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fb41c547884511893b768b833f4e90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129321) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:51:20.846452 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: INFO nova.api.openstack.requestlog [None req-a567469c-0c84-42c8-a679-a9aa191ff478 tempest-TestVolumeBootPattern-1304354335 tempest-TestVolumeBootPattern-1304354335-project] 10.222.0.75 "GET /compute/v2.1/servers/657f7e4e-0bc0-4594-8210-767d8e63dfec" status: 200 len: 1266 microversion: 2.1 time: 0.174043 May 26 12:51:20.847035 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: [pid: 129321|app: 0|req: 541/1101] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 26 12:51:20 2022] GET /compute/v2.1/servers/657f7e4e-0bc0-4594-8210-767d8e63dfec => generated 1266 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:51:21.867305 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi [None req-4cc90f0c-ce76-4a6b-9144-0d0bf21c0c33 tempest-TestVolumeBootPattern-1304354335 tempest-TestVolumeBootPattern-1304354335-project] Calling method '>' {{(pid=129322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:51:21.867953 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.compute.api [None req-4cc90f0c-ce76-4a6b-9144-0d0bf21c0c33 tempest-TestVolumeBootPattern-1304354335 tempest-TestVolumeBootPattern-1304354335-project] [instance: 657f7e4e-0bc0-4594-8210-767d8e63dfec] Fetching instance by UUID {{(pid=129322) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:51:21.875421 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-4cc90f0c-ce76-4a6b-9144-0d0bf21c0c33 tempest-TestVolumeBootPattern-1304354335 tempest-TestVolumeBootPattern-1304354335-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:51:21.875898 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-4cc90f0c-ce76-4a6b-9144-0d0bf21c0c33 tempest-TestVolumeBootPattern-1304354335 tempest-TestVolumeBootPattern-1304354335-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:51:21.876672 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-4cc90f0c-ce76-4a6b-9144-0d0bf21c0c33 tempest-TestVolumeBootPattern-1304354335 tempest-TestVolumeBootPattern-1304354335-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:51:21.877102 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-4cc90f0c-ce76-4a6b-9144-0d0bf21c0c33 tempest-TestVolumeBootPattern-1304354335 tempest-TestVolumeBootPattern-1304354335-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:51:22.010819 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.policy [None req-4cc90f0c-ce76-4a6b-9144-0d0bf21c0c33 tempest-TestVolumeBootPattern-1304354335 tempest-TestVolumeBootPattern-1304354335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab469b18ce0444d9884cdddc34ef7247', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fb41c547884511893b768b833f4e90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129322) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:51:22.019289 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: INFO nova.api.openstack.requestlog [None req-4cc90f0c-ce76-4a6b-9144-0d0bf21c0c33 tempest-TestVolumeBootPattern-1304354335 tempest-TestVolumeBootPattern-1304354335-project] 10.222.0.75 "GET /compute/v2.1/servers/657f7e4e-0bc0-4594-8210-767d8e63dfec" status: 200 len: 1266 microversion: 2.1 time: 0.157841 May 26 12:51:22.019947 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: [pid: 129322|app: 0|req: 561/1102] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 26 12:51:21 2022] GET /compute/v2.1/servers/657f7e4e-0bc0-4594-8210-767d8e63dfec => generated 1266 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:51:23.039341 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi [None req-06821add-c5ea-415e-863c-72fdfca2b381 tempest-TestVolumeBootPattern-1304354335 tempest-TestVolumeBootPattern-1304354335-project] Calling method '>' {{(pid=129321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:51:23.039964 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.compute.api [None req-06821add-c5ea-415e-863c-72fdfca2b381 tempest-TestVolumeBootPattern-1304354335 tempest-TestVolumeBootPattern-1304354335-project] [instance: 657f7e4e-0bc0-4594-8210-767d8e63dfec] Fetching instance by UUID {{(pid=129321) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:51:23.046903 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-06821add-c5ea-415e-863c-72fdfca2b381 tempest-TestVolumeBootPattern-1304354335 tempest-TestVolumeBootPattern-1304354335-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:51:23.047345 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-06821add-c5ea-415e-863c-72fdfca2b381 tempest-TestVolumeBootPattern-1304354335 tempest-TestVolumeBootPattern-1304354335-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:51:23.048146 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-06821add-c5ea-415e-863c-72fdfca2b381 tempest-TestVolumeBootPattern-1304354335 tempest-TestVolumeBootPattern-1304354335-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:51:23.048572 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-06821add-c5ea-415e-863c-72fdfca2b381 tempest-TestVolumeBootPattern-1304354335 tempest-TestVolumeBootPattern-1304354335-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:51:23.198034 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.policy [None req-06821add-c5ea-415e-863c-72fdfca2b381 tempest-TestVolumeBootPattern-1304354335 tempest-TestVolumeBootPattern-1304354335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab469b18ce0444d9884cdddc34ef7247', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fb41c547884511893b768b833f4e90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129321) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:51:23.206076 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: INFO nova.api.openstack.requestlog [None req-06821add-c5ea-415e-863c-72fdfca2b381 tempest-TestVolumeBootPattern-1304354335 tempest-TestVolumeBootPattern-1304354335-project] 10.222.0.75 "GET /compute/v2.1/servers/657f7e4e-0bc0-4594-8210-767d8e63dfec" status: 200 len: 1266 microversion: 2.1 time: 0.172404 May 26 12:51:23.206630 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: [pid: 129321|app: 0|req: 542/1103] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 26 12:51:23 2022] GET /compute/v2.1/servers/657f7e4e-0bc0-4594-8210-767d8e63dfec => generated 1266 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:51:24.223436 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi [None req-2432cba9-70a6-4aaf-95d3-6231d95a916e tempest-TestVolumeBootPattern-1304354335 tempest-TestVolumeBootPattern-1304354335-project] Calling method '>' {{(pid=129322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:51:24.224096 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.compute.api [None req-2432cba9-70a6-4aaf-95d3-6231d95a916e tempest-TestVolumeBootPattern-1304354335 tempest-TestVolumeBootPattern-1304354335-project] [instance: 657f7e4e-0bc0-4594-8210-767d8e63dfec] Fetching instance by UUID {{(pid=129322) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:51:24.231456 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-2432cba9-70a6-4aaf-95d3-6231d95a916e tempest-TestVolumeBootPattern-1304354335 tempest-TestVolumeBootPattern-1304354335-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:51:24.232625 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-2432cba9-70a6-4aaf-95d3-6231d95a916e tempest-TestVolumeBootPattern-1304354335 tempest-TestVolumeBootPattern-1304354335-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:51:24.233988 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-2432cba9-70a6-4aaf-95d3-6231d95a916e tempest-TestVolumeBootPattern-1304354335 tempest-TestVolumeBootPattern-1304354335-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:51:24.234421 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-2432cba9-70a6-4aaf-95d3-6231d95a916e tempest-TestVolumeBootPattern-1304354335 tempest-TestVolumeBootPattern-1304354335-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:51:24.377723 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.policy [None req-2432cba9-70a6-4aaf-95d3-6231d95a916e tempest-TestVolumeBootPattern-1304354335 tempest-TestVolumeBootPattern-1304354335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab469b18ce0444d9884cdddc34ef7247', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fb41c547884511893b768b833f4e90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129322) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:51:24.385374 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: INFO nova.api.openstack.requestlog [None req-2432cba9-70a6-4aaf-95d3-6231d95a916e tempest-TestVolumeBootPattern-1304354335 tempest-TestVolumeBootPattern-1304354335-project] 10.222.0.75 "GET /compute/v2.1/servers/657f7e4e-0bc0-4594-8210-767d8e63dfec" status: 200 len: 1266 microversion: 2.1 time: 0.166174 May 26 12:51:24.385976 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: [pid: 129322|app: 0|req: 562/1104] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 26 12:51:24 2022] GET /compute/v2.1/servers/657f7e4e-0bc0-4594-8210-767d8e63dfec => generated 1266 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:51:25.405385 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi [None req-a051c010-a72b-420d-8fd9-d47f5f5a9e27 tempest-TestVolumeBootPattern-1304354335 tempest-TestVolumeBootPattern-1304354335-project] Calling method '>' {{(pid=129321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:51:25.406301 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.compute.api [None req-a051c010-a72b-420d-8fd9-d47f5f5a9e27 tempest-TestVolumeBootPattern-1304354335 tempest-TestVolumeBootPattern-1304354335-project] [instance: 657f7e4e-0bc0-4594-8210-767d8e63dfec] Fetching instance by UUID {{(pid=129321) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:51:25.416087 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-a051c010-a72b-420d-8fd9-d47f5f5a9e27 tempest-TestVolumeBootPattern-1304354335 tempest-TestVolumeBootPattern-1304354335-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:51:25.416420 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-a051c010-a72b-420d-8fd9-d47f5f5a9e27 tempest-TestVolumeBootPattern-1304354335 tempest-TestVolumeBootPattern-1304354335-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:51:25.417219 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-a051c010-a72b-420d-8fd9-d47f5f5a9e27 tempest-TestVolumeBootPattern-1304354335 tempest-TestVolumeBootPattern-1304354335-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:51:25.417648 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-a051c010-a72b-420d-8fd9-d47f5f5a9e27 tempest-TestVolumeBootPattern-1304354335 tempest-TestVolumeBootPattern-1304354335-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:51:25.563590 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.policy [None req-a051c010-a72b-420d-8fd9-d47f5f5a9e27 tempest-TestVolumeBootPattern-1304354335 tempest-TestVolumeBootPattern-1304354335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab469b18ce0444d9884cdddc34ef7247', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fb41c547884511893b768b833f4e90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129321) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:51:25.575233 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: INFO nova.api.openstack.requestlog [None req-a051c010-a72b-420d-8fd9-d47f5f5a9e27 tempest-TestVolumeBootPattern-1304354335 tempest-TestVolumeBootPattern-1304354335-project] 10.222.0.75 "GET /compute/v2.1/servers/657f7e4e-0bc0-4594-8210-767d8e63dfec" status: 200 len: 1266 microversion: 2.1 time: 0.175498 May 26 12:51:25.576048 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: [pid: 129321|app: 0|req: 543/1105] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 26 12:51:25 2022] GET /compute/v2.1/servers/657f7e4e-0bc0-4594-8210-767d8e63dfec => generated 1266 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:51:26.600494 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi [None req-e2339c5d-3fde-426d-9fbf-b31f776b1d17 tempest-TestVolumeBootPattern-1304354335 tempest-TestVolumeBootPattern-1304354335-project] Calling method '>' {{(pid=129322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:51:26.601431 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.compute.api [None req-e2339c5d-3fde-426d-9fbf-b31f776b1d17 tempest-TestVolumeBootPattern-1304354335 tempest-TestVolumeBootPattern-1304354335-project] [instance: 657f7e4e-0bc0-4594-8210-767d8e63dfec] Fetching instance by UUID {{(pid=129322) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:51:26.603937 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG dbcounter [-] [129322] Writing DB stats nova_cell0:SELECT=2 {{(pid=129322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:51:26.609846 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-e2339c5d-3fde-426d-9fbf-b31f776b1d17 tempest-TestVolumeBootPattern-1304354335 tempest-TestVolumeBootPattern-1304354335-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:51:26.610286 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-e2339c5d-3fde-426d-9fbf-b31f776b1d17 tempest-TestVolumeBootPattern-1304354335 tempest-TestVolumeBootPattern-1304354335-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:51:26.611060 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-e2339c5d-3fde-426d-9fbf-b31f776b1d17 tempest-TestVolumeBootPattern-1304354335 tempest-TestVolumeBootPattern-1304354335-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:51:26.611483 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-e2339c5d-3fde-426d-9fbf-b31f776b1d17 tempest-TestVolumeBootPattern-1304354335 tempest-TestVolumeBootPattern-1304354335-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:51:26.753570 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.policy [None req-e2339c5d-3fde-426d-9fbf-b31f776b1d17 tempest-TestVolumeBootPattern-1304354335 tempest-TestVolumeBootPattern-1304354335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab469b18ce0444d9884cdddc34ef7247', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fb41c547884511893b768b833f4e90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129322) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:51:26.761828 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: INFO nova.api.openstack.requestlog [None req-e2339c5d-3fde-426d-9fbf-b31f776b1d17 tempest-TestVolumeBootPattern-1304354335 tempest-TestVolumeBootPattern-1304354335-project] 10.222.0.75 "GET /compute/v2.1/servers/657f7e4e-0bc0-4594-8210-767d8e63dfec" status: 200 len: 1266 microversion: 2.1 time: 0.167324 May 26 12:51:26.762442 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: [pid: 129322|app: 0|req: 563/1106] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 26 12:51:26 2022] GET /compute/v2.1/servers/657f7e4e-0bc0-4594-8210-767d8e63dfec => generated 1266 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:51:27.779824 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi [None req-48bbd9d2-1412-4e81-bf28-673b9740c62d tempest-TestVolumeBootPattern-1304354335 tempest-TestVolumeBootPattern-1304354335-project] Calling method '>' {{(pid=129321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:51:27.780368 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.compute.api [None req-48bbd9d2-1412-4e81-bf28-673b9740c62d tempest-TestVolumeBootPattern-1304354335 tempest-TestVolumeBootPattern-1304354335-project] [instance: 657f7e4e-0bc0-4594-8210-767d8e63dfec] Fetching instance by UUID {{(pid=129321) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:51:27.782290 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG dbcounter [-] [129321] Writing DB stats nova_cell0:SELECT=2 {{(pid=129321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:51:27.782934 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG dbcounter [-] [129321] Writing DB stats nova_cell0:SELECT=6 {{(pid=129321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:51:27.790660 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-48bbd9d2-1412-4e81-bf28-673b9740c62d tempest-TestVolumeBootPattern-1304354335 tempest-TestVolumeBootPattern-1304354335-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:51:27.791125 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-48bbd9d2-1412-4e81-bf28-673b9740c62d tempest-TestVolumeBootPattern-1304354335 tempest-TestVolumeBootPattern-1304354335-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:51:27.791928 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-48bbd9d2-1412-4e81-bf28-673b9740c62d tempest-TestVolumeBootPattern-1304354335 tempest-TestVolumeBootPattern-1304354335-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:51:27.792362 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-48bbd9d2-1412-4e81-bf28-673b9740c62d tempest-TestVolumeBootPattern-1304354335 tempest-TestVolumeBootPattern-1304354335-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:51:27.932079 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.policy [None req-48bbd9d2-1412-4e81-bf28-673b9740c62d tempest-TestVolumeBootPattern-1304354335 tempest-TestVolumeBootPattern-1304354335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab469b18ce0444d9884cdddc34ef7247', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fb41c547884511893b768b833f4e90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129321) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:51:27.941363 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: INFO nova.api.openstack.requestlog [None req-48bbd9d2-1412-4e81-bf28-673b9740c62d tempest-TestVolumeBootPattern-1304354335 tempest-TestVolumeBootPattern-1304354335-project] 10.222.0.75 "GET /compute/v2.1/servers/657f7e4e-0bc0-4594-8210-767d8e63dfec" status: 200 len: 1266 microversion: 2.1 time: 0.165533 May 26 12:51:27.941942 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: [pid: 129321|app: 0|req: 544/1107] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 26 12:51:27 2022] GET /compute/v2.1/servers/657f7e4e-0bc0-4594-8210-767d8e63dfec => generated 1266 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:51:28.958679 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi [None req-5159e322-5dfe-4be7-8d79-65b0953c759f tempest-TestVolumeBootPattern-1304354335 tempest-TestVolumeBootPattern-1304354335-project] Calling method '>' {{(pid=129322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:51:28.959284 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.compute.api [None req-5159e322-5dfe-4be7-8d79-65b0953c759f tempest-TestVolumeBootPattern-1304354335 tempest-TestVolumeBootPattern-1304354335-project] [instance: 657f7e4e-0bc0-4594-8210-767d8e63dfec] Fetching instance by UUID {{(pid=129322) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:51:28.966431 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-5159e322-5dfe-4be7-8d79-65b0953c759f tempest-TestVolumeBootPattern-1304354335 tempest-TestVolumeBootPattern-1304354335-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:51:28.966908 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-5159e322-5dfe-4be7-8d79-65b0953c759f tempest-TestVolumeBootPattern-1304354335 tempest-TestVolumeBootPattern-1304354335-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:51:28.967718 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-5159e322-5dfe-4be7-8d79-65b0953c759f tempest-TestVolumeBootPattern-1304354335 tempest-TestVolumeBootPattern-1304354335-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:51:28.968174 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-5159e322-5dfe-4be7-8d79-65b0953c759f tempest-TestVolumeBootPattern-1304354335 tempest-TestVolumeBootPattern-1304354335-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:51:29.101339 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.policy [None req-5159e322-5dfe-4be7-8d79-65b0953c759f tempest-TestVolumeBootPattern-1304354335 tempest-TestVolumeBootPattern-1304354335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab469b18ce0444d9884cdddc34ef7247', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fb41c547884511893b768b833f4e90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129322) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:51:29.109390 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: INFO nova.api.openstack.requestlog [None req-5159e322-5dfe-4be7-8d79-65b0953c759f tempest-TestVolumeBootPattern-1304354335 tempest-TestVolumeBootPattern-1304354335-project] 10.222.0.75 "GET /compute/v2.1/servers/657f7e4e-0bc0-4594-8210-767d8e63dfec" status: 200 len: 1266 microversion: 2.1 time: 0.154881 May 26 12:51:29.109996 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: [pid: 129322|app: 0|req: 564/1108] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 26 12:51:28 2022] GET /compute/v2.1/servers/657f7e4e-0bc0-4594-8210-767d8e63dfec => generated 1266 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:51:30.127093 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi [None req-75e9f74c-73b9-49b4-bf45-9921ae59db83 tempest-TestVolumeBootPattern-1304354335 tempest-TestVolumeBootPattern-1304354335-project] Calling method '>' {{(pid=129321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:51:30.127698 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.compute.api [None req-75e9f74c-73b9-49b4-bf45-9921ae59db83 tempest-TestVolumeBootPattern-1304354335 tempest-TestVolumeBootPattern-1304354335-project] [instance: 657f7e4e-0bc0-4594-8210-767d8e63dfec] Fetching instance by UUID {{(pid=129321) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:51:30.134736 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-75e9f74c-73b9-49b4-bf45-9921ae59db83 tempest-TestVolumeBootPattern-1304354335 tempest-TestVolumeBootPattern-1304354335-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:51:30.135178 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-75e9f74c-73b9-49b4-bf45-9921ae59db83 tempest-TestVolumeBootPattern-1304354335 tempest-TestVolumeBootPattern-1304354335-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:51:30.135973 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-75e9f74c-73b9-49b4-bf45-9921ae59db83 tempest-TestVolumeBootPattern-1304354335 tempest-TestVolumeBootPattern-1304354335-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:51:30.136400 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-75e9f74c-73b9-49b4-bf45-9921ae59db83 tempest-TestVolumeBootPattern-1304354335 tempest-TestVolumeBootPattern-1304354335-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:51:30.277562 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.policy [None req-75e9f74c-73b9-49b4-bf45-9921ae59db83 tempest-TestVolumeBootPattern-1304354335 tempest-TestVolumeBootPattern-1304354335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab469b18ce0444d9884cdddc34ef7247', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fb41c547884511893b768b833f4e90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129321) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:51:30.285226 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: INFO nova.api.openstack.requestlog [None req-75e9f74c-73b9-49b4-bf45-9921ae59db83 tempest-TestVolumeBootPattern-1304354335 tempest-TestVolumeBootPattern-1304354335-project] 10.222.0.75 "GET /compute/v2.1/servers/657f7e4e-0bc0-4594-8210-767d8e63dfec" status: 200 len: 1266 microversion: 2.1 time: 0.162114 May 26 12:51:30.285810 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: [pid: 129321|app: 0|req: 545/1109] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 26 12:51:30 2022] GET /compute/v2.1/servers/657f7e4e-0bc0-4594-8210-767d8e63dfec => generated 1266 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:51:31.307215 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi [None req-7ce38027-68da-4694-b726-16f2ba050128 tempest-TestVolumeBootPattern-1304354335 tempest-TestVolumeBootPattern-1304354335-project] Calling method '>' {{(pid=129322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:51:31.308052 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.compute.api [None req-7ce38027-68da-4694-b726-16f2ba050128 tempest-TestVolumeBootPattern-1304354335 tempest-TestVolumeBootPattern-1304354335-project] [instance: 657f7e4e-0bc0-4594-8210-767d8e63dfec] Fetching instance by UUID {{(pid=129322) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:51:31.318856 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-7ce38027-68da-4694-b726-16f2ba050128 tempest-TestVolumeBootPattern-1304354335 tempest-TestVolumeBootPattern-1304354335-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:51:31.319716 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-7ce38027-68da-4694-b726-16f2ba050128 tempest-TestVolumeBootPattern-1304354335 tempest-TestVolumeBootPattern-1304354335-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:51:31.320781 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-7ce38027-68da-4694-b726-16f2ba050128 tempest-TestVolumeBootPattern-1304354335 tempest-TestVolumeBootPattern-1304354335-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:51:31.321411 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-7ce38027-68da-4694-b726-16f2ba050128 tempest-TestVolumeBootPattern-1304354335 tempest-TestVolumeBootPattern-1304354335-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:51:31.483234 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.policy [None req-7ce38027-68da-4694-b726-16f2ba050128 tempest-TestVolumeBootPattern-1304354335 tempest-TestVolumeBootPattern-1304354335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab469b18ce0444d9884cdddc34ef7247', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fb41c547884511893b768b833f4e90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129322) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:51:31.495412 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: INFO nova.api.openstack.requestlog [None req-7ce38027-68da-4694-b726-16f2ba050128 tempest-TestVolumeBootPattern-1304354335 tempest-TestVolumeBootPattern-1304354335-project] 10.222.0.75 "GET /compute/v2.1/servers/657f7e4e-0bc0-4594-8210-767d8e63dfec" status: 200 len: 1266 microversion: 2.1 time: 0.194900 May 26 12:51:31.496423 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: [pid: 129322|app: 0|req: 565/1110] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 26 12:51:31 2022] GET /compute/v2.1/servers/657f7e4e-0bc0-4594-8210-767d8e63dfec => generated 1266 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:51:32.301969 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi [req-68d22d6a-46a1-4848-8bfe-92c4e0d570a2 req-70a5eb9b-9351-4337-a641-9bb4504f4042 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "657f7e4e-0bc0-4594-8210-767d8e63dfec", "name": "network-vif-plugged", "status": "completed", "tag": "c9abc1b1-291f-4a53-ba39-f482d780eca0"}]} {{(pid=129321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 12:51:32.312339 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [req-68d22d6a-46a1-4848-8bfe-92c4e0d570a2 req-70a5eb9b-9351-4337-a641-9bb4504f4042 service nova] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:51:32.312785 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [req-68d22d6a-46a1-4848-8bfe-92c4e0d570a2 req-70a5eb9b-9351-4337-a641-9bb4504f4042 service nova] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:51:32.324937 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: INFO nova.api.openstack.compute.server_external_events [req-68d22d6a-46a1-4848-8bfe-92c4e0d570a2 req-70a5eb9b-9351-4337-a641-9bb4504f4042 service nova] Creating event network-vif-plugged:c9abc1b1-291f-4a53-ba39-f482d780eca0 for instance 657f7e4e-0bc0-4594-8210-767d8e63dfec on hv-cinder-81966 May 26 12:51:32.330006 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: INFO nova.api.openstack.requestlog [req-68d22d6a-46a1-4848-8bfe-92c4e0d570a2 req-70a5eb9b-9351-4337-a641-9bb4504f4042 service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031853 May 26 12:51:32.330686 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: [pid: 129321|app: 0|req: 546/1111] 10.222.0.75 () {64 vars in 1317 bytes} [Thu May 26 12:51:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 12:51:32.516974 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi [None req-4d9b44a7-0628-4410-b057-4babc3ba5b8f tempest-TestVolumeBootPattern-1304354335 tempest-TestVolumeBootPattern-1304354335-project] Calling method '>' {{(pid=129322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:51:32.518130 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.compute.api [None req-4d9b44a7-0628-4410-b057-4babc3ba5b8f tempest-TestVolumeBootPattern-1304354335 tempest-TestVolumeBootPattern-1304354335-project] [instance: 657f7e4e-0bc0-4594-8210-767d8e63dfec] Fetching instance by UUID {{(pid=129322) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:51:32.525200 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-4d9b44a7-0628-4410-b057-4babc3ba5b8f tempest-TestVolumeBootPattern-1304354335 tempest-TestVolumeBootPattern-1304354335-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:51:32.525678 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-4d9b44a7-0628-4410-b057-4babc3ba5b8f tempest-TestVolumeBootPattern-1304354335 tempest-TestVolumeBootPattern-1304354335-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:51:32.526429 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-4d9b44a7-0628-4410-b057-4babc3ba5b8f tempest-TestVolumeBootPattern-1304354335 tempest-TestVolumeBootPattern-1304354335-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:51:32.526919 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-4d9b44a7-0628-4410-b057-4babc3ba5b8f tempest-TestVolumeBootPattern-1304354335 tempest-TestVolumeBootPattern-1304354335-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:51:32.658763 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.policy [None req-4d9b44a7-0628-4410-b057-4babc3ba5b8f tempest-TestVolumeBootPattern-1304354335 tempest-TestVolumeBootPattern-1304354335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab469b18ce0444d9884cdddc34ef7247', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fb41c547884511893b768b833f4e90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129322) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:51:32.666767 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: INFO nova.api.openstack.requestlog [None req-4d9b44a7-0628-4410-b057-4babc3ba5b8f tempest-TestVolumeBootPattern-1304354335 tempest-TestVolumeBootPattern-1304354335-project] 10.222.0.75 "GET /compute/v2.1/servers/657f7e4e-0bc0-4594-8210-767d8e63dfec" status: 200 len: 1266 microversion: 2.1 time: 0.153832 May 26 12:51:32.667363 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: [pid: 129322|app: 0|req: 566/1112] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 26 12:51:32 2022] GET /compute/v2.1/servers/657f7e4e-0bc0-4594-8210-767d8e63dfec => generated 1266 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:51:33.689884 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi [None req-18f586a6-d5fc-4577-a8b3-ae5b5ffd6d97 tempest-TestVolumeBootPattern-1304354335 tempest-TestVolumeBootPattern-1304354335-project] Calling method '>' {{(pid=129321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:51:33.690986 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.compute.api [None req-18f586a6-d5fc-4577-a8b3-ae5b5ffd6d97 tempest-TestVolumeBootPattern-1304354335 tempest-TestVolumeBootPattern-1304354335-project] [instance: 657f7e4e-0bc0-4594-8210-767d8e63dfec] Fetching instance by UUID {{(pid=129321) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:51:33.701253 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-18f586a6-d5fc-4577-a8b3-ae5b5ffd6d97 tempest-TestVolumeBootPattern-1304354335 tempest-TestVolumeBootPattern-1304354335-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:51:33.701702 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-18f586a6-d5fc-4577-a8b3-ae5b5ffd6d97 tempest-TestVolumeBootPattern-1304354335 tempest-TestVolumeBootPattern-1304354335-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:51:33.702465 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-18f586a6-d5fc-4577-a8b3-ae5b5ffd6d97 tempest-TestVolumeBootPattern-1304354335 tempest-TestVolumeBootPattern-1304354335-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:51:33.702899 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-18f586a6-d5fc-4577-a8b3-ae5b5ffd6d97 tempest-TestVolumeBootPattern-1304354335 tempest-TestVolumeBootPattern-1304354335-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:51:33.850269 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.policy [None req-18f586a6-d5fc-4577-a8b3-ae5b5ffd6d97 tempest-TestVolumeBootPattern-1304354335 tempest-TestVolumeBootPattern-1304354335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab469b18ce0444d9884cdddc34ef7247', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fb41c547884511893b768b833f4e90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129321) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:51:33.860701 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: INFO nova.api.openstack.requestlog [None req-18f586a6-d5fc-4577-a8b3-ae5b5ffd6d97 tempest-TestVolumeBootPattern-1304354335 tempest-TestVolumeBootPattern-1304354335-project] 10.222.0.75 "GET /compute/v2.1/servers/657f7e4e-0bc0-4594-8210-767d8e63dfec" status: 200 len: 1266 microversion: 2.1 time: 0.179383 May 26 12:51:33.861280 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: [pid: 129321|app: 0|req: 547/1113] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 26 12:51:33 2022] GET /compute/v2.1/servers/657f7e4e-0bc0-4594-8210-767d8e63dfec => generated 1266 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:51:34.880522 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi [None req-db3b5c2b-20fa-491f-9d70-14907ed2628e tempest-TestVolumeBootPattern-1304354335 tempest-TestVolumeBootPattern-1304354335-project] Calling method '>' {{(pid=129322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:51:34.881501 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.compute.api [None req-db3b5c2b-20fa-491f-9d70-14907ed2628e tempest-TestVolumeBootPattern-1304354335 tempest-TestVolumeBootPattern-1304354335-project] [instance: 657f7e4e-0bc0-4594-8210-767d8e63dfec] Fetching instance by UUID {{(pid=129322) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:51:34.892301 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-db3b5c2b-20fa-491f-9d70-14907ed2628e tempest-TestVolumeBootPattern-1304354335 tempest-TestVolumeBootPattern-1304354335-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:51:34.893406 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-db3b5c2b-20fa-491f-9d70-14907ed2628e tempest-TestVolumeBootPattern-1304354335 tempest-TestVolumeBootPattern-1304354335-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:51:34.894614 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-db3b5c2b-20fa-491f-9d70-14907ed2628e tempest-TestVolumeBootPattern-1304354335 tempest-TestVolumeBootPattern-1304354335-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:51:34.895306 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-db3b5c2b-20fa-491f-9d70-14907ed2628e tempest-TestVolumeBootPattern-1304354335 tempest-TestVolumeBootPattern-1304354335-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:51:35.034029 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.policy [None req-db3b5c2b-20fa-491f-9d70-14907ed2628e tempest-TestVolumeBootPattern-1304354335 tempest-TestVolumeBootPattern-1304354335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab469b18ce0444d9884cdddc34ef7247', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fb41c547884511893b768b833f4e90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129322) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:51:35.045667 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: INFO nova.api.openstack.requestlog [None req-db3b5c2b-20fa-491f-9d70-14907ed2628e tempest-TestVolumeBootPattern-1304354335 tempest-TestVolumeBootPattern-1304354335-project] 10.222.0.75 "GET /compute/v2.1/servers/657f7e4e-0bc0-4594-8210-767d8e63dfec" status: 200 len: 1453 microversion: 2.1 time: 0.171079 May 26 12:51:35.046296 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: [pid: 129322|app: 0|req: 567/1114] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 26 12:51:34 2022] GET /compute/v2.1/servers/657f7e4e-0bc0-4594-8210-767d8e63dfec => generated 1453 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:51:35.066517 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi [None req-943b8a60-2a33-4ba7-aede-32ca00d82a22 tempest-TestVolumeBootPattern-1304354335 tempest-TestVolumeBootPattern-1304354335-project] Calling method '>' {{(pid=129321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:51:35.067127 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.compute.api [None req-943b8a60-2a33-4ba7-aede-32ca00d82a22 tempest-TestVolumeBootPattern-1304354335 tempest-TestVolumeBootPattern-1304354335-project] [instance: 657f7e4e-0bc0-4594-8210-767d8e63dfec] Fetching instance by UUID {{(pid=129321) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:51:35.073881 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-943b8a60-2a33-4ba7-aede-32ca00d82a22 tempest-TestVolumeBootPattern-1304354335 tempest-TestVolumeBootPattern-1304354335-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:51:35.074329 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-943b8a60-2a33-4ba7-aede-32ca00d82a22 tempest-TestVolumeBootPattern-1304354335 tempest-TestVolumeBootPattern-1304354335-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:51:35.075119 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-943b8a60-2a33-4ba7-aede-32ca00d82a22 tempest-TestVolumeBootPattern-1304354335 tempest-TestVolumeBootPattern-1304354335-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:51:35.075630 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-943b8a60-2a33-4ba7-aede-32ca00d82a22 tempest-TestVolumeBootPattern-1304354335 tempest-TestVolumeBootPattern-1304354335-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:51:35.208084 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.policy [None req-943b8a60-2a33-4ba7-aede-32ca00d82a22 tempest-TestVolumeBootPattern-1304354335 tempest-TestVolumeBootPattern-1304354335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab469b18ce0444d9884cdddc34ef7247', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fb41c547884511893b768b833f4e90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129321) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:51:35.215734 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: INFO nova.api.openstack.requestlog [None req-943b8a60-2a33-4ba7-aede-32ca00d82a22 tempest-TestVolumeBootPattern-1304354335 tempest-TestVolumeBootPattern-1304354335-project] 10.222.0.75 "GET /compute/v2.1/servers/657f7e4e-0bc0-4594-8210-767d8e63dfec" status: 200 len: 1453 microversion: 2.1 time: 0.153033 May 26 12:51:35.216295 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: [pid: 129321|app: 0|req: 548/1115] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 26 12:51:35 2022] GET /compute/v2.1/servers/657f7e4e-0bc0-4594-8210-767d8e63dfec => generated 1453 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:51:37.359944 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi [req-45a4a607-41ac-46bb-9a99-312530184f20 req-f30f7a78-0df3-484e-9f5f-b745adfe7a30 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "657f7e4e-0bc0-4594-8210-767d8e63dfec", "tag": "c9abc1b1-291f-4a53-ba39-f482d780eca0"}]} {{(pid=129322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 12:51:37.368323 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [req-45a4a607-41ac-46bb-9a99-312530184f20 req-f30f7a78-0df3-484e-9f5f-b745adfe7a30 service nova] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:51:37.368688 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [req-45a4a607-41ac-46bb-9a99-312530184f20 req-f30f7a78-0df3-484e-9f5f-b745adfe7a30 service nova] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:51:37.380237 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: INFO nova.api.openstack.compute.server_external_events [req-45a4a607-41ac-46bb-9a99-312530184f20 req-f30f7a78-0df3-484e-9f5f-b745adfe7a30 service nova] Creating event network-changed:c9abc1b1-291f-4a53-ba39-f482d780eca0 for instance 657f7e4e-0bc0-4594-8210-767d8e63dfec on hv-cinder-81966 May 26 12:51:37.385547 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: INFO nova.api.openstack.requestlog [req-45a4a607-41ac-46bb-9a99-312530184f20 req-f30f7a78-0df3-484e-9f5f-b745adfe7a30 service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.086129 May 26 12:51:37.386160 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: [pid: 129322|app: 0|req: 568/1116] 10.222.0.75 () {64 vars in 1317 bytes} [Thu May 26 12:51:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 12:51:37.599351 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi [None req-ec7d9746-23e8-47b2-88fd-6a94c64fbc5d tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] Calling method '>' {{(pid=129321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:51:37.600259 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.compute.api [None req-ec7d9746-23e8-47b2-88fd-6a94c64fbc5d tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] [instance: 88867ead-523a-4d55-9311-bdddd200c270] Fetching instance by UUID {{(pid=129321) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:51:37.607189 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-ec7d9746-23e8-47b2-88fd-6a94c64fbc5d tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:51:37.607680 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-ec7d9746-23e8-47b2-88fd-6a94c64fbc5d tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:51:37.608551 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-ec7d9746-23e8-47b2-88fd-6a94c64fbc5d tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:51:37.608990 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-ec7d9746-23e8-47b2-88fd-6a94c64fbc5d tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:51:37.635173 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: INFO nova.api.openstack.requestlog [None req-ec7d9746-23e8-47b2-88fd-6a94c64fbc5d tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] 10.222.0.75 "GET /compute/v2.1/servers/88867ead-523a-4d55-9311-bdddd200c270/ips" status: 200 len: 150 microversion: 2.1 time: 0.039799 May 26 12:51:37.635768 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: [pid: 129321|app: 0|req: 549/1117] 10.222.0.75 () {58 vars in 1247 bytes} [Thu May 26 12:51:37 2022] GET /compute/v2.1/servers/88867ead-523a-4d55-9311-bdddd200c270/ips => generated 150 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 12:51:39.036170 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi [None req-14c484b8-e819-4eee-8539-57a70ab9bf53 tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "1f106872-e01b-46c9-87ce-b31b047c3e22"}} {{(pid=129322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 12:51:39.037367 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.compute.api [None req-14c484b8-e819-4eee-8539-57a70ab9bf53 tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] [instance: 88867ead-523a-4d55-9311-bdddd200c270] Fetching instance by UUID {{(pid=129322) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:51:39.044860 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-14c484b8-e819-4eee-8539-57a70ab9bf53 tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:51:39.045229 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-14c484b8-e819-4eee-8539-57a70ab9bf53 tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:51:39.045982 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-14c484b8-e819-4eee-8539-57a70ab9bf53 tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:51:39.046417 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-14c484b8-e819-4eee-8539-57a70ab9bf53 tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:51:39.358117 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: INFO nova.api.openstack.requestlog [None req-14c484b8-e819-4eee-8539-57a70ab9bf53 tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] 10.222.0.75 "POST /compute/v2.1/servers/88867ead-523a-4d55-9311-bdddd200c270/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.326228 May 26 12:51:39.358783 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: [pid: 129322|app: 0|req: 569/1118] 10.222.0.75 () {60 vars in 1322 bytes} [Thu May 26 12:51:39 2022] POST /compute/v2.1/servers/88867ead-523a-4d55-9311-bdddd200c270/os-volume_attachments => generated 194 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 12:51:46.895382 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi [None req-234b1541-c036-4436-8dcd-476b6c987f21 tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] Action: 'create', calling method: .version_select at 0x7f830815d5e0>, body: {"keypair": {"name": "tempest-keypair-380112310", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDPNr2x3D/gzu0ZxSYqM5a0wRPeQo/W3uigwHXNMjbSvdBNrjl+hQWITS9MxnOFt2JQvg4yQ41w1mTBQkRT/KkArqIHYiKNLzhAUm+ZINr/LuO+U+O5zvXaDDfD6ZXlsig=="}} {{(pid=129321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 12:51:46.902722 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG dbcounter [-] [129321] Writing DB stats nova_api:SELECT=38,nova_api:INSERT=3 {{(pid=129321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:51:46.920787 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.quota [None req-234b1541-c036-4436-8dcd-476b6c987f21 tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] Getting quotas for project 93d5b6bba38643bfb76f083e230b3d22. Resources: {'key_pairs'} {{(pid=129321) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 26 12:51:46.927103 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.quota [None req-234b1541-c036-4436-8dcd-476b6c987f21 tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] Getting quotas for user eddc5d9ac2a74507bca19e06f0051ae1 and project 93d5b6bba38643bfb76f083e230b3d22. Resources: {'key_pairs'} {{(pid=129321) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 26 12:51:46.959975 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: INFO nova.api.openstack.requestlog [None req-234b1541-c036-4436-8dcd-476b6c987f21 tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] 10.222.0.75 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.070935 May 26 12:51:46.960741 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: [pid: 129321|app: 0|req: 550/1119] 10.222.0.75 () {60 vars in 1158 bytes} [Thu May 26 12:51:46 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 12:51:48.534401 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi [None req-997a3f1a-ff2b-4c5d-a041-18f2440fe10b tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-68389783", "imageRef": "1e3c323d-d797-4e6d-bd9a-482d90084b0c", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "0b8803cb-8e70-473c-b131-a8a5b912880c"}], "security_groups": [{"name": "tempest-securitygroup--132012470"}], "key_name": "tempest-keypair-380112310", "user_data": "}} {{(pid=129322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 12:51:48.541010 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG dbcounter [-] [129322] Writing DB stats nova_api:SELECT=27 {{(pid=129322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:51:48.654220 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.network.neutron [None req-997a3f1a-ff2b-4c5d-a041-18f2440fe10b tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] validate_networks() for [('0b8803cb-8e70-473c-b131-a8a5b912880c', None, None, None, None, None)] {{(pid=129322) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 26 12:51:49.064283 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.virt.hardware [None req-997a3f1a-ff2b-4c5d-a041-18f2440fe10b tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] Flavor limits 0:0:0 {{(pid=129322) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 26 12:51:49.064917 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.virt.hardware [None req-997a3f1a-ff2b-4c5d-a041-18f2440fe10b tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] Image limits 0:0:0 {{(pid=129322) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 26 12:51:49.065388 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.virt.hardware [None req-997a3f1a-ff2b-4c5d-a041-18f2440fe10b tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] Flavor pref 0:0:0 {{(pid=129322) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 26 12:51:49.065816 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.virt.hardware [None req-997a3f1a-ff2b-4c5d-a041-18f2440fe10b tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] Image pref 0:0:0 {{(pid=129322) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 26 12:51:49.066241 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.virt.hardware [None req-997a3f1a-ff2b-4c5d-a041-18f2440fe10b tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129322) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 26 12:51:49.075207 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-997a3f1a-ff2b-4c5d-a041-18f2440fe10b tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:51:49.075678 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-997a3f1a-ff2b-4c5d-a041-18f2440fe10b tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:51:49.076459 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-997a3f1a-ff2b-4c5d-a041-18f2440fe10b tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:51:49.076889 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-997a3f1a-ff2b-4c5d-a041-18f2440fe10b tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:51:49.082531 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG dbcounter [-] [129322] Writing DB stats nova_cell1:SELECT=68,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=129322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:51:49.096368 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.quota [None req-997a3f1a-ff2b-4c5d-a041-18f2440fe10b tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] Getting quotas for project 93d5b6bba38643bfb76f083e230b3d22. Resources: {'instances', 'cores', 'ram'} {{(pid=129322) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 26 12:51:49.100442 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.quota [None req-997a3f1a-ff2b-4c5d-a041-18f2440fe10b tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] Getting quotas for user eddc5d9ac2a74507bca19e06f0051ae1 and project 93d5b6bba38643bfb76f083e230b3d22. Resources: {'instances', 'cores', 'ram'} {{(pid=129322) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 26 12:51:49.111812 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.compute.api [None req-997a3f1a-ff2b-4c5d-a041-18f2440fe10b tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] Going to run 1 instances... {{(pid=129322) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 26 12:51:49.114178 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.compute.api [None req-997a3f1a-ff2b-4c5d-a041-18f2440fe10b tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] [instance: 12795e31-07da-4c2a-8945-2c4b820f1bbf] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1e3c323d-d797-4e6d-bd9a-482d90084b0c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129322) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 26 12:51:49.163334 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: INFO nova.api.openstack.requestlog [None req-997a3f1a-ff2b-4c5d-a041-18f2440fe10b tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] 10.222.0.75 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.634164 May 26 12:51:49.164016 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: [pid: 129322|app: 0|req: 570/1120] 10.222.0.75 () {60 vars in 1146 bytes} [Thu May 26 12:51:48 2022] POST /compute/v2.1/servers => generated 401 bytes in 636 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 26 12:51:49.171847 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG dbcounter [-] [129321] Writing DB stats nova_cell1:SELECT=58 {{(pid=129321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:51:49.177620 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi [None req-e9de67ad-db27-4986-8276-a55480a23fdd tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] Calling method '>' {{(pid=129321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:51:49.178054 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.compute.api [None req-e9de67ad-db27-4986-8276-a55480a23fdd tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] [instance: 12795e31-07da-4c2a-8945-2c4b820f1bbf] Fetching instance by UUID {{(pid=129321) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:51:49.233159 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.policy [None req-e9de67ad-db27-4986-8276-a55480a23fdd tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eddc5d9ac2a74507bca19e06f0051ae1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93d5b6bba38643bfb76f083e230b3d22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129321) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:51:49.241587 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: INFO nova.api.openstack.requestlog [None req-e9de67ad-db27-4986-8276-a55480a23fdd tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] 10.222.0.75 "GET /compute/v2.1/servers/12795e31-07da-4c2a-8945-2c4b820f1bbf" status: 200 len: 1239 microversion: 2.1 time: 0.070510 May 26 12:51:49.242575 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: [pid: 129321|app: 0|req: 551/1121] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 26 12:51:49 2022] GET /compute/v2.1/servers/12795e31-07da-4c2a-8945-2c4b820f1bbf => generated 1239 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:51:50.259527 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi [None req-4b1f718b-7d55-405a-ae4d-4b2aab059eb5 tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] Calling method '>' {{(pid=129322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:51:50.260201 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.compute.api [None req-4b1f718b-7d55-405a-ae4d-4b2aab059eb5 tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] [instance: 12795e31-07da-4c2a-8945-2c4b820f1bbf] Fetching instance by UUID {{(pid=129322) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:51:50.269454 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-4b1f718b-7d55-405a-ae4d-4b2aab059eb5 tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:51:50.269906 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-4b1f718b-7d55-405a-ae4d-4b2aab059eb5 tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:51:50.270690 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-4b1f718b-7d55-405a-ae4d-4b2aab059eb5 tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:51:50.271127 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-4b1f718b-7d55-405a-ae4d-4b2aab059eb5 tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:51:50.334045 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.policy [None req-4b1f718b-7d55-405a-ae4d-4b2aab059eb5 tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eddc5d9ac2a74507bca19e06f0051ae1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93d5b6bba38643bfb76f083e230b3d22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129322) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:51:50.341984 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: INFO nova.api.openstack.requestlog [None req-4b1f718b-7d55-405a-ae4d-4b2aab059eb5 tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] 10.222.0.75 "GET /compute/v2.1/servers/12795e31-07da-4c2a-8945-2c4b820f1bbf" status: 200 len: 1299 microversion: 2.1 time: 0.086409 May 26 12:51:50.342760 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: [pid: 129322|app: 0|req: 571/1122] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 26 12:51:50 2022] GET /compute/v2.1/servers/12795e31-07da-4c2a-8945-2c4b820f1bbf => generated 1299 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:51:51.360194 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi [None req-9b32618f-c4bf-4022-b094-f0f4aa5182e0 tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] Calling method '>' {{(pid=129321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:51:51.360741 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.compute.api [None req-9b32618f-c4bf-4022-b094-f0f4aa5182e0 tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] [instance: 12795e31-07da-4c2a-8945-2c4b820f1bbf] Fetching instance by UUID {{(pid=129321) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:51:51.369287 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-9b32618f-c4bf-4022-b094-f0f4aa5182e0 tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:51:51.369761 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-9b32618f-c4bf-4022-b094-f0f4aa5182e0 tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:51:51.370599 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-9b32618f-c4bf-4022-b094-f0f4aa5182e0 tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:51:51.371043 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-9b32618f-c4bf-4022-b094-f0f4aa5182e0 tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:51:51.597049 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.policy [None req-9b32618f-c4bf-4022-b094-f0f4aa5182e0 tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eddc5d9ac2a74507bca19e06f0051ae1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93d5b6bba38643bfb76f083e230b3d22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129321) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:51:51.605320 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: INFO nova.api.openstack.requestlog [None req-9b32618f-c4bf-4022-b094-f0f4aa5182e0 tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] 10.222.0.75 "GET /compute/v2.1/servers/12795e31-07da-4c2a-8945-2c4b820f1bbf" status: 200 len: 1364 microversion: 2.1 time: 0.249259 May 26 12:51:51.605938 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: [pid: 129321|app: 0|req: 552/1123] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 26 12:51:51 2022] GET /compute/v2.1/servers/12795e31-07da-4c2a-8945-2c4b820f1bbf => generated 1364 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:51:51.978220 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi [req-412a6488-ab42-4be9-bcf3-20365bbfb21f req-f57bf26d-bb75-4b52-a8aa-dc35ca70b3d6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "12795e31-07da-4c2a-8945-2c4b820f1bbf", "tag": "1e49470f-0070-48d9-8c09-380718118150"}]} {{(pid=129322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 12:51:51.993958 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [req-412a6488-ab42-4be9-bcf3-20365bbfb21f req-f57bf26d-bb75-4b52-a8aa-dc35ca70b3d6 service nova] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:51:51.994408 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [req-412a6488-ab42-4be9-bcf3-20365bbfb21f req-f57bf26d-bb75-4b52-a8aa-dc35ca70b3d6 service nova] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:51:52.015434 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: INFO nova.api.openstack.compute.server_external_events [req-412a6488-ab42-4be9-bcf3-20365bbfb21f req-f57bf26d-bb75-4b52-a8aa-dc35ca70b3d6 service nova] Creating event network-changed:1e49470f-0070-48d9-8c09-380718118150 for instance 12795e31-07da-4c2a-8945-2c4b820f1bbf on hv-cinder-81966 May 26 12:51:52.021326 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: INFO nova.api.openstack.requestlog [req-412a6488-ab42-4be9-bcf3-20365bbfb21f req-f57bf26d-bb75-4b52-a8aa-dc35ca70b3d6 service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054047 May 26 12:51:52.021939 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: [pid: 129322|app: 0|req: 572/1124] 10.222.0.75 () {64 vars in 1317 bytes} [Thu May 26 12:51:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 12:51:52.627249 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi [None req-0340ab2d-3e84-4197-b0ec-9c09fcb9630f tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] Calling method '>' {{(pid=129321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:51:52.628531 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.compute.api [None req-0340ab2d-3e84-4197-b0ec-9c09fcb9630f tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] [instance: 12795e31-07da-4c2a-8945-2c4b820f1bbf] Fetching instance by UUID {{(pid=129321) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:51:52.639116 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-0340ab2d-3e84-4197-b0ec-9c09fcb9630f tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:51:52.639963 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-0340ab2d-3e84-4197-b0ec-9c09fcb9630f tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:51:52.641205 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-0340ab2d-3e84-4197-b0ec-9c09fcb9630f tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:51:52.641915 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-0340ab2d-3e84-4197-b0ec-9c09fcb9630f tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:51:52.795936 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.policy [None req-0340ab2d-3e84-4197-b0ec-9c09fcb9630f tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eddc5d9ac2a74507bca19e06f0051ae1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93d5b6bba38643bfb76f083e230b3d22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129321) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:51:52.803908 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: INFO nova.api.openstack.requestlog [None req-0340ab2d-3e84-4197-b0ec-9c09fcb9630f tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] 10.222.0.75 "GET /compute/v2.1/servers/12795e31-07da-4c2a-8945-2c4b820f1bbf" status: 200 len: 1364 microversion: 2.1 time: 0.183309 May 26 12:51:52.804486 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: [pid: 129321|app: 0|req: 553/1125] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 26 12:51:52 2022] GET /compute/v2.1/servers/12795e31-07da-4c2a-8945-2c4b820f1bbf => generated 1364 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:51:53.826201 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi [None req-ffa65c41-316b-42f2-91ba-760b1295a273 tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] Calling method '>' {{(pid=129322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:51:53.826937 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.compute.api [None req-ffa65c41-316b-42f2-91ba-760b1295a273 tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] [instance: 12795e31-07da-4c2a-8945-2c4b820f1bbf] Fetching instance by UUID {{(pid=129322) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:51:53.834218 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-ffa65c41-316b-42f2-91ba-760b1295a273 tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:51:53.834667 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-ffa65c41-316b-42f2-91ba-760b1295a273 tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:51:53.835429 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-ffa65c41-316b-42f2-91ba-760b1295a273 tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:51:53.835867 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-ffa65c41-316b-42f2-91ba-760b1295a273 tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:51:53.980935 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.policy [None req-ffa65c41-316b-42f2-91ba-760b1295a273 tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eddc5d9ac2a74507bca19e06f0051ae1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93d5b6bba38643bfb76f083e230b3d22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129322) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:51:53.990927 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: INFO nova.api.openstack.requestlog [None req-ffa65c41-316b-42f2-91ba-760b1295a273 tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] 10.222.0.75 "GET /compute/v2.1/servers/12795e31-07da-4c2a-8945-2c4b820f1bbf" status: 200 len: 1364 microversion: 2.1 time: 0.169502 May 26 12:51:53.991515 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: [pid: 129322|app: 0|req: 573/1126] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 26 12:51:53 2022] GET /compute/v2.1/servers/12795e31-07da-4c2a-8945-2c4b820f1bbf => generated 1364 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:51:55.008359 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi [None req-4e07f414-62d5-4679-b3ea-632b9dbb3534 tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] Calling method '>' {{(pid=129321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:51:55.008948 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.compute.api [None req-4e07f414-62d5-4679-b3ea-632b9dbb3534 tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] [instance: 12795e31-07da-4c2a-8945-2c4b820f1bbf] Fetching instance by UUID {{(pid=129321) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:51:55.015866 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-4e07f414-62d5-4679-b3ea-632b9dbb3534 tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:51:55.016321 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-4e07f414-62d5-4679-b3ea-632b9dbb3534 tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:51:55.017098 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-4e07f414-62d5-4679-b3ea-632b9dbb3534 tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:51:55.017897 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-4e07f414-62d5-4679-b3ea-632b9dbb3534 tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:51:55.233223 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.policy [None req-4e07f414-62d5-4679-b3ea-632b9dbb3534 tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eddc5d9ac2a74507bca19e06f0051ae1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93d5b6bba38643bfb76f083e230b3d22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129321) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:51:55.243516 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: INFO nova.api.openstack.requestlog [None req-4e07f414-62d5-4679-b3ea-632b9dbb3534 tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] 10.222.0.75 "GET /compute/v2.1/servers/12795e31-07da-4c2a-8945-2c4b820f1bbf" status: 200 len: 1364 microversion: 2.1 time: 0.239079 May 26 12:51:55.244147 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: [pid: 129321|app: 0|req: 554/1127] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 26 12:51:55 2022] GET /compute/v2.1/servers/12795e31-07da-4c2a-8945-2c4b820f1bbf => generated 1364 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:51:56.262776 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi [None req-31623b2b-5fc7-4ea1-b3bb-da19fdc64553 tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] Calling method '>' {{(pid=129322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:51:56.263510 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.compute.api [None req-31623b2b-5fc7-4ea1-b3bb-da19fdc64553 tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] [instance: 12795e31-07da-4c2a-8945-2c4b820f1bbf] Fetching instance by UUID {{(pid=129322) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:51:56.272144 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-31623b2b-5fc7-4ea1-b3bb-da19fdc64553 tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:51:56.273083 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-31623b2b-5fc7-4ea1-b3bb-da19fdc64553 tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:51:56.273353 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-31623b2b-5fc7-4ea1-b3bb-da19fdc64553 tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:51:56.273787 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-31623b2b-5fc7-4ea1-b3bb-da19fdc64553 tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:51:56.408984 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.policy [None req-31623b2b-5fc7-4ea1-b3bb-da19fdc64553 tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eddc5d9ac2a74507bca19e06f0051ae1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93d5b6bba38643bfb76f083e230b3d22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129322) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:51:56.417107 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: INFO nova.api.openstack.requestlog [None req-31623b2b-5fc7-4ea1-b3bb-da19fdc64553 tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] 10.222.0.75 "GET /compute/v2.1/servers/12795e31-07da-4c2a-8945-2c4b820f1bbf" status: 200 len: 1364 microversion: 2.1 time: 0.159244 May 26 12:51:56.417927 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: [pid: 129322|app: 0|req: 574/1128] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 26 12:51:56 2022] GET /compute/v2.1/servers/12795e31-07da-4c2a-8945-2c4b820f1bbf => generated 1364 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:51:57.438083 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi [None req-37b3c08d-6ef4-48fe-bc9c-f4b45a37264a tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] Calling method '>' {{(pid=129321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:51:57.438882 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.compute.api [None req-37b3c08d-6ef4-48fe-bc9c-f4b45a37264a tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] [instance: 12795e31-07da-4c2a-8945-2c4b820f1bbf] Fetching instance by UUID {{(pid=129321) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:51:57.446966 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-37b3c08d-6ef4-48fe-bc9c-f4b45a37264a tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:51:57.447414 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-37b3c08d-6ef4-48fe-bc9c-f4b45a37264a tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:51:57.448206 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-37b3c08d-6ef4-48fe-bc9c-f4b45a37264a tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:51:57.448657 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-37b3c08d-6ef4-48fe-bc9c-f4b45a37264a tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:51:57.578438 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.policy [None req-37b3c08d-6ef4-48fe-bc9c-f4b45a37264a tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eddc5d9ac2a74507bca19e06f0051ae1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93d5b6bba38643bfb76f083e230b3d22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129321) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:51:57.586749 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: INFO nova.api.openstack.requestlog [None req-37b3c08d-6ef4-48fe-bc9c-f4b45a37264a tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] 10.222.0.75 "GET /compute/v2.1/servers/12795e31-07da-4c2a-8945-2c4b820f1bbf" status: 200 len: 1364 microversion: 2.1 time: 0.155483 May 26 12:51:57.587293 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: [pid: 129321|app: 0|req: 555/1129] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 26 12:51:57 2022] GET /compute/v2.1/servers/12795e31-07da-4c2a-8945-2c4b820f1bbf => generated 1364 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:51:58.452970 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi [req-04508393-e5d9-46d1-9a18-8a98c5332c4b req-ecbd318e-6355-4278-8a37-b8b2caf84b0b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "12795e31-07da-4c2a-8945-2c4b820f1bbf", "name": "network-vif-plugged", "status": "completed", "tag": "1e49470f-0070-48d9-8c09-380718118150"}]} {{(pid=129322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 12:51:58.462178 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [req-04508393-e5d9-46d1-9a18-8a98c5332c4b req-ecbd318e-6355-4278-8a37-b8b2caf84b0b service nova] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:51:58.462645 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [req-04508393-e5d9-46d1-9a18-8a98c5332c4b req-ecbd318e-6355-4278-8a37-b8b2caf84b0b service nova] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:51:58.476553 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: INFO nova.api.openstack.compute.server_external_events [req-04508393-e5d9-46d1-9a18-8a98c5332c4b req-ecbd318e-6355-4278-8a37-b8b2caf84b0b service nova] Creating event network-vif-plugged:1e49470f-0070-48d9-8c09-380718118150 for instance 12795e31-07da-4c2a-8945-2c4b820f1bbf on hv-cinder-81966 May 26 12:51:58.481892 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: INFO nova.api.openstack.requestlog [req-04508393-e5d9-46d1-9a18-8a98c5332c4b req-ecbd318e-6355-4278-8a37-b8b2caf84b0b service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033087 May 26 12:51:58.482735 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: [pid: 129322|app: 0|req: 575/1130] 10.222.0.75 () {64 vars in 1317 bytes} [Thu May 26 12:51:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 12:51:58.604407 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi [None req-a3062542-d7f1-4a42-92b4-9a6287d56439 tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] Calling method '>' {{(pid=129321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:51:58.604979 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.compute.api [None req-a3062542-d7f1-4a42-92b4-9a6287d56439 tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] [instance: 12795e31-07da-4c2a-8945-2c4b820f1bbf] Fetching instance by UUID {{(pid=129321) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:51:58.611528 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-a3062542-d7f1-4a42-92b4-9a6287d56439 tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:51:58.612001 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-a3062542-d7f1-4a42-92b4-9a6287d56439 tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:51:58.612763 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-a3062542-d7f1-4a42-92b4-9a6287d56439 tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:51:58.613300 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-a3062542-d7f1-4a42-92b4-9a6287d56439 tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:51:58.825347 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.policy [None req-a3062542-d7f1-4a42-92b4-9a6287d56439 tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eddc5d9ac2a74507bca19e06f0051ae1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93d5b6bba38643bfb76f083e230b3d22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129321) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:51:58.833285 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: INFO nova.api.openstack.requestlog [None req-a3062542-d7f1-4a42-92b4-9a6287d56439 tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] 10.222.0.75 "GET /compute/v2.1/servers/12795e31-07da-4c2a-8945-2c4b820f1bbf" status: 200 len: 1364 microversion: 2.1 time: 0.232975 May 26 12:51:58.833854 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: [pid: 129321|app: 0|req: 556/1131] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 26 12:51:58 2022] GET /compute/v2.1/servers/12795e31-07da-4c2a-8945-2c4b820f1bbf => generated 1364 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:51:59.853952 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi [None req-bbaa317d-2cb8-4cbe-beb8-cc68bde582d7 tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] Calling method '>' {{(pid=129322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:51:59.854939 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.compute.api [None req-bbaa317d-2cb8-4cbe-beb8-cc68bde582d7 tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] [instance: 12795e31-07da-4c2a-8945-2c4b820f1bbf] Fetching instance by UUID {{(pid=129322) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:51:59.857718 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG dbcounter [-] [129322] Writing DB stats nova_cell0:SELECT=2 {{(pid=129322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:51:59.858693 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG dbcounter [-] [129322] Writing DB stats nova_cell0:SELECT=6 {{(pid=129322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:51:59.867174 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-bbaa317d-2cb8-4cbe-beb8-cc68bde582d7 tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:51:59.867655 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-bbaa317d-2cb8-4cbe-beb8-cc68bde582d7 tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:51:59.868413 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-bbaa317d-2cb8-4cbe-beb8-cc68bde582d7 tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:51:59.868860 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-bbaa317d-2cb8-4cbe-beb8-cc68bde582d7 tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:52:00.017555 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.policy [None req-bbaa317d-2cb8-4cbe-beb8-cc68bde582d7 tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eddc5d9ac2a74507bca19e06f0051ae1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93d5b6bba38643bfb76f083e230b3d22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129322) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:52:00.025834 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: INFO nova.api.openstack.requestlog [None req-bbaa317d-2cb8-4cbe-beb8-cc68bde582d7 tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] 10.222.0.75 "GET /compute/v2.1/servers/12795e31-07da-4c2a-8945-2c4b820f1bbf" status: 200 len: 1364 microversion: 2.1 time: 0.178151 May 26 12:52:00.026411 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: [pid: 129322|app: 0|req: 576/1132] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 26 12:51:59 2022] GET /compute/v2.1/servers/12795e31-07da-4c2a-8945-2c4b820f1bbf => generated 1364 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:52:01.047080 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi [None req-ebb46096-1bcd-46c9-8cf6-aee0cf0011ac tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] Calling method '>' {{(pid=129321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:52:01.048003 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.compute.api [None req-ebb46096-1bcd-46c9-8cf6-aee0cf0011ac tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] [instance: 12795e31-07da-4c2a-8945-2c4b820f1bbf] Fetching instance by UUID {{(pid=129321) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:52:01.050796 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG dbcounter [-] [129321] Writing DB stats nova_cell0:SELECT=6 {{(pid=129321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:52:01.058974 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-ebb46096-1bcd-46c9-8cf6-aee0cf0011ac tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:52:01.059620 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-ebb46096-1bcd-46c9-8cf6-aee0cf0011ac tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:52:01.060877 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-ebb46096-1bcd-46c9-8cf6-aee0cf0011ac tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:52:01.061515 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-ebb46096-1bcd-46c9-8cf6-aee0cf0011ac tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:52:01.132300 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi [None req-f1ead89f-1bdd-49d0-8293-5fa05ec6de2b tempest-AttachVolumeTestJSON-1454716698 tempest-AttachVolumeTestJSON-1454716698-project] Calling method '>' {{(pid=129322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:52:01.133247 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.compute.api [None req-f1ead89f-1bdd-49d0-8293-5fa05ec6de2b tempest-AttachVolumeTestJSON-1454716698 tempest-AttachVolumeTestJSON-1454716698-project] [instance: 51b4bd5b-19a0-4b50-804d-aff4216e854c] Fetching instance by UUID {{(pid=129322) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:52:01.139969 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-f1ead89f-1bdd-49d0-8293-5fa05ec6de2b tempest-AttachVolumeTestJSON-1454716698 tempest-AttachVolumeTestJSON-1454716698-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:52:01.140438 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-f1ead89f-1bdd-49d0-8293-5fa05ec6de2b tempest-AttachVolumeTestJSON-1454716698 tempest-AttachVolumeTestJSON-1454716698-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:52:01.141212 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-f1ead89f-1bdd-49d0-8293-5fa05ec6de2b tempest-AttachVolumeTestJSON-1454716698 tempest-AttachVolumeTestJSON-1454716698-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:52:01.141630 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-f1ead89f-1bdd-49d0-8293-5fa05ec6de2b tempest-AttachVolumeTestJSON-1454716698 tempest-AttachVolumeTestJSON-1454716698-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:52:01.172101 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: INFO nova.api.openstack.requestlog [None req-f1ead89f-1bdd-49d0-8293-5fa05ec6de2b tempest-AttachVolumeTestJSON-1454716698 tempest-AttachVolumeTestJSON-1454716698-project] 10.222.0.75 "GET /compute/v2.1/servers/51b4bd5b-19a0-4b50-804d-aff4216e854c/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.043838 May 26 12:52:01.172789 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: [pid: 129322|app: 0|req: 577/1133] 10.222.0.75 () {58 vars in 1301 bytes} [Thu May 26 12:52:01 2022] GET /compute/v2.1/servers/51b4bd5b-19a0-4b50-804d-aff4216e854c/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) May 26 12:52:01.198710 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.policy [None req-ebb46096-1bcd-46c9-8cf6-aee0cf0011ac tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eddc5d9ac2a74507bca19e06f0051ae1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93d5b6bba38643bfb76f083e230b3d22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129321) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:52:01.206517 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: INFO nova.api.openstack.requestlog [None req-ebb46096-1bcd-46c9-8cf6-aee0cf0011ac tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] 10.222.0.75 "GET /compute/v2.1/servers/12795e31-07da-4c2a-8945-2c4b820f1bbf" status: 200 len: 1554 microversion: 2.1 time: 0.166070 May 26 12:52:01.207090 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: [pid: 129321|app: 0|req: 557/1134] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 26 12:52:01 2022] GET /compute/v2.1/servers/12795e31-07da-4c2a-8945-2c4b820f1bbf => generated 1554 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:52:01.223192 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi [None req-a9044ad0-928e-4d75-b248-5b57fbbf89f4 tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] Calling method '>' {{(pid=129322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:52:01.223735 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.compute.api [None req-a9044ad0-928e-4d75-b248-5b57fbbf89f4 tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] [instance: 12795e31-07da-4c2a-8945-2c4b820f1bbf] Fetching instance by UUID {{(pid=129322) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:52:01.230019 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-a9044ad0-928e-4d75-b248-5b57fbbf89f4 tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:52:01.230465 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-a9044ad0-928e-4d75-b248-5b57fbbf89f4 tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:52:01.231223 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-a9044ad0-928e-4d75-b248-5b57fbbf89f4 tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:52:01.231660 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi [None req-2675c0d4-cd34-4ccc-ade8-63fd7b3aa711 tempest-AttachVolumeTestJSON-1454716698 tempest-AttachVolumeTestJSON-1454716698-project] Calling method '>' {{(pid=129321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:52:01.231808 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-a9044ad0-928e-4d75-b248-5b57fbbf89f4 tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:52:01.232161 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.compute.api [None req-2675c0d4-cd34-4ccc-ade8-63fd7b3aa711 tempest-AttachVolumeTestJSON-1454716698 tempest-AttachVolumeTestJSON-1454716698-project] [instance: 51b4bd5b-19a0-4b50-804d-aff4216e854c] Fetching instance by UUID {{(pid=129321) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:52:01.238977 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-2675c0d4-cd34-4ccc-ade8-63fd7b3aa711 tempest-AttachVolumeTestJSON-1454716698 tempest-AttachVolumeTestJSON-1454716698-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:52:01.239424 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-2675c0d4-cd34-4ccc-ade8-63fd7b3aa711 tempest-AttachVolumeTestJSON-1454716698 tempest-AttachVolumeTestJSON-1454716698-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:52:01.240213 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-2675c0d4-cd34-4ccc-ade8-63fd7b3aa711 tempest-AttachVolumeTestJSON-1454716698 tempest-AttachVolumeTestJSON-1454716698-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:52:01.240691 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-2675c0d4-cd34-4ccc-ade8-63fd7b3aa711 tempest-AttachVolumeTestJSON-1454716698 tempest-AttachVolumeTestJSON-1454716698-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:52:01.271103 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.compute.api [None req-2675c0d4-cd34-4ccc-ade8-63fd7b3aa711 tempest-AttachVolumeTestJSON-1454716698 tempest-AttachVolumeTestJSON-1454716698-project] [instance: 51b4bd5b-19a0-4b50-804d-aff4216e854c] Going to try to terminate instance {{(pid=129321) delete /opt/stack/nova/nova/compute/api.py:2664}} May 26 12:52:01.312929 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: INFO nova.api.openstack.requestlog [None req-a9044ad0-928e-4d75-b248-5b57fbbf89f4 tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] 10.222.0.75 "GET /compute/v2.1/servers/12795e31-07da-4c2a-8945-2c4b820f1bbf/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.093722 May 26 12:52:01.313548 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: [pid: 129322|app: 0|req: 578/1135] 10.222.0.75 () {58 vars in 1274 bytes} [Thu May 26 12:52:01 2022] GET /compute/v2.1/servers/12795e31-07da-4c2a-8945-2c4b820f1bbf/os-interface => generated 284 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 12:52:01.352516 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: INFO nova.api.openstack.requestlog [None req-2675c0d4-cd34-4ccc-ade8-63fd7b3aa711 tempest-AttachVolumeTestJSON-1454716698 tempest-AttachVolumeTestJSON-1454716698-project] 10.222.0.75 "DELETE /compute/v2.1/servers/51b4bd5b-19a0-4b50-804d-aff4216e854c" status: 204 len: 0 microversion: 2.1 time: 0.124395 May 26 12:52:01.353456 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: [pid: 129321|app: 0|req: 558/1136] 10.222.0.75 () {58 vars in 1238 bytes} [Thu May 26 12:52:01 2022] DELETE /compute/v2.1/servers/51b4bd5b-19a0-4b50-804d-aff4216e854c => generated 0 bytes in 126 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) May 26 12:52:01.361726 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi [None req-d2970705-3547-49ec-ada8-01c3b9c7b35d tempest-AttachVolumeTestJSON-1454716698 tempest-AttachVolumeTestJSON-1454716698-project] Calling method '>' {{(pid=129322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:52:01.362343 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.compute.api [None req-d2970705-3547-49ec-ada8-01c3b9c7b35d tempest-AttachVolumeTestJSON-1454716698 tempest-AttachVolumeTestJSON-1454716698-project] [instance: 51b4bd5b-19a0-4b50-804d-aff4216e854c] Fetching instance by UUID {{(pid=129322) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:52:01.369225 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-d2970705-3547-49ec-ada8-01c3b9c7b35d tempest-AttachVolumeTestJSON-1454716698 tempest-AttachVolumeTestJSON-1454716698-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:52:01.369745 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-d2970705-3547-49ec-ada8-01c3b9c7b35d tempest-AttachVolumeTestJSON-1454716698 tempest-AttachVolumeTestJSON-1454716698-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:52:01.370592 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-d2970705-3547-49ec-ada8-01c3b9c7b35d tempest-AttachVolumeTestJSON-1454716698 tempest-AttachVolumeTestJSON-1454716698-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:52:01.371086 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-d2970705-3547-49ec-ada8-01c3b9c7b35d tempest-AttachVolumeTestJSON-1454716698 tempest-AttachVolumeTestJSON-1454716698-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:52:01.503399 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.policy [None req-d2970705-3547-49ec-ada8-01c3b9c7b35d tempest-AttachVolumeTestJSON-1454716698 tempest-AttachVolumeTestJSON-1454716698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e987a71a29243dbac6c23e337765508', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9f9a22ad1e74798b9b2f7d85f89a4b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129322) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:52:01.511193 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: INFO nova.api.openstack.requestlog [None req-d2970705-3547-49ec-ada8-01c3b9c7b35d tempest-AttachVolumeTestJSON-1454716698 tempest-AttachVolumeTestJSON-1454716698-project] 10.222.0.75 "GET /compute/v2.1/servers/51b4bd5b-19a0-4b50-804d-aff4216e854c" status: 200 len: 1672 microversion: 2.1 time: 0.153255 May 26 12:52:01.511790 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: [pid: 129322|app: 0|req: 579/1137] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 26 12:52:01 2022] GET /compute/v2.1/servers/51b4bd5b-19a0-4b50-804d-aff4216e854c => generated 1672 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:52:02.290507 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi [req-e0b4f2c3-5d06-4a87-8c43-30cd50d5783c req-132b8c7f-df4e-40b4-9afa-b17aba981315 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "12795e31-07da-4c2a-8945-2c4b820f1bbf", "tag": "1e49470f-0070-48d9-8c09-380718118150"}]} {{(pid=129321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 12:52:02.299088 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [req-e0b4f2c3-5d06-4a87-8c43-30cd50d5783c req-132b8c7f-df4e-40b4-9afa-b17aba981315 service nova] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:52:02.299524 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [req-e0b4f2c3-5d06-4a87-8c43-30cd50d5783c req-132b8c7f-df4e-40b4-9afa-b17aba981315 service nova] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:52:02.310765 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: INFO nova.api.openstack.compute.server_external_events [req-e0b4f2c3-5d06-4a87-8c43-30cd50d5783c req-132b8c7f-df4e-40b4-9afa-b17aba981315 service nova] Creating event network-changed:1e49470f-0070-48d9-8c09-380718118150 for instance 12795e31-07da-4c2a-8945-2c4b820f1bbf on hv-cinder-81966 May 26 12:52:02.315611 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: INFO nova.api.openstack.requestlog [req-e0b4f2c3-5d06-4a87-8c43-30cd50d5783c req-132b8c7f-df4e-40b4-9afa-b17aba981315 service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029166 May 26 12:52:02.316199 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: [pid: 129321|app: 0|req: 559/1138] 10.222.0.75 () {64 vars in 1317 bytes} [Thu May 26 12:52:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 12:52:02.529231 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi [None req-5d16ae92-4fe3-47c0-98bf-c2ef4c35011c tempest-AttachVolumeTestJSON-1454716698 tempest-AttachVolumeTestJSON-1454716698-project] Calling method '>' {{(pid=129322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:52:02.529823 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.compute.api [None req-5d16ae92-4fe3-47c0-98bf-c2ef4c35011c tempest-AttachVolumeTestJSON-1454716698 tempest-AttachVolumeTestJSON-1454716698-project] [instance: 51b4bd5b-19a0-4b50-804d-aff4216e854c] Fetching instance by UUID {{(pid=129322) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:52:02.536976 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-5d16ae92-4fe3-47c0-98bf-c2ef4c35011c tempest-AttachVolumeTestJSON-1454716698 tempest-AttachVolumeTestJSON-1454716698-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:52:02.537630 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-5d16ae92-4fe3-47c0-98bf-c2ef4c35011c tempest-AttachVolumeTestJSON-1454716698 tempest-AttachVolumeTestJSON-1454716698-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:52:02.538535 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-5d16ae92-4fe3-47c0-98bf-c2ef4c35011c tempest-AttachVolumeTestJSON-1454716698 tempest-AttachVolumeTestJSON-1454716698-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:52:02.538986 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-5d16ae92-4fe3-47c0-98bf-c2ef4c35011c tempest-AttachVolumeTestJSON-1454716698 tempest-AttachVolumeTestJSON-1454716698-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:52:02.681479 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.policy [None req-5d16ae92-4fe3-47c0-98bf-c2ef4c35011c tempest-AttachVolumeTestJSON-1454716698 tempest-AttachVolumeTestJSON-1454716698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e987a71a29243dbac6c23e337765508', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9f9a22ad1e74798b9b2f7d85f89a4b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129322) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:52:02.689336 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: INFO nova.api.openstack.requestlog [None req-5d16ae92-4fe3-47c0-98bf-c2ef4c35011c tempest-AttachVolumeTestJSON-1454716698 tempest-AttachVolumeTestJSON-1454716698-project] 10.222.0.75 "GET /compute/v2.1/servers/51b4bd5b-19a0-4b50-804d-aff4216e854c" status: 200 len: 1672 microversion: 2.1 time: 0.164078 May 26 12:52:02.689912 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: [pid: 129322|app: 0|req: 580/1139] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 26 12:52:02 2022] GET /compute/v2.1/servers/51b4bd5b-19a0-4b50-804d-aff4216e854c => generated 1672 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:52:03.708304 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi [None req-b5a0cad1-9caf-4f36-8d57-f9f47efda386 tempest-AttachVolumeTestJSON-1454716698 tempest-AttachVolumeTestJSON-1454716698-project] Calling method '>' {{(pid=129321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:52:03.708998 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.compute.api [None req-b5a0cad1-9caf-4f36-8d57-f9f47efda386 tempest-AttachVolumeTestJSON-1454716698 tempest-AttachVolumeTestJSON-1454716698-project] [instance: 51b4bd5b-19a0-4b50-804d-aff4216e854c] Fetching instance by UUID {{(pid=129321) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:52:03.717878 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-b5a0cad1-9caf-4f36-8d57-f9f47efda386 tempest-AttachVolumeTestJSON-1454716698 tempest-AttachVolumeTestJSON-1454716698-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:52:03.718475 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-b5a0cad1-9caf-4f36-8d57-f9f47efda386 tempest-AttachVolumeTestJSON-1454716698 tempest-AttachVolumeTestJSON-1454716698-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:52:03.719595 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-b5a0cad1-9caf-4f36-8d57-f9f47efda386 tempest-AttachVolumeTestJSON-1454716698 tempest-AttachVolumeTestJSON-1454716698-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:52:03.720152 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-b5a0cad1-9caf-4f36-8d57-f9f47efda386 tempest-AttachVolumeTestJSON-1454716698 tempest-AttachVolumeTestJSON-1454716698-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:52:04.024627 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.policy [None req-b5a0cad1-9caf-4f36-8d57-f9f47efda386 tempest-AttachVolumeTestJSON-1454716698 tempest-AttachVolumeTestJSON-1454716698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e987a71a29243dbac6c23e337765508', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9f9a22ad1e74798b9b2f7d85f89a4b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129321) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:52:04.033400 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: INFO nova.api.openstack.requestlog [None req-b5a0cad1-9caf-4f36-8d57-f9f47efda386 tempest-AttachVolumeTestJSON-1454716698 tempest-AttachVolumeTestJSON-1454716698-project] 10.222.0.75 "GET /compute/v2.1/servers/51b4bd5b-19a0-4b50-804d-aff4216e854c" status: 200 len: 1672 microversion: 2.1 time: 0.329356 May 26 12:52:04.033980 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: [pid: 129321|app: 0|req: 560/1140] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 26 12:52:03 2022] GET /compute/v2.1/servers/51b4bd5b-19a0-4b50-804d-aff4216e854c => generated 1672 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:52:05.057009 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi [None req-83bd20f2-ecdb-4945-a7d8-b272ac78505c tempest-AttachVolumeTestJSON-1454716698 tempest-AttachVolumeTestJSON-1454716698-project] Calling method '>' {{(pid=129322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:52:05.057737 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.compute.api [None req-83bd20f2-ecdb-4945-a7d8-b272ac78505c tempest-AttachVolumeTestJSON-1454716698 tempest-AttachVolumeTestJSON-1454716698-project] [instance: 51b4bd5b-19a0-4b50-804d-aff4216e854c] Fetching instance by UUID {{(pid=129322) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:52:05.065468 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-83bd20f2-ecdb-4945-a7d8-b272ac78505c tempest-AttachVolumeTestJSON-1454716698 tempest-AttachVolumeTestJSON-1454716698-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:52:05.066045 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-83bd20f2-ecdb-4945-a7d8-b272ac78505c tempest-AttachVolumeTestJSON-1454716698 tempest-AttachVolumeTestJSON-1454716698-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:52:05.067267 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-83bd20f2-ecdb-4945-a7d8-b272ac78505c tempest-AttachVolumeTestJSON-1454716698 tempest-AttachVolumeTestJSON-1454716698-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:52:05.067660 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-83bd20f2-ecdb-4945-a7d8-b272ac78505c tempest-AttachVolumeTestJSON-1454716698 tempest-AttachVolumeTestJSON-1454716698-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:52:05.105243 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi [req-a27d49ef-5f34-4e3e-b8df-94088510d93f req-c7a4ff9d-48b1-4ab5-aff7-37a6421ec654 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "51b4bd5b-19a0-4b50-804d-aff4216e854c", "name": "network-vif-deleted", "tag": "c8eb9be5-5a23-4ce3-91ab-0a8c5ead259d"}]} {{(pid=129321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 12:52:05.116308 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [req-a27d49ef-5f34-4e3e-b8df-94088510d93f req-c7a4ff9d-48b1-4ab5-aff7-37a6421ec654 service nova] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:52:05.116832 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [req-a27d49ef-5f34-4e3e-b8df-94088510d93f req-c7a4ff9d-48b1-4ab5-aff7-37a6421ec654 service nova] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:52:05.130116 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: INFO nova.api.openstack.compute.server_external_events [req-a27d49ef-5f34-4e3e-b8df-94088510d93f req-c7a4ff9d-48b1-4ab5-aff7-37a6421ec654 service nova] Creating event network-vif-deleted:c8eb9be5-5a23-4ce3-91ab-0a8c5ead259d for instance 51b4bd5b-19a0-4b50-804d-aff4216e854c on hv-cinder-81966 May 26 12:52:05.134134 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.policy [None req-83bd20f2-ecdb-4945-a7d8-b272ac78505c tempest-AttachVolumeTestJSON-1454716698 tempest-AttachVolumeTestJSON-1454716698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e987a71a29243dbac6c23e337765508', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9f9a22ad1e74798b9b2f7d85f89a4b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129322) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:52:05.136670 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: INFO nova.api.openstack.requestlog [req-a27d49ef-5f34-4e3e-b8df-94088510d93f req-c7a4ff9d-48b1-4ab5-aff7-37a6421ec654 service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036350 May 26 12:52:05.137877 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: [pid: 129321|app: 0|req: 561/1141] 10.222.0.75 () {64 vars in 1317 bytes} [Thu May 26 12:52:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 26 12:52:05.150354 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: INFO nova.api.openstack.requestlog [None req-83bd20f2-ecdb-4945-a7d8-b272ac78505c tempest-AttachVolumeTestJSON-1454716698 tempest-AttachVolumeTestJSON-1454716698-project] 10.222.0.75 "GET /compute/v2.1/servers/51b4bd5b-19a0-4b50-804d-aff4216e854c" status: 200 len: 1605 microversion: 2.1 time: 0.103464 May 26 12:52:05.151578 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: [pid: 129322|app: 0|req: 581/1142] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 26 12:52:05 2022] GET /compute/v2.1/servers/51b4bd5b-19a0-4b50-804d-aff4216e854c => generated 1605 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:52:06.168655 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi [None req-f3776359-9721-4f48-8816-59ef7502ed13 tempest-AttachVolumeTestJSON-1454716698 tempest-AttachVolumeTestJSON-1454716698-project] Calling method '>' {{(pid=129321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:52:06.169241 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.compute.api [None req-f3776359-9721-4f48-8816-59ef7502ed13 tempest-AttachVolumeTestJSON-1454716698 tempest-AttachVolumeTestJSON-1454716698-project] [instance: 51b4bd5b-19a0-4b50-804d-aff4216e854c] Fetching instance by UUID {{(pid=129321) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:52:06.176542 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-f3776359-9721-4f48-8816-59ef7502ed13 tempest-AttachVolumeTestJSON-1454716698 tempest-AttachVolumeTestJSON-1454716698-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:52:06.176975 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-f3776359-9721-4f48-8816-59ef7502ed13 tempest-AttachVolumeTestJSON-1454716698 tempest-AttachVolumeTestJSON-1454716698-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:52:06.177739 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-f3776359-9721-4f48-8816-59ef7502ed13 tempest-AttachVolumeTestJSON-1454716698 tempest-AttachVolumeTestJSON-1454716698-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:52:06.178275 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-f3776359-9721-4f48-8816-59ef7502ed13 tempest-AttachVolumeTestJSON-1454716698 tempest-AttachVolumeTestJSON-1454716698-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:52:06.192568 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: INFO nova.api.openstack.wsgi [None req-f3776359-9721-4f48-8816-59ef7502ed13 tempest-AttachVolumeTestJSON-1454716698 tempest-AttachVolumeTestJSON-1454716698-project] HTTP exception thrown: Instance 51b4bd5b-19a0-4b50-804d-aff4216e854c could not be found. May 26 12:52:06.194516 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi [None req-f3776359-9721-4f48-8816-59ef7502ed13 tempest-AttachVolumeTestJSON-1454716698 tempest-AttachVolumeTestJSON-1454716698-project] Request method failure captured: May 26 12:52:06.194516 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: request: GET /compute/v2.1/servers/51b4bd5b-19a0-4b50-804d-aff4216e854c HTTP/1.1 May 26 12:52:06.194516 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: Accept: application/json May 26 12:52:06.194516 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: Accept-Encoding: identity May 26 12:52:06.194516 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: Connection: close May 26 12:52:06.194516 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: Content-Length: 0 May 26 12:52:06.194516 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: Content-Type: application/json May 26 12:52:06.194516 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: Host: 10.222.0.75 May 26 12:52:06.194516 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: Openstack-System-Scope: None May 26 12:52:06.194516 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: User-Agent: python-urllib3/1.26.9 May 26 12:52:06.194516 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: X-Auth-Token: gAAAAABij3biYRQth7VNOFBPzfZXJB_qWHSqHSG9e6P1UeNb-q3RPpB2aj40Ns6GyVugXTOB-VgpuQ9swDH2_aawBsT7HShFwXMj-lLhfBtfFspOvV4H1TRGH5-5fyaG-z1MHKgWVpH6S9gUyGK6Y8u3KlBpZrkU5rjhH3fCckOY_4x3OGsHu8E May 26 12:52:06.194516 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: X-Domain-Id: None May 26 12:52:06.194516 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: X-Domain-Name: None May 26 12:52:06.194516 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: X-Identity-Status: Confirmed May 26 12:52:06.194516 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: X-Is-Admin-Project: True May 26 12:52:06.194516 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: X-Project-Domain-Id: default May 26 12:52:06.194516 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: X-Project-Domain-Name: Default May 26 12:52:06.194516 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: X-Project-Id: a9f9a22ad1e74798b9b2f7d85f89a4b6 May 26 12:52:06.194516 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: X-Project-Name: tempest-AttachVolumeTestJSON-1454716698 May 26 12:52:06.194516 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: X-Role: member,reader May 26 12:52:06.194516 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: X-Roles: member,reader May 26 12:52:06.196252 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/a9f9a22ad1e74798b9b2f7d85f89a4b6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.75:8080", "publicURL": "http://10.222.0.75:8080/v1/AUTH_a9f9a22ad1e74798b9b2f7d85f89a4b6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2/a9f9a22ad1e74798b9b2f7d85f89a4b6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/a9f9a22ad1e74798b9b2f7d85f89a4b6"}]}] May 26 12:52:06.196252 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: X-Tenant: tempest-AttachVolumeTestJSON-1454716698 May 26 12:52:06.196252 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: X-Tenant-Id: a9f9a22ad1e74798b9b2f7d85f89a4b6 May 26 12:52:06.196252 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1454716698 May 26 12:52:06.196252 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: X-User: tempest-AttachVolumeTestJSON-1454716698-project May 26 12:52:06.196252 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: X-User-Domain-Id: default May 26 12:52:06.196252 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: X-User-Domain-Name: Default May 26 12:52:06.196252 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: X-User-Id: 4e987a71a29243dbac6c23e337765508 May 26 12:52:06.196252 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: X-User-Name: tempest-AttachVolumeTestJSON-1454716698-project May 26 12:52:06.196252 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: method: > May 26 12:52:06.196252 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: exception: Instance 51b4bd5b-19a0-4b50-804d-aff4216e854c could not be found. May 26 12:52:06.196252 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: action_args: {'id': '51b4bd5b-19a0-4b50-804d-aff4216e854c'} May 26 12:52:06.197172 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: {{(pid=129321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 12:52:06.197172 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 12:52:06.197172 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 26 12:52:06.197172 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 26 12:52:06.197172 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 26 12:52:06.197172 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 26 12:52:06.197172 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 26 12:52:06.197172 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 26 12:52:06.197172 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 26 12:52:06.197172 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 26 12:52:06.197172 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 51b4bd5b-19a0-4b50-804d-aff4216e854c could not be found. May 26 12:52:06.197172 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi May 26 12:52:06.197172 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 12:52:06.197172 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi May 26 12:52:06.197172 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 12:52:06.197172 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 12:52:06.197172 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 12:52:06.197172 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 12:52:06.197172 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 12:52:06.197172 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 12:52:06.198692 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 12:52:06.198692 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 26 12:52:06.198692 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 26 12:52:06.198692 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 26 12:52:06.198692 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 26 12:52:06.198692 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 26 12:52:06.198692 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 12:52:06.198692 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 51b4bd5b-19a0-4b50-804d-aff4216e854c could not be found. May 26 12:52:06.198692 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi May 26 12:52:06.198692 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 12:52:06.198692 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi May 26 12:52:06.198692 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 12:52:06.198692 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 12:52:06.198692 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 12:52:06.198692 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 12:52:06.198692 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 12:52:06.198692 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 51b4bd5b-19a0-4b50-804d-aff4216e854c could not be found. May 26 12:52:06.198692 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi May 26 12:52:06.200240 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi [None req-f3776359-9721-4f48-8816-59ef7502ed13 tempest-AttachVolumeTestJSON-1454716698 tempest-AttachVolumeTestJSON-1454716698-project] Returning 404 to user: Instance 51b4bd5b-19a0-4b50-804d-aff4216e854c could not be found. {{(pid=129321) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 12:52:06.200240 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: INFO nova.api.openstack.requestlog [None req-f3776359-9721-4f48-8816-59ef7502ed13 tempest-AttachVolumeTestJSON-1454716698 tempest-AttachVolumeTestJSON-1454716698-project] 10.222.0.75 "GET /compute/v2.1/servers/51b4bd5b-19a0-4b50-804d-aff4216e854c" status: 404 len: 111 microversion: 2.1 time: 0.031685 May 26 12:52:06.200240 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: [pid: 129321|app: 0|req: 562/1143] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 26 12:52:06 2022] GET /compute/v2.1/servers/51b4bd5b-19a0-4b50-804d-aff4216e854c => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 26 12:52:06.205444 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi [None req-313b92bf-c375-44aa-ab85-6f8881af61f0 tempest-AttachVolumeTestJSON-1454716698 tempest-AttachVolumeTestJSON-1454716698-project] Calling method '.version_select at 0x7f8308280af0>' {{(pid=129322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:52:06.226526 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: INFO nova.api.openstack.requestlog [None req-313b92bf-c375-44aa-ab85-6f8881af61f0 tempest-AttachVolumeTestJSON-1454716698 tempest-AttachVolumeTestJSON-1454716698-project] 10.222.0.75 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-66458007" status: 202 len: 0 microversion: 2.1 time: 0.024779 May 26 12:52:06.227124 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: [pid: 129322|app: 0|req: 582/1144] 10.222.0.75 () {58 vars in 1214 bytes} [Thu May 26 12:52:06 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-66458007 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 26 12:52:06.868137 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi [None req-6d8e86fd-cf43-4383-9e19-699b2b32525a tempest-AttachVolumeTestJSON-1454716698 tempest-AttachVolumeTestJSON-1454716698-project] Action: 'create', calling method: .version_select at 0x7f8308035ca0>, body: {"keypair": {"name": "tempest-keypair-1941309662", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLvGXsewMgXEdVsyBEYvBH/fqM4IuvxVOsbsYuVwr476k23MJpv0DjQ35MQv623RfqQvbvF1AUbKJ5RZAmNuJ3YRd3h1QVEwFrZnNNNY9iZSFszj5EkxDYRil7+r8zMkwQ=="}} {{(pid=129321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 12:52:06.882036 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.quota [None req-6d8e86fd-cf43-4383-9e19-699b2b32525a tempest-AttachVolumeTestJSON-1454716698 tempest-AttachVolumeTestJSON-1454716698-project] Getting quotas for project a9f9a22ad1e74798b9b2f7d85f89a4b6. Resources: {'key_pairs'} {{(pid=129321) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 26 12:52:06.885911 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.quota [None req-6d8e86fd-cf43-4383-9e19-699b2b32525a tempest-AttachVolumeTestJSON-1454716698 tempest-AttachVolumeTestJSON-1454716698-project] Getting quotas for user 4e987a71a29243dbac6c23e337765508 and project a9f9a22ad1e74798b9b2f7d85f89a4b6. Resources: {'key_pairs'} {{(pid=129321) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 26 12:52:06.908467 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: INFO nova.api.openstack.requestlog [None req-6d8e86fd-cf43-4383-9e19-699b2b32525a tempest-AttachVolumeTestJSON-1454716698 tempest-AttachVolumeTestJSON-1454716698-project] 10.222.0.75 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.044417 May 26 12:52:06.909053 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: [pid: 129321|app: 0|req: 563/1145] 10.222.0.75 () {60 vars in 1158 bytes} [Thu May 26 12:52:06 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 12:52:08.277661 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi [None req-8aff2fc5-645f-42f3-83ef-c2e7a7847dc4 tempest-AttachVolumeTestJSON-1454716698 tempest-AttachVolumeTestJSON-1454716698-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-329757825", "imageRef": "1e3c323d-d797-4e6d-bd9a-482d90084b0c", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "cb7a4ed5-5abd-45e0-aef5-449f084fc9b8"}], "security_groups": [{"name": "tempest-securitygroup--1113004523"}], "key_name": "tempest-keypair-1941309662", "user_data": "}} {{(pid=129322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 12:52:08.382831 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.network.neutron [None req-8aff2fc5-645f-42f3-83ef-c2e7a7847dc4 tempest-AttachVolumeTestJSON-1454716698 tempest-AttachVolumeTestJSON-1454716698-project] validate_networks() for [('cb7a4ed5-5abd-45e0-aef5-449f084fc9b8', None, None, None, None, None)] {{(pid=129322) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 26 12:52:08.779265 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.virt.hardware [None req-8aff2fc5-645f-42f3-83ef-c2e7a7847dc4 tempest-AttachVolumeTestJSON-1454716698 tempest-AttachVolumeTestJSON-1454716698-project] Flavor limits 0:0:0 {{(pid=129322) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 26 12:52:08.779721 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.virt.hardware [None req-8aff2fc5-645f-42f3-83ef-c2e7a7847dc4 tempest-AttachVolumeTestJSON-1454716698 tempest-AttachVolumeTestJSON-1454716698-project] Image limits 0:0:0 {{(pid=129322) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 26 12:52:08.780196 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.virt.hardware [None req-8aff2fc5-645f-42f3-83ef-c2e7a7847dc4 tempest-AttachVolumeTestJSON-1454716698 tempest-AttachVolumeTestJSON-1454716698-project] Flavor pref 0:0:0 {{(pid=129322) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 26 12:52:08.780605 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.virt.hardware [None req-8aff2fc5-645f-42f3-83ef-c2e7a7847dc4 tempest-AttachVolumeTestJSON-1454716698 tempest-AttachVolumeTestJSON-1454716698-project] Image pref 0:0:0 {{(pid=129322) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 26 12:52:08.781086 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.virt.hardware [None req-8aff2fc5-645f-42f3-83ef-c2e7a7847dc4 tempest-AttachVolumeTestJSON-1454716698 tempest-AttachVolumeTestJSON-1454716698-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129322) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 26 12:52:08.791419 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-8aff2fc5-645f-42f3-83ef-c2e7a7847dc4 tempest-AttachVolumeTestJSON-1454716698 tempest-AttachVolumeTestJSON-1454716698-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:52:08.792114 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-8aff2fc5-645f-42f3-83ef-c2e7a7847dc4 tempest-AttachVolumeTestJSON-1454716698 tempest-AttachVolumeTestJSON-1454716698-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:52:08.793305 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-8aff2fc5-645f-42f3-83ef-c2e7a7847dc4 tempest-AttachVolumeTestJSON-1454716698 tempest-AttachVolumeTestJSON-1454716698-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:52:08.793932 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-8aff2fc5-645f-42f3-83ef-c2e7a7847dc4 tempest-AttachVolumeTestJSON-1454716698 tempest-AttachVolumeTestJSON-1454716698-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:52:08.814823 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.quota [None req-8aff2fc5-645f-42f3-83ef-c2e7a7847dc4 tempest-AttachVolumeTestJSON-1454716698 tempest-AttachVolumeTestJSON-1454716698-project] Getting quotas for project a9f9a22ad1e74798b9b2f7d85f89a4b6. Resources: {'instances', 'cores', 'ram'} {{(pid=129322) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 26 12:52:08.819155 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.quota [None req-8aff2fc5-645f-42f3-83ef-c2e7a7847dc4 tempest-AttachVolumeTestJSON-1454716698 tempest-AttachVolumeTestJSON-1454716698-project] Getting quotas for user 4e987a71a29243dbac6c23e337765508 and project a9f9a22ad1e74798b9b2f7d85f89a4b6. Resources: {'instances', 'cores', 'ram'} {{(pid=129322) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 26 12:52:08.831520 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.compute.api [None req-8aff2fc5-645f-42f3-83ef-c2e7a7847dc4 tempest-AttachVolumeTestJSON-1454716698 tempest-AttachVolumeTestJSON-1454716698-project] Going to run 1 instances... {{(pid=129322) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 26 12:52:08.833850 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.compute.api [None req-8aff2fc5-645f-42f3-83ef-c2e7a7847dc4 tempest-AttachVolumeTestJSON-1454716698 tempest-AttachVolumeTestJSON-1454716698-project] [instance: 98a9eaba-a08a-4883-9549-883c38590393] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1e3c323d-d797-4e6d-bd9a-482d90084b0c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129322) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 26 12:52:08.883466 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: INFO nova.api.openstack.requestlog [None req-8aff2fc5-645f-42f3-83ef-c2e7a7847dc4 tempest-AttachVolumeTestJSON-1454716698 tempest-AttachVolumeTestJSON-1454716698-project] 10.222.0.75 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.610269 May 26 12:52:08.884559 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: [pid: 129322|app: 0|req: 583/1146] 10.222.0.75 () {60 vars in 1146 bytes} [Thu May 26 12:52:08 2022] POST /compute/v2.1/servers => generated 402 bytes in 612 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 26 12:52:08.895368 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi [None req-c4ee4b2e-e4c5-48e8-abf6-ab9d0cb8bf46 tempest-AttachVolumeTestJSON-1454716698 tempest-AttachVolumeTestJSON-1454716698-project] Calling method '>' {{(pid=129321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:52:08.895996 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.compute.api [None req-c4ee4b2e-e4c5-48e8-abf6-ab9d0cb8bf46 tempest-AttachVolumeTestJSON-1454716698 tempest-AttachVolumeTestJSON-1454716698-project] [instance: 98a9eaba-a08a-4883-9549-883c38590393] Fetching instance by UUID {{(pid=129321) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:52:08.951759 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.policy [None req-c4ee4b2e-e4c5-48e8-abf6-ab9d0cb8bf46 tempest-AttachVolumeTestJSON-1454716698 tempest-AttachVolumeTestJSON-1454716698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e987a71a29243dbac6c23e337765508', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9f9a22ad1e74798b9b2f7d85f89a4b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129321) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:52:08.958439 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: INFO nova.api.openstack.requestlog [None req-c4ee4b2e-e4c5-48e8-abf6-ab9d0cb8bf46 tempest-AttachVolumeTestJSON-1454716698 tempest-AttachVolumeTestJSON-1454716698-project] 10.222.0.75 "GET /compute/v2.1/servers/98a9eaba-a08a-4883-9549-883c38590393" status: 200 len: 1237 microversion: 2.1 time: 0.068054 May 26 12:52:08.959245 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: [pid: 129321|app: 0|req: 564/1147] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 26 12:52:08 2022] GET /compute/v2.1/servers/98a9eaba-a08a-4883-9549-883c38590393 => generated 1237 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:52:09.976417 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi [None req-bd1674f2-405c-4280-878f-a6d6cdfc0cae tempest-AttachVolumeTestJSON-1454716698 tempest-AttachVolumeTestJSON-1454716698-project] Calling method '>' {{(pid=129322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:52:09.977766 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.compute.api [None req-bd1674f2-405c-4280-878f-a6d6cdfc0cae tempest-AttachVolumeTestJSON-1454716698 tempest-AttachVolumeTestJSON-1454716698-project] [instance: 98a9eaba-a08a-4883-9549-883c38590393] Fetching instance by UUID {{(pid=129322) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:52:09.986129 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-bd1674f2-405c-4280-878f-a6d6cdfc0cae tempest-AttachVolumeTestJSON-1454716698 tempest-AttachVolumeTestJSON-1454716698-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:52:09.986577 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-bd1674f2-405c-4280-878f-a6d6cdfc0cae tempest-AttachVolumeTestJSON-1454716698 tempest-AttachVolumeTestJSON-1454716698-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:52:09.987359 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-bd1674f2-405c-4280-878f-a6d6cdfc0cae tempest-AttachVolumeTestJSON-1454716698 tempest-AttachVolumeTestJSON-1454716698-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:52:09.987801 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-bd1674f2-405c-4280-878f-a6d6cdfc0cae tempest-AttachVolumeTestJSON-1454716698 tempest-AttachVolumeTestJSON-1454716698-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:52:10.055849 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.policy [None req-bd1674f2-405c-4280-878f-a6d6cdfc0cae tempest-AttachVolumeTestJSON-1454716698 tempest-AttachVolumeTestJSON-1454716698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e987a71a29243dbac6c23e337765508', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9f9a22ad1e74798b9b2f7d85f89a4b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129322) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:52:10.064120 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: INFO nova.api.openstack.requestlog [None req-bd1674f2-405c-4280-878f-a6d6cdfc0cae tempest-AttachVolumeTestJSON-1454716698 tempest-AttachVolumeTestJSON-1454716698-project] 10.222.0.75 "GET /compute/v2.1/servers/98a9eaba-a08a-4883-9549-883c38590393" status: 200 len: 1297 microversion: 2.1 time: 0.091577 May 26 12:52:10.064858 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: [pid: 129322|app: 0|req: 584/1148] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 26 12:52:09 2022] GET /compute/v2.1/servers/98a9eaba-a08a-4883-9549-883c38590393 => generated 1297 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:52:11.081789 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi [None req-5336aa01-c5cf-4909-b91d-6cb9829f4ff5 tempest-AttachVolumeTestJSON-1454716698 tempest-AttachVolumeTestJSON-1454716698-project] Calling method '>' {{(pid=129321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:52:11.082589 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.compute.api [None req-5336aa01-c5cf-4909-b91d-6cb9829f4ff5 tempest-AttachVolumeTestJSON-1454716698 tempest-AttachVolumeTestJSON-1454716698-project] [instance: 98a9eaba-a08a-4883-9549-883c38590393] Fetching instance by UUID {{(pid=129321) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:52:11.090186 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-5336aa01-c5cf-4909-b91d-6cb9829f4ff5 tempest-AttachVolumeTestJSON-1454716698 tempest-AttachVolumeTestJSON-1454716698-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:52:11.090655 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-5336aa01-c5cf-4909-b91d-6cb9829f4ff5 tempest-AttachVolumeTestJSON-1454716698 tempest-AttachVolumeTestJSON-1454716698-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:52:11.091417 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-5336aa01-c5cf-4909-b91d-6cb9829f4ff5 tempest-AttachVolumeTestJSON-1454716698 tempest-AttachVolumeTestJSON-1454716698-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:52:11.091893 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-5336aa01-c5cf-4909-b91d-6cb9829f4ff5 tempest-AttachVolumeTestJSON-1454716698 tempest-AttachVolumeTestJSON-1454716698-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:52:11.331181 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.policy [None req-5336aa01-c5cf-4909-b91d-6cb9829f4ff5 tempest-AttachVolumeTestJSON-1454716698 tempest-AttachVolumeTestJSON-1454716698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e987a71a29243dbac6c23e337765508', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9f9a22ad1e74798b9b2f7d85f89a4b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129321) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:52:11.340956 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: INFO nova.api.openstack.requestlog [None req-5336aa01-c5cf-4909-b91d-6cb9829f4ff5 tempest-AttachVolumeTestJSON-1454716698 tempest-AttachVolumeTestJSON-1454716698-project] 10.222.0.75 "GET /compute/v2.1/servers/98a9eaba-a08a-4883-9549-883c38590393" status: 200 len: 1363 microversion: 2.1 time: 0.263055 May 26 12:52:11.341735 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: [pid: 129321|app: 0|req: 565/1149] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 26 12:52:11 2022] GET /compute/v2.1/servers/98a9eaba-a08a-4883-9549-883c38590393 => generated 1363 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:52:11.703752 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi [req-00eca74c-e0c1-4af3-bb7b-c4eecddcfef1 req-e8898123-5505-4672-ba8e-a0b8498eae93 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "98a9eaba-a08a-4883-9549-883c38590393", "tag": "9346829c-77c5-4003-9a76-ec6c58463abe"}]} {{(pid=129322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 12:52:11.713253 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [req-00eca74c-e0c1-4af3-bb7b-c4eecddcfef1 req-e8898123-5505-4672-ba8e-a0b8498eae93 service nova] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:52:11.714030 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [req-00eca74c-e0c1-4af3-bb7b-c4eecddcfef1 req-e8898123-5505-4672-ba8e-a0b8498eae93 service nova] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:52:11.726782 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: INFO nova.api.openstack.compute.server_external_events [req-00eca74c-e0c1-4af3-bb7b-c4eecddcfef1 req-e8898123-5505-4672-ba8e-a0b8498eae93 service nova] Creating event network-changed:9346829c-77c5-4003-9a76-ec6c58463abe for instance 98a9eaba-a08a-4883-9549-883c38590393 on hv-cinder-81966 May 26 12:52:11.731919 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: INFO nova.api.openstack.requestlog [req-00eca74c-e0c1-4af3-bb7b-c4eecddcfef1 req-e8898123-5505-4672-ba8e-a0b8498eae93 service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031874 May 26 12:52:11.732703 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: [pid: 129322|app: 0|req: 585/1150] 10.222.0.75 () {64 vars in 1317 bytes} [Thu May 26 12:52:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 12:52:12.362425 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi [None req-c301dd65-1bc0-454c-86ac-7af2b77796f9 tempest-AttachVolumeTestJSON-1454716698 tempest-AttachVolumeTestJSON-1454716698-project] Calling method '>' {{(pid=129321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:52:12.363349 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.compute.api [None req-c301dd65-1bc0-454c-86ac-7af2b77796f9 tempest-AttachVolumeTestJSON-1454716698 tempest-AttachVolumeTestJSON-1454716698-project] [instance: 98a9eaba-a08a-4883-9549-883c38590393] Fetching instance by UUID {{(pid=129321) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:52:12.375083 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-c301dd65-1bc0-454c-86ac-7af2b77796f9 tempest-AttachVolumeTestJSON-1454716698 tempest-AttachVolumeTestJSON-1454716698-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:52:12.375898 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-c301dd65-1bc0-454c-86ac-7af2b77796f9 tempest-AttachVolumeTestJSON-1454716698 tempest-AttachVolumeTestJSON-1454716698-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:52:12.377145 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-c301dd65-1bc0-454c-86ac-7af2b77796f9 tempest-AttachVolumeTestJSON-1454716698 tempest-AttachVolumeTestJSON-1454716698-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:52:12.377849 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-c301dd65-1bc0-454c-86ac-7af2b77796f9 tempest-AttachVolumeTestJSON-1454716698 tempest-AttachVolumeTestJSON-1454716698-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:52:12.525576 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.policy [None req-c301dd65-1bc0-454c-86ac-7af2b77796f9 tempest-AttachVolumeTestJSON-1454716698 tempest-AttachVolumeTestJSON-1454716698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e987a71a29243dbac6c23e337765508', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9f9a22ad1e74798b9b2f7d85f89a4b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129321) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:52:12.537093 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: INFO nova.api.openstack.requestlog [None req-c301dd65-1bc0-454c-86ac-7af2b77796f9 tempest-AttachVolumeTestJSON-1454716698 tempest-AttachVolumeTestJSON-1454716698-project] 10.222.0.75 "GET /compute/v2.1/servers/98a9eaba-a08a-4883-9549-883c38590393" status: 200 len: 1363 microversion: 2.1 time: 0.181079 May 26 12:52:12.537820 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: [pid: 129321|app: 0|req: 566/1151] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 26 12:52:12 2022] GET /compute/v2.1/servers/98a9eaba-a08a-4883-9549-883c38590393 => generated 1363 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:52:13.562305 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi [None req-34c1c89a-58e2-4a84-92f9-bb399c6af0b2 tempest-AttachVolumeTestJSON-1454716698 tempest-AttachVolumeTestJSON-1454716698-project] Calling method '>' {{(pid=129322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:52:13.563071 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.compute.api [None req-34c1c89a-58e2-4a84-92f9-bb399c6af0b2 tempest-AttachVolumeTestJSON-1454716698 tempest-AttachVolumeTestJSON-1454716698-project] [instance: 98a9eaba-a08a-4883-9549-883c38590393] Fetching instance by UUID {{(pid=129322) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:52:13.571898 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-34c1c89a-58e2-4a84-92f9-bb399c6af0b2 tempest-AttachVolumeTestJSON-1454716698 tempest-AttachVolumeTestJSON-1454716698-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:52:13.572358 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-34c1c89a-58e2-4a84-92f9-bb399c6af0b2 tempest-AttachVolumeTestJSON-1454716698 tempest-AttachVolumeTestJSON-1454716698-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:52:13.573124 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-34c1c89a-58e2-4a84-92f9-bb399c6af0b2 tempest-AttachVolumeTestJSON-1454716698 tempest-AttachVolumeTestJSON-1454716698-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:52:13.573559 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-34c1c89a-58e2-4a84-92f9-bb399c6af0b2 tempest-AttachVolumeTestJSON-1454716698 tempest-AttachVolumeTestJSON-1454716698-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:52:13.716401 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.policy [None req-34c1c89a-58e2-4a84-92f9-bb399c6af0b2 tempest-AttachVolumeTestJSON-1454716698 tempest-AttachVolumeTestJSON-1454716698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e987a71a29243dbac6c23e337765508', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9f9a22ad1e74798b9b2f7d85f89a4b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129322) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:52:13.726538 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: INFO nova.api.openstack.requestlog [None req-34c1c89a-58e2-4a84-92f9-bb399c6af0b2 tempest-AttachVolumeTestJSON-1454716698 tempest-AttachVolumeTestJSON-1454716698-project] 10.222.0.75 "GET /compute/v2.1/servers/98a9eaba-a08a-4883-9549-883c38590393" status: 200 len: 1363 microversion: 2.1 time: 0.170313 May 26 12:52:13.727196 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: [pid: 129322|app: 0|req: 586/1152] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 26 12:52:13 2022] GET /compute/v2.1/servers/98a9eaba-a08a-4883-9549-883c38590393 => generated 1363 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:52:14.744109 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi [None req-f31c2ee5-961a-41c6-8218-7c64763a7411 tempest-AttachVolumeTestJSON-1454716698 tempest-AttachVolumeTestJSON-1454716698-project] Calling method '>' {{(pid=129321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:52:14.744710 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.compute.api [None req-f31c2ee5-961a-41c6-8218-7c64763a7411 tempest-AttachVolumeTestJSON-1454716698 tempest-AttachVolumeTestJSON-1454716698-project] [instance: 98a9eaba-a08a-4883-9549-883c38590393] Fetching instance by UUID {{(pid=129321) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:52:14.751286 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-f31c2ee5-961a-41c6-8218-7c64763a7411 tempest-AttachVolumeTestJSON-1454716698 tempest-AttachVolumeTestJSON-1454716698-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:52:14.751771 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-f31c2ee5-961a-41c6-8218-7c64763a7411 tempest-AttachVolumeTestJSON-1454716698 tempest-AttachVolumeTestJSON-1454716698-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:52:14.752587 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-f31c2ee5-961a-41c6-8218-7c64763a7411 tempest-AttachVolumeTestJSON-1454716698 tempest-AttachVolumeTestJSON-1454716698-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:52:14.752991 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-f31c2ee5-961a-41c6-8218-7c64763a7411 tempest-AttachVolumeTestJSON-1454716698 tempest-AttachVolumeTestJSON-1454716698-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:52:14.961294 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.policy [None req-f31c2ee5-961a-41c6-8218-7c64763a7411 tempest-AttachVolumeTestJSON-1454716698 tempest-AttachVolumeTestJSON-1454716698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e987a71a29243dbac6c23e337765508', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9f9a22ad1e74798b9b2f7d85f89a4b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129321) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:52:14.969301 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: INFO nova.api.openstack.requestlog [None req-f31c2ee5-961a-41c6-8218-7c64763a7411 tempest-AttachVolumeTestJSON-1454716698 tempest-AttachVolumeTestJSON-1454716698-project] 10.222.0.75 "GET /compute/v2.1/servers/98a9eaba-a08a-4883-9549-883c38590393" status: 200 len: 1363 microversion: 2.1 time: 0.229151 May 26 12:52:14.969875 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: [pid: 129321|app: 0|req: 567/1153] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 26 12:52:14 2022] GET /compute/v2.1/servers/98a9eaba-a08a-4883-9549-883c38590393 => generated 1363 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:52:15.986945 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi [None req-1d1e56fb-2353-4926-87b2-02f5b6e62f82 tempest-AttachVolumeTestJSON-1454716698 tempest-AttachVolumeTestJSON-1454716698-project] Calling method '>' {{(pid=129322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:52:15.988337 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.compute.api [None req-1d1e56fb-2353-4926-87b2-02f5b6e62f82 tempest-AttachVolumeTestJSON-1454716698 tempest-AttachVolumeTestJSON-1454716698-project] [instance: 98a9eaba-a08a-4883-9549-883c38590393] Fetching instance by UUID {{(pid=129322) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:52:15.994552 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-1d1e56fb-2353-4926-87b2-02f5b6e62f82 tempest-AttachVolumeTestJSON-1454716698 tempest-AttachVolumeTestJSON-1454716698-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:52:15.995000 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-1d1e56fb-2353-4926-87b2-02f5b6e62f82 tempest-AttachVolumeTestJSON-1454716698 tempest-AttachVolumeTestJSON-1454716698-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:52:15.995790 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-1d1e56fb-2353-4926-87b2-02f5b6e62f82 tempest-AttachVolumeTestJSON-1454716698 tempest-AttachVolumeTestJSON-1454716698-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:52:15.996222 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-1d1e56fb-2353-4926-87b2-02f5b6e62f82 tempest-AttachVolumeTestJSON-1454716698 tempest-AttachVolumeTestJSON-1454716698-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:52:16.128584 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.policy [None req-1d1e56fb-2353-4926-87b2-02f5b6e62f82 tempest-AttachVolumeTestJSON-1454716698 tempest-AttachVolumeTestJSON-1454716698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e987a71a29243dbac6c23e337765508', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9f9a22ad1e74798b9b2f7d85f89a4b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129322) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:52:16.137227 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: INFO nova.api.openstack.requestlog [None req-1d1e56fb-2353-4926-87b2-02f5b6e62f82 tempest-AttachVolumeTestJSON-1454716698 tempest-AttachVolumeTestJSON-1454716698-project] 10.222.0.75 "GET /compute/v2.1/servers/98a9eaba-a08a-4883-9549-883c38590393" status: 200 len: 1363 microversion: 2.1 time: 0.154248 May 26 12:52:16.137796 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: [pid: 129322|app: 0|req: 587/1154] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 26 12:52:15 2022] GET /compute/v2.1/servers/98a9eaba-a08a-4883-9549-883c38590393 => generated 1363 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:52:17.154247 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi [None req-ca46b476-4d9d-4d39-8574-ba01137153ca tempest-AttachVolumeTestJSON-1454716698 tempest-AttachVolumeTestJSON-1454716698-project] Calling method '>' {{(pid=129321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:52:17.157079 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.compute.api [None req-ca46b476-4d9d-4d39-8574-ba01137153ca tempest-AttachVolumeTestJSON-1454716698 tempest-AttachVolumeTestJSON-1454716698-project] [instance: 98a9eaba-a08a-4883-9549-883c38590393] Fetching instance by UUID {{(pid=129321) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:52:17.160603 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG dbcounter [-] [129321] Writing DB stats nova_api:SELECT=63,nova_api:INSERT=2,nova_api:UPDATE=1 {{(pid=129321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:52:17.168646 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-ca46b476-4d9d-4d39-8574-ba01137153ca tempest-AttachVolumeTestJSON-1454716698 tempest-AttachVolumeTestJSON-1454716698-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:52:17.169174 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-ca46b476-4d9d-4d39-8574-ba01137153ca tempest-AttachVolumeTestJSON-1454716698 tempest-AttachVolumeTestJSON-1454716698-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:52:17.170007 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-ca46b476-4d9d-4d39-8574-ba01137153ca tempest-AttachVolumeTestJSON-1454716698 tempest-AttachVolumeTestJSON-1454716698-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:52:17.170501 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-ca46b476-4d9d-4d39-8574-ba01137153ca tempest-AttachVolumeTestJSON-1454716698 tempest-AttachVolumeTestJSON-1454716698-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:52:17.326095 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.policy [None req-ca46b476-4d9d-4d39-8574-ba01137153ca tempest-AttachVolumeTestJSON-1454716698 tempest-AttachVolumeTestJSON-1454716698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e987a71a29243dbac6c23e337765508', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9f9a22ad1e74798b9b2f7d85f89a4b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129321) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:52:17.338786 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: INFO nova.api.openstack.requestlog [None req-ca46b476-4d9d-4d39-8574-ba01137153ca tempest-AttachVolumeTestJSON-1454716698 tempest-AttachVolumeTestJSON-1454716698-project] 10.222.0.75 "GET /compute/v2.1/servers/98a9eaba-a08a-4883-9549-883c38590393" status: 200 len: 1363 microversion: 2.1 time: 0.188073 May 26 12:52:17.339631 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: [pid: 129321|app: 0|req: 568/1155] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 26 12:52:17 2022] GET /compute/v2.1/servers/98a9eaba-a08a-4883-9549-883c38590393 => generated 1363 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:52:18.365899 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi [None req-009f6518-eb49-48d3-a9ba-79b5bb75ff10 tempest-AttachVolumeTestJSON-1454716698 tempest-AttachVolumeTestJSON-1454716698-project] Calling method '>' {{(pid=129322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:52:18.366906 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.compute.api [None req-009f6518-eb49-48d3-a9ba-79b5bb75ff10 tempest-AttachVolumeTestJSON-1454716698 tempest-AttachVolumeTestJSON-1454716698-project] [instance: 98a9eaba-a08a-4883-9549-883c38590393] Fetching instance by UUID {{(pid=129322) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:52:18.378243 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-009f6518-eb49-48d3-a9ba-79b5bb75ff10 tempest-AttachVolumeTestJSON-1454716698 tempest-AttachVolumeTestJSON-1454716698-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:52:18.378983 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-009f6518-eb49-48d3-a9ba-79b5bb75ff10 tempest-AttachVolumeTestJSON-1454716698 tempest-AttachVolumeTestJSON-1454716698-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:52:18.380304 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-009f6518-eb49-48d3-a9ba-79b5bb75ff10 tempest-AttachVolumeTestJSON-1454716698 tempest-AttachVolumeTestJSON-1454716698-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:52:18.381026 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-009f6518-eb49-48d3-a9ba-79b5bb75ff10 tempest-AttachVolumeTestJSON-1454716698 tempest-AttachVolumeTestJSON-1454716698-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:52:18.518926 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.policy [None req-009f6518-eb49-48d3-a9ba-79b5bb75ff10 tempest-AttachVolumeTestJSON-1454716698 tempest-AttachVolumeTestJSON-1454716698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e987a71a29243dbac6c23e337765508', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9f9a22ad1e74798b9b2f7d85f89a4b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129322) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:52:18.528105 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: INFO nova.api.openstack.requestlog [None req-009f6518-eb49-48d3-a9ba-79b5bb75ff10 tempest-AttachVolumeTestJSON-1454716698 tempest-AttachVolumeTestJSON-1454716698-project] 10.222.0.75 "GET /compute/v2.1/servers/98a9eaba-a08a-4883-9549-883c38590393" status: 200 len: 1363 microversion: 2.1 time: 0.169077 May 26 12:52:18.528697 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: [pid: 129322|app: 0|req: 588/1156] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 26 12:52:18 2022] GET /compute/v2.1/servers/98a9eaba-a08a-4883-9549-883c38590393 => generated 1363 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:52:18.536845 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi [req-9c93cd11-3285-431b-a3a8-cdf1e588a593 req-a866144a-d897-42df-9d85-212f8f9de809 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "98a9eaba-a08a-4883-9549-883c38590393", "name": "network-vif-plugged", "status": "completed", "tag": "9346829c-77c5-4003-9a76-ec6c58463abe"}]} {{(pid=129321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 12:52:18.546238 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [req-9c93cd11-3285-431b-a3a8-cdf1e588a593 req-a866144a-d897-42df-9d85-212f8f9de809 service nova] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:52:18.546750 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [req-9c93cd11-3285-431b-a3a8-cdf1e588a593 req-a866144a-d897-42df-9d85-212f8f9de809 service nova] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:52:18.559401 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: INFO nova.api.openstack.compute.server_external_events [req-9c93cd11-3285-431b-a3a8-cdf1e588a593 req-a866144a-d897-42df-9d85-212f8f9de809 service nova] Creating event network-vif-plugged:9346829c-77c5-4003-9a76-ec6c58463abe for instance 98a9eaba-a08a-4883-9549-883c38590393 on hv-cinder-81966 May 26 12:52:18.564854 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: INFO nova.api.openstack.requestlog [req-9c93cd11-3285-431b-a3a8-cdf1e588a593 req-a866144a-d897-42df-9d85-212f8f9de809 service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031700 May 26 12:52:18.565727 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: [pid: 129321|app: 0|req: 569/1157] 10.222.0.75 () {64 vars in 1317 bytes} [Thu May 26 12:52:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 12:52:19.546853 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi [None req-1698687d-9cc5-4276-bb01-3e2d8dc065f4 tempest-AttachVolumeTestJSON-1454716698 tempest-AttachVolumeTestJSON-1454716698-project] Calling method '>' {{(pid=129322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:52:19.547574 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.compute.api [None req-1698687d-9cc5-4276-bb01-3e2d8dc065f4 tempest-AttachVolumeTestJSON-1454716698 tempest-AttachVolumeTestJSON-1454716698-project] [instance: 98a9eaba-a08a-4883-9549-883c38590393] Fetching instance by UUID {{(pid=129322) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:52:19.550063 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG dbcounter [-] [129322] Writing DB stats nova_cell0:SELECT=2 {{(pid=129322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:52:19.550984 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG dbcounter [-] [129322] Writing DB stats nova_cell0:SELECT=6 {{(pid=129322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:52:19.552387 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG dbcounter [-] [129322] Writing DB stats nova_api:SELECT=65,nova_api:INSERT=6,nova_api:DELETE=1 {{(pid=129322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:52:19.561003 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-1698687d-9cc5-4276-bb01-3e2d8dc065f4 tempest-AttachVolumeTestJSON-1454716698 tempest-AttachVolumeTestJSON-1454716698-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:52:19.561599 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-1698687d-9cc5-4276-bb01-3e2d8dc065f4 tempest-AttachVolumeTestJSON-1454716698 tempest-AttachVolumeTestJSON-1454716698-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:52:19.562621 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-1698687d-9cc5-4276-bb01-3e2d8dc065f4 tempest-AttachVolumeTestJSON-1454716698 tempest-AttachVolumeTestJSON-1454716698-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:52:19.563198 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-1698687d-9cc5-4276-bb01-3e2d8dc065f4 tempest-AttachVolumeTestJSON-1454716698 tempest-AttachVolumeTestJSON-1454716698-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:52:19.567620 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG dbcounter [-] [129322] Writing DB stats nova_cell1:SELECT=86 {{(pid=129322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:52:19.716673 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.policy [None req-1698687d-9cc5-4276-bb01-3e2d8dc065f4 tempest-AttachVolumeTestJSON-1454716698 tempest-AttachVolumeTestJSON-1454716698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e987a71a29243dbac6c23e337765508', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9f9a22ad1e74798b9b2f7d85f89a4b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129322) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:52:19.724685 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: INFO nova.api.openstack.requestlog [None req-1698687d-9cc5-4276-bb01-3e2d8dc065f4 tempest-AttachVolumeTestJSON-1454716698 tempest-AttachVolumeTestJSON-1454716698-project] 10.222.0.75 "GET /compute/v2.1/servers/98a9eaba-a08a-4883-9549-883c38590393" status: 200 len: 1363 microversion: 2.1 time: 0.183315 May 26 12:52:19.725294 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: [pid: 129322|app: 0|req: 589/1158] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 26 12:52:19 2022] GET /compute/v2.1/servers/98a9eaba-a08a-4883-9549-883c38590393 => generated 1363 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:52:20.739164 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG dbcounter [-] [129321] Writing DB stats nova_cell0:SELECT=6 {{(pid=129321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:52:20.744530 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi [None req-41c04f1a-6d2e-4748-9199-72a14d157281 tempest-AttachVolumeTestJSON-1454716698 tempest-AttachVolumeTestJSON-1454716698-project] Calling method '>' {{(pid=129321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:52:20.745205 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.compute.api [None req-41c04f1a-6d2e-4748-9199-72a14d157281 tempest-AttachVolumeTestJSON-1454716698 tempest-AttachVolumeTestJSON-1454716698-project] [instance: 98a9eaba-a08a-4883-9549-883c38590393] Fetching instance by UUID {{(pid=129321) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:52:20.751874 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-41c04f1a-6d2e-4748-9199-72a14d157281 tempest-AttachVolumeTestJSON-1454716698 tempest-AttachVolumeTestJSON-1454716698-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:52:20.752324 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-41c04f1a-6d2e-4748-9199-72a14d157281 tempest-AttachVolumeTestJSON-1454716698 tempest-AttachVolumeTestJSON-1454716698-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:52:20.753082 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-41c04f1a-6d2e-4748-9199-72a14d157281 tempest-AttachVolumeTestJSON-1454716698 tempest-AttachVolumeTestJSON-1454716698-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:52:20.753548 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-41c04f1a-6d2e-4748-9199-72a14d157281 tempest-AttachVolumeTestJSON-1454716698 tempest-AttachVolumeTestJSON-1454716698-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:52:20.756110 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG dbcounter [-] [129321] Writing DB stats nova_cell1:SELECT=89,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:52:20.900422 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.policy [None req-41c04f1a-6d2e-4748-9199-72a14d157281 tempest-AttachVolumeTestJSON-1454716698 tempest-AttachVolumeTestJSON-1454716698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e987a71a29243dbac6c23e337765508', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9f9a22ad1e74798b9b2f7d85f89a4b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129321) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:52:20.908535 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: INFO nova.api.openstack.requestlog [None req-41c04f1a-6d2e-4748-9199-72a14d157281 tempest-AttachVolumeTestJSON-1454716698 tempest-AttachVolumeTestJSON-1454716698-project] 10.222.0.75 "GET /compute/v2.1/servers/98a9eaba-a08a-4883-9549-883c38590393" status: 200 len: 1363 microversion: 2.1 time: 0.170464 May 26 12:52:20.909041 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: [pid: 129321|app: 0|req: 570/1159] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 26 12:52:20 2022] GET /compute/v2.1/servers/98a9eaba-a08a-4883-9549-883c38590393 => generated 1363 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:52:21.928889 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi [None req-d6666e1f-83bf-4452-b895-ec73f77c4dc1 tempest-AttachVolumeTestJSON-1454716698 tempest-AttachVolumeTestJSON-1454716698-project] Calling method '>' {{(pid=129322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:52:21.929777 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.compute.api [None req-d6666e1f-83bf-4452-b895-ec73f77c4dc1 tempest-AttachVolumeTestJSON-1454716698 tempest-AttachVolumeTestJSON-1454716698-project] [instance: 98a9eaba-a08a-4883-9549-883c38590393] Fetching instance by UUID {{(pid=129322) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:52:21.940090 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-d6666e1f-83bf-4452-b895-ec73f77c4dc1 tempest-AttachVolumeTestJSON-1454716698 tempest-AttachVolumeTestJSON-1454716698-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:52:21.940601 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-d6666e1f-83bf-4452-b895-ec73f77c4dc1 tempest-AttachVolumeTestJSON-1454716698 tempest-AttachVolumeTestJSON-1454716698-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:52:21.941557 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-d6666e1f-83bf-4452-b895-ec73f77c4dc1 tempest-AttachVolumeTestJSON-1454716698 tempest-AttachVolumeTestJSON-1454716698-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:52:21.942099 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-d6666e1f-83bf-4452-b895-ec73f77c4dc1 tempest-AttachVolumeTestJSON-1454716698 tempest-AttachVolumeTestJSON-1454716698-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:52:22.092185 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.policy [None req-d6666e1f-83bf-4452-b895-ec73f77c4dc1 tempest-AttachVolumeTestJSON-1454716698 tempest-AttachVolumeTestJSON-1454716698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e987a71a29243dbac6c23e337765508', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9f9a22ad1e74798b9b2f7d85f89a4b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129322) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:52:22.103877 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: INFO nova.api.openstack.requestlog [None req-d6666e1f-83bf-4452-b895-ec73f77c4dc1 tempest-AttachVolumeTestJSON-1454716698 tempest-AttachVolumeTestJSON-1454716698-project] 10.222.0.75 "GET /compute/v2.1/servers/98a9eaba-a08a-4883-9549-883c38590393" status: 200 len: 1549 microversion: 2.1 time: 0.181245 May 26 12:52:22.104558 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: [pid: 129322|app: 0|req: 590/1160] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 26 12:52:21 2022] GET /compute/v2.1/servers/98a9eaba-a08a-4883-9549-883c38590393 => generated 1549 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:52:22.120528 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi [None req-0c573b16-b771-4103-8a6e-e355b2ecf485 tempest-AttachVolumeTestJSON-1454716698 tempest-AttachVolumeTestJSON-1454716698-project] Calling method '>' {{(pid=129321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:52:22.121091 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.compute.api [None req-0c573b16-b771-4103-8a6e-e355b2ecf485 tempest-AttachVolumeTestJSON-1454716698 tempest-AttachVolumeTestJSON-1454716698-project] [instance: 98a9eaba-a08a-4883-9549-883c38590393] Fetching instance by UUID {{(pid=129321) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:52:22.127781 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-0c573b16-b771-4103-8a6e-e355b2ecf485 tempest-AttachVolumeTestJSON-1454716698 tempest-AttachVolumeTestJSON-1454716698-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:52:22.128230 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-0c573b16-b771-4103-8a6e-e355b2ecf485 tempest-AttachVolumeTestJSON-1454716698 tempest-AttachVolumeTestJSON-1454716698-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:52:22.128985 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-0c573b16-b771-4103-8a6e-e355b2ecf485 tempest-AttachVolumeTestJSON-1454716698 tempest-AttachVolumeTestJSON-1454716698-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:52:22.129418 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-0c573b16-b771-4103-8a6e-e355b2ecf485 tempest-AttachVolumeTestJSON-1454716698 tempest-AttachVolumeTestJSON-1454716698-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:52:22.219481 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: INFO nova.api.openstack.requestlog [None req-0c573b16-b771-4103-8a6e-e355b2ecf485 tempest-AttachVolumeTestJSON-1454716698 tempest-AttachVolumeTestJSON-1454716698-project] 10.222.0.75 "GET /compute/v2.1/servers/98a9eaba-a08a-4883-9549-883c38590393/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.102910 May 26 12:52:22.220144 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: [pid: 129321|app: 0|req: 571/1161] 10.222.0.75 () {58 vars in 1274 bytes} [Thu May 26 12:52:22 2022] GET /compute/v2.1/servers/98a9eaba-a08a-4883-9549-883c38590393/os-interface => generated 285 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 26 12:52:23.159932 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi [req-1954a831-59b5-4415-a879-120fd791344c req-dd663b9d-0d86-43bd-bc12-850e3abdf79b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "98a9eaba-a08a-4883-9549-883c38590393", "tag": "9346829c-77c5-4003-9a76-ec6c58463abe"}]} {{(pid=129322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 12:52:23.169058 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [req-1954a831-59b5-4415-a879-120fd791344c req-dd663b9d-0d86-43bd-bc12-850e3abdf79b service nova] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:52:23.169502 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [req-1954a831-59b5-4415-a879-120fd791344c req-dd663b9d-0d86-43bd-bc12-850e3abdf79b service nova] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:52:23.180824 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: INFO nova.api.openstack.compute.server_external_events [req-1954a831-59b5-4415-a879-120fd791344c req-dd663b9d-0d86-43bd-bc12-850e3abdf79b service nova] Creating event network-changed:9346829c-77c5-4003-9a76-ec6c58463abe for instance 98a9eaba-a08a-4883-9549-883c38590393 on hv-cinder-81966 May 26 12:52:23.186019 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: INFO nova.api.openstack.requestlog [req-1954a831-59b5-4415-a879-120fd791344c req-dd663b9d-0d86-43bd-bc12-850e3abdf79b service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029799 May 26 12:52:23.186665 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: [pid: 129322|app: 0|req: 591/1162] 10.222.0.75 () {64 vars in 1317 bytes} [Thu May 26 12:52:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 12:53:16.417926 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 26 12:53:16.418920 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: Thu May 26 12:53:16 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 26 12:53:28.701421 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG dbcounter [-] [129321] Writing DB stats nova_api:SELECT=7 {{(pid=129321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:53:28.702233 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG dbcounter [-] [129321] Writing DB stats nova_cell1:SELECT=9 {{(pid=129321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:53:28.706379 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi [None req-58f867d4-870a-4247-8a9e-f1a7c038d53f tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] Calling method '>' {{(pid=129321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:53:28.706871 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.compute.api [None req-58f867d4-870a-4247-8a9e-f1a7c038d53f tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] [instance: 12795e31-07da-4c2a-8945-2c4b820f1bbf] Fetching instance by UUID {{(pid=129321) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:53:28.714487 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-58f867d4-870a-4247-8a9e-f1a7c038d53f tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:53:28.714935 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-58f867d4-870a-4247-8a9e-f1a7c038d53f tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:53:28.715734 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-58f867d4-870a-4247-8a9e-f1a7c038d53f tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:53:28.716172 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-58f867d4-870a-4247-8a9e-f1a7c038d53f tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:53:28.742289 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: INFO nova.api.openstack.requestlog [None req-58f867d4-870a-4247-8a9e-f1a7c038d53f tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] 10.222.0.75 "GET /compute/v2.1/servers/12795e31-07da-4c2a-8945-2c4b820f1bbf/ips" status: 200 len: 150 microversion: 2.1 time: 0.042811 May 26 12:53:28.742972 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: [pid: 129321|app: 0|req: 572/1163] 10.222.0.75 () {58 vars in 1247 bytes} [Thu May 26 12:53:28 2022] GET /compute/v2.1/servers/12795e31-07da-4c2a-8945-2c4b820f1bbf/ips => generated 150 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 12:53:28.752129 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG dbcounter [-] [129322] Writing DB stats nova_api:SELECT=5 {{(pid=129322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:53:28.752947 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG dbcounter [-] [129322] Writing DB stats nova_cell1:SELECT=13 {{(pid=129322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:53:28.758203 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi [None req-5cee100d-c19e-4f6c-bb7c-49a02b15529c tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "1f106872-e01b-46c9-87ce-b31b047c3e22"}} {{(pid=129322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 12:53:28.759361 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.compute.api [None req-5cee100d-c19e-4f6c-bb7c-49a02b15529c tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] [instance: 12795e31-07da-4c2a-8945-2c4b820f1bbf] Fetching instance by UUID {{(pid=129322) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:53:28.766376 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-5cee100d-c19e-4f6c-bb7c-49a02b15529c tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:53:28.766826 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-5cee100d-c19e-4f6c-bb7c-49a02b15529c tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:53:28.767979 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-5cee100d-c19e-4f6c-bb7c-49a02b15529c tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:53:28.768410 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-5cee100d-c19e-4f6c-bb7c-49a02b15529c tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:53:28.937498 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: INFO nova.api.openstack.wsgi [None req-5cee100d-c19e-4f6c-bb7c-49a02b15529c tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] HTTP exception thrown: Invalid volume: volume 1f106872-e01b-46c9-87ce-b31b047c3e22 is already attached to instances: 88867ead-523a-4d55-9311-bdddd200c270 May 26 12:53:28.939474 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi [None req-5cee100d-c19e-4f6c-bb7c-49a02b15529c tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] Request method failure captured: May 26 12:53:28.939474 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: request: POST /compute/v2.1/servers/12795e31-07da-4c2a-8945-2c4b820f1bbf/os-volume_attachments HTTP/1.1 May 26 12:53:28.939474 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: Accept: application/json May 26 12:53:28.939474 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: Accept-Encoding: identity May 26 12:53:28.939474 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: Connection: close May 26 12:53:28.939474 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: Content-Length: 74 May 26 12:53:28.939474 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: Content-Type: application/json May 26 12:53:28.939474 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: Host: 10.222.0.75 May 26 12:53:28.939474 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: Openstack-System-Scope: None May 26 12:53:28.939474 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: User-Agent: python-urllib3/1.26.9 May 26 12:53:28.939474 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: X-Auth-Token: gAAAAABij3dy_ejiT_65wXWPYwZfIN-6WeUbfvEBcCDgX9L01CFqFU-nwaxJgQr_xdeJZky3mnpsSEy0WtYtz-shYs9kb1EXqBcjtE4c5z7FWjh8oWZK7TxUIPSLNV7p0eRBTjtvtICj3UXIwBcd_3erDIcqb3pLxZywjxdf6YmqLjQWXxRzhB0 May 26 12:53:28.939474 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: X-Domain-Id: None May 26 12:53:28.939474 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: X-Domain-Name: None May 26 12:53:28.939474 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: X-Identity-Status: Confirmed May 26 12:53:28.939474 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: X-Is-Admin-Project: True May 26 12:53:28.939474 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: X-Project-Domain-Id: default May 26 12:53:28.939474 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: X-Project-Domain-Name: Default May 26 12:53:28.939474 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: X-Project-Id: 93d5b6bba38643bfb76f083e230b3d22 May 26 12:53:28.939474 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: X-Project-Name: tempest-AttachVolumeNegativeTest-1109191477 May 26 12:53:28.939474 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: X-Role: member,reader May 26 12:53:28.939474 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: X-Roles: member,reader May 26 12:53:28.941047 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/93d5b6bba38643bfb76f083e230b3d22"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.75:8080", "publicURL": "http://10.222.0.75:8080/v1/AUTH_93d5b6bba38643bfb76f083e230b3d22"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2/93d5b6bba38643bfb76f083e230b3d22"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/93d5b6bba38643bfb76f083e230b3d22"}]}] May 26 12:53:28.941047 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: X-Tenant: tempest-AttachVolumeNegativeTest-1109191477 May 26 12:53:28.941047 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: X-Tenant-Id: 93d5b6bba38643bfb76f083e230b3d22 May 26 12:53:28.941047 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1109191477 May 26 12:53:28.941047 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: X-User: tempest-AttachVolumeNegativeTest-1109191477-project May 26 12:53:28.941047 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: X-User-Domain-Id: default May 26 12:53:28.941047 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: X-User-Domain-Name: Default May 26 12:53:28.941047 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: X-User-Id: eddc5d9ac2a74507bca19e06f0051ae1 May 26 12:53:28.941047 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: X-User-Name: tempest-AttachVolumeNegativeTest-1109191477-project May 26 12:53:28.941047 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: May 26 12:53:28.941047 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: {"volumeAttachment": {"volumeId": "1f106872-e01b-46c9-87ce-b31b047c3e22"}} May 26 12:53:28.941047 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: method: > May 26 12:53:28.941946 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: exception: Invalid volume: volume 1f106872-e01b-46c9-87ce-b31b047c3e22 is already attached to instances: 88867ead-523a-4d55-9311-bdddd200c270 May 26 12:53:28.941946 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: action_args: {'server_id': '12795e31-07da-4c2a-8945-2c4b820f1bbf', 'body': {'volumeAttachment': {'volumeId': '1f106872-e01b-46c9-87ce-b31b047c3e22'}}} May 26 12:53:28.941946 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: {{(pid=129322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 12:53:28.941946 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 12:53:28.941946 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create May 26 12:53:28.941946 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( May 26 12:53:28.941946 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner May 26 12:53:28.941946 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 26 12:53:28.941946 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner May 26 12:53:28.941946 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) May 26 12:53:28.941946 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume May 26 12:53:28.941946 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) May 26 12:53:28.941946 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached May 26 12:53:28.941946 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) May 26 12:53:28.941946 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 1f106872-e01b-46c9-87ce-b31b047c3e22 is already attached to instances: 88867ead-523a-4d55-9311-bdddd200c270 May 26 12:53:28.941946 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi May 26 12:53:28.941946 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 12:53:28.941946 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi May 26 12:53:28.941946 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 12:53:28.943231 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 12:53:28.943231 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 12:53:28.943231 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 12:53:28.943231 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 12:53:28.943231 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 12:53:28.943231 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 12:53:28.943231 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 26 12:53:28.943231 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 26 12:53:28.943231 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 26 12:53:28.943231 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 26 12:53:28.943231 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 26 12:53:28.943231 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 26 12:53:28.943231 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create May 26 12:53:28.943231 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) May 26 12:53:28.943231 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 1f106872-e01b-46c9-87ce-b31b047c3e22 is already attached to instances: 88867ead-523a-4d55-9311-bdddd200c270 May 26 12:53:28.943231 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi May 26 12:53:28.943231 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 12:53:28.943231 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi May 26 12:53:28.943231 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 12:53:28.943231 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 12:53:28.944716 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 12:53:28.944716 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 12:53:28.944716 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 12:53:28.944716 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 1f106872-e01b-46c9-87ce-b31b047c3e22 is already attached to instances: 88867ead-523a-4d55-9311-bdddd200c270 May 26 12:53:28.944716 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi May 26 12:53:28.944716 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi [None req-5cee100d-c19e-4f6c-bb7c-49a02b15529c tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] Returning 400 to user: Invalid volume: volume 1f106872-e01b-46c9-87ce-b31b047c3e22 is already attached to instances: 88867ead-523a-4d55-9311-bdddd200c270 {{(pid=129322) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 12:53:28.944716 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: INFO nova.api.openstack.requestlog [None req-5cee100d-c19e-4f6c-bb7c-49a02b15529c tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] 10.222.0.75 "POST /compute/v2.1/servers/12795e31-07da-4c2a-8945-2c4b820f1bbf/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.191195 May 26 12:53:28.944716 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: [pid: 129322|app: 0|req: 592/1164] 10.222.0.75 () {60 vars in 1322 bytes} [Thu May 26 12:53:28 2022] POST /compute/v2.1/servers/12795e31-07da-4c2a-8945-2c4b820f1bbf/os-volume_attachments => generated 174 bytes in 193 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) May 26 12:53:28.949875 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi [None req-c9ca721f-1eb5-4425-a0bf-6fb27fdf4c66 tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] Calling method '>' {{(pid=129321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:53:28.950369 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.compute.api [None req-c9ca721f-1eb5-4425-a0bf-6fb27fdf4c66 tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] [instance: 12795e31-07da-4c2a-8945-2c4b820f1bbf] Fetching instance by UUID {{(pid=129321) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:53:28.956568 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-c9ca721f-1eb5-4425-a0bf-6fb27fdf4c66 tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:53:28.956943 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-c9ca721f-1eb5-4425-a0bf-6fb27fdf4c66 tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:53:28.957710 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-c9ca721f-1eb5-4425-a0bf-6fb27fdf4c66 tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:53:28.958119 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-c9ca721f-1eb5-4425-a0bf-6fb27fdf4c66 tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:53:28.985343 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.compute.api [None req-c9ca721f-1eb5-4425-a0bf-6fb27fdf4c66 tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] [instance: 12795e31-07da-4c2a-8945-2c4b820f1bbf] Going to try to terminate instance {{(pid=129321) delete /opt/stack/nova/nova/compute/api.py:2664}} May 26 12:53:29.086958 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: INFO nova.api.openstack.requestlog [None req-c9ca721f-1eb5-4425-a0bf-6fb27fdf4c66 tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] 10.222.0.75 "DELETE /compute/v2.1/servers/12795e31-07da-4c2a-8945-2c4b820f1bbf" status: 204 len: 0 microversion: 2.1 time: 0.140654 May 26 12:53:29.087598 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: [pid: 129321|app: 0|req: 573/1165] 10.222.0.75 () {58 vars in 1238 bytes} [Thu May 26 12:53:28 2022] DELETE /compute/v2.1/servers/12795e31-07da-4c2a-8945-2c4b820f1bbf => generated 0 bytes in 142 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 26 12:53:29.098106 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi [None req-e475f89e-3fe5-4cc9-a9ab-ef62ea39c1b7 tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] Calling method '>' {{(pid=129322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:53:29.100022 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.compute.api [None req-e475f89e-3fe5-4cc9-a9ab-ef62ea39c1b7 tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] [instance: 12795e31-07da-4c2a-8945-2c4b820f1bbf] Fetching instance by UUID {{(pid=129322) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:53:29.109586 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-e475f89e-3fe5-4cc9-a9ab-ef62ea39c1b7 tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:53:29.110310 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-e475f89e-3fe5-4cc9-a9ab-ef62ea39c1b7 tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:53:29.111296 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-e475f89e-3fe5-4cc9-a9ab-ef62ea39c1b7 tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:53:29.111956 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-e475f89e-3fe5-4cc9-a9ab-ef62ea39c1b7 tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:53:29.248803 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.policy [None req-e475f89e-3fe5-4cc9-a9ab-ef62ea39c1b7 tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eddc5d9ac2a74507bca19e06f0051ae1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93d5b6bba38643bfb76f083e230b3d22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129322) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:53:29.256866 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: INFO nova.api.openstack.requestlog [None req-e475f89e-3fe5-4cc9-a9ab-ef62ea39c1b7 tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] 10.222.0.75 "GET /compute/v2.1/servers/12795e31-07da-4c2a-8945-2c4b820f1bbf" status: 200 len: 1679 microversion: 2.1 time: 0.164964 May 26 12:53:29.257572 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: [pid: 129322|app: 0|req: 593/1166] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 26 12:53:29 2022] GET /compute/v2.1/servers/12795e31-07da-4c2a-8945-2c4b820f1bbf => generated 1679 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:53:30.278044 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi [None req-ab78d6ab-c6b6-41c0-9675-5ae8f59aca74 tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] Calling method '>' {{(pid=129321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:53:30.278752 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.compute.api [None req-ab78d6ab-c6b6-41c0-9675-5ae8f59aca74 tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] [instance: 12795e31-07da-4c2a-8945-2c4b820f1bbf] Fetching instance by UUID {{(pid=129321) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:53:30.287655 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-ab78d6ab-c6b6-41c0-9675-5ae8f59aca74 tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:53:30.288115 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-ab78d6ab-c6b6-41c0-9675-5ae8f59aca74 tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:53:30.289129 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-ab78d6ab-c6b6-41c0-9675-5ae8f59aca74 tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:53:30.289884 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-ab78d6ab-c6b6-41c0-9675-5ae8f59aca74 tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:53:30.483266 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.policy [None req-ab78d6ab-c6b6-41c0-9675-5ae8f59aca74 tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eddc5d9ac2a74507bca19e06f0051ae1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93d5b6bba38643bfb76f083e230b3d22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129321) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:53:30.492742 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: INFO nova.api.openstack.requestlog [None req-ab78d6ab-c6b6-41c0-9675-5ae8f59aca74 tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] 10.222.0.75 "GET /compute/v2.1/servers/12795e31-07da-4c2a-8945-2c4b820f1bbf" status: 200 len: 1679 microversion: 2.1 time: 0.220482 May 26 12:53:30.493310 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: [pid: 129321|app: 0|req: 574/1167] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 26 12:53:30 2022] GET /compute/v2.1/servers/12795e31-07da-4c2a-8945-2c4b820f1bbf => generated 1679 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:53:31.510914 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi [None req-667dc802-5174-4e83-b752-02a545e29983 tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] Calling method '>' {{(pid=129322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:53:31.511684 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.compute.api [None req-667dc802-5174-4e83-b752-02a545e29983 tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] [instance: 12795e31-07da-4c2a-8945-2c4b820f1bbf] Fetching instance by UUID {{(pid=129322) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:53:31.521910 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-667dc802-5174-4e83-b752-02a545e29983 tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:53:31.522441 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-667dc802-5174-4e83-b752-02a545e29983 tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:53:31.523243 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-667dc802-5174-4e83-b752-02a545e29983 tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:53:31.523612 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-667dc802-5174-4e83-b752-02a545e29983 tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:53:31.593112 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.policy [None req-667dc802-5174-4e83-b752-02a545e29983 tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eddc5d9ac2a74507bca19e06f0051ae1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93d5b6bba38643bfb76f083e230b3d22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129322) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:53:31.600945 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: INFO nova.api.openstack.requestlog [None req-667dc802-5174-4e83-b752-02a545e29983 tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] 10.222.0.75 "GET /compute/v2.1/servers/12795e31-07da-4c2a-8945-2c4b820f1bbf" status: 200 len: 1612 microversion: 2.1 time: 0.094320 May 26 12:53:31.601739 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: [pid: 129322|app: 0|req: 594/1168] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 26 12:53:31 2022] GET /compute/v2.1/servers/12795e31-07da-4c2a-8945-2c4b820f1bbf => generated 1612 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:53:31.812375 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi [req-ebd510d2-5822-42d1-bc6e-dc9cad56469b req-a174ebda-75c3-4b7d-8768-4802b1f4bba4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "12795e31-07da-4c2a-8945-2c4b820f1bbf", "name": "network-vif-deleted", "tag": "1e49470f-0070-48d9-8c09-380718118150"}]} {{(pid=129321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 12:53:31.822097 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [req-ebd510d2-5822-42d1-bc6e-dc9cad56469b req-a174ebda-75c3-4b7d-8768-4802b1f4bba4 service nova] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:53:31.822520 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [req-ebd510d2-5822-42d1-bc6e-dc9cad56469b req-a174ebda-75c3-4b7d-8768-4802b1f4bba4 service nova] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:53:31.835964 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: INFO nova.api.openstack.compute.server_external_events [req-ebd510d2-5822-42d1-bc6e-dc9cad56469b req-a174ebda-75c3-4b7d-8768-4802b1f4bba4 service nova] Creating event network-vif-deleted:1e49470f-0070-48d9-8c09-380718118150 for instance 12795e31-07da-4c2a-8945-2c4b820f1bbf on hv-cinder-81966 May 26 12:53:31.841304 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: INFO nova.api.openstack.requestlog [req-ebd510d2-5822-42d1-bc6e-dc9cad56469b req-a174ebda-75c3-4b7d-8768-4802b1f4bba4 service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032656 May 26 12:53:31.841837 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: [pid: 129321|app: 0|req: 575/1169] 10.222.0.75 () {64 vars in 1317 bytes} [Thu May 26 12:53:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 12:53:32.618916 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi [None req-ec7166de-2b91-44ca-8ec5-916e091d007c tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] Calling method '>' {{(pid=129322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:53:32.620273 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.compute.api [None req-ec7166de-2b91-44ca-8ec5-916e091d007c tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] [instance: 12795e31-07da-4c2a-8945-2c4b820f1bbf] Fetching instance by UUID {{(pid=129322) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:53:32.626974 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-ec7166de-2b91-44ca-8ec5-916e091d007c tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:53:32.627428 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-ec7166de-2b91-44ca-8ec5-916e091d007c tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:53:32.628268 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-ec7166de-2b91-44ca-8ec5-916e091d007c tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:53:32.628676 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-ec7166de-2b91-44ca-8ec5-916e091d007c tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:53:32.643719 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: INFO nova.api.openstack.wsgi [None req-ec7166de-2b91-44ca-8ec5-916e091d007c tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] HTTP exception thrown: Instance 12795e31-07da-4c2a-8945-2c4b820f1bbf could not be found. May 26 12:53:32.645270 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi [None req-ec7166de-2b91-44ca-8ec5-916e091d007c tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] Request method failure captured: May 26 12:53:32.645270 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: request: GET /compute/v2.1/servers/12795e31-07da-4c2a-8945-2c4b820f1bbf HTTP/1.1 May 26 12:53:32.645270 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: Accept: application/json May 26 12:53:32.645270 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: Accept-Encoding: identity May 26 12:53:32.645270 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: Connection: close May 26 12:53:32.645270 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: Content-Length: 0 May 26 12:53:32.645270 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: Content-Type: application/json May 26 12:53:32.645270 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: Host: 10.222.0.75 May 26 12:53:32.645270 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: Openstack-System-Scope: None May 26 12:53:32.645270 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: User-Agent: python-urllib3/1.26.9 May 26 12:53:32.645270 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: X-Auth-Token: gAAAAABij3dy_ejiT_65wXWPYwZfIN-6WeUbfvEBcCDgX9L01CFqFU-nwaxJgQr_xdeJZky3mnpsSEy0WtYtz-shYs9kb1EXqBcjtE4c5z7FWjh8oWZK7TxUIPSLNV7p0eRBTjtvtICj3UXIwBcd_3erDIcqb3pLxZywjxdf6YmqLjQWXxRzhB0 May 26 12:53:32.645270 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: X-Domain-Id: None May 26 12:53:32.645270 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: X-Domain-Name: None May 26 12:53:32.645270 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: X-Identity-Status: Confirmed May 26 12:53:32.645270 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: X-Is-Admin-Project: True May 26 12:53:32.645270 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: X-Project-Domain-Id: default May 26 12:53:32.645270 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: X-Project-Domain-Name: Default May 26 12:53:32.645270 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: X-Project-Id: 93d5b6bba38643bfb76f083e230b3d22 May 26 12:53:32.645270 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: X-Project-Name: tempest-AttachVolumeNegativeTest-1109191477 May 26 12:53:32.645270 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: X-Role: member,reader May 26 12:53:32.645270 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: X-Roles: member,reader May 26 12:53:32.646993 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/93d5b6bba38643bfb76f083e230b3d22"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.75:8080", "publicURL": "http://10.222.0.75:8080/v1/AUTH_93d5b6bba38643bfb76f083e230b3d22"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2/93d5b6bba38643bfb76f083e230b3d22"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/93d5b6bba38643bfb76f083e230b3d22"}]}] May 26 12:53:32.646993 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: X-Tenant: tempest-AttachVolumeNegativeTest-1109191477 May 26 12:53:32.646993 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: X-Tenant-Id: 93d5b6bba38643bfb76f083e230b3d22 May 26 12:53:32.646993 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1109191477 May 26 12:53:32.646993 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: X-User: tempest-AttachVolumeNegativeTest-1109191477-project May 26 12:53:32.646993 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: X-User-Domain-Id: default May 26 12:53:32.646993 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: X-User-Domain-Name: Default May 26 12:53:32.646993 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: X-User-Id: eddc5d9ac2a74507bca19e06f0051ae1 May 26 12:53:32.646993 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: X-User-Name: tempest-AttachVolumeNegativeTest-1109191477-project May 26 12:53:32.646993 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: method: > May 26 12:53:32.646993 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: exception: Instance 12795e31-07da-4c2a-8945-2c4b820f1bbf could not be found. May 26 12:53:32.646993 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: action_args: {'id': '12795e31-07da-4c2a-8945-2c4b820f1bbf'} May 26 12:53:32.648103 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: {{(pid=129322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 12:53:32.648103 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 12:53:32.648103 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 26 12:53:32.648103 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 26 12:53:32.648103 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 26 12:53:32.648103 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 26 12:53:32.648103 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 26 12:53:32.648103 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 26 12:53:32.648103 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 26 12:53:32.648103 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 26 12:53:32.648103 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 12795e31-07da-4c2a-8945-2c4b820f1bbf could not be found. May 26 12:53:32.648103 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi May 26 12:53:32.648103 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 12:53:32.648103 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi May 26 12:53:32.648103 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 12:53:32.648103 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 12:53:32.648103 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 12:53:32.648103 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 12:53:32.648103 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 12:53:32.648103 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 12:53:32.649646 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 12:53:32.649646 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 26 12:53:32.649646 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 26 12:53:32.649646 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 26 12:53:32.649646 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 26 12:53:32.649646 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 26 12:53:32.649646 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 12:53:32.649646 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 12795e31-07da-4c2a-8945-2c4b820f1bbf could not be found. May 26 12:53:32.649646 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi May 26 12:53:32.649646 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 12:53:32.649646 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi May 26 12:53:32.649646 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 12:53:32.649646 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 12:53:32.649646 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 12:53:32.649646 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 12:53:32.649646 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 12:53:32.649646 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 12795e31-07da-4c2a-8945-2c4b820f1bbf could not be found. May 26 12:53:32.649646 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi May 26 12:53:32.651213 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi [None req-ec7166de-2b91-44ca-8ec5-916e091d007c tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] Returning 404 to user: Instance 12795e31-07da-4c2a-8945-2c4b820f1bbf could not be found. {{(pid=129322) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 12:53:32.651213 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: INFO nova.api.openstack.requestlog [None req-ec7166de-2b91-44ca-8ec5-916e091d007c tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] 10.222.0.75 "GET /compute/v2.1/servers/12795e31-07da-4c2a-8945-2c4b820f1bbf" status: 404 len: 111 microversion: 2.1 time: 0.032058 May 26 12:53:32.651213 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: [pid: 129322|app: 0|req: 595/1170] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 26 12:53:32 2022] GET /compute/v2.1/servers/12795e31-07da-4c2a-8945-2c4b820f1bbf => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 26 12:53:32.657614 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi [None req-6b428ddd-853a-451c-986d-32b8c2deb946 tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] Calling method '.version_select at 0x7f8308a0faf0>' {{(pid=129321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:53:32.678316 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: INFO nova.api.openstack.requestlog [None req-6b428ddd-853a-451c-986d-32b8c2deb946 tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] 10.222.0.75 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-380112310" status: 202 len: 0 microversion: 2.1 time: 0.025323 May 26 12:53:32.679146 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: [pid: 129321|app: 0|req: 576/1171] 10.222.0.75 () {58 vars in 1217 bytes} [Thu May 26 12:53:32 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-380112310 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 26 12:53:33.382927 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi [None req-0c4f9e90-9499-416c-bf17-1da0e800e062 tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] Calling method '>' {{(pid=129322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:53:33.383423 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.compute.api [None req-0c4f9e90-9499-416c-bf17-1da0e800e062 tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] [instance: 88867ead-523a-4d55-9311-bdddd200c270] Fetching instance by UUID {{(pid=129322) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:53:33.389855 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-0c4f9e90-9499-416c-bf17-1da0e800e062 tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:53:33.390313 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-0c4f9e90-9499-416c-bf17-1da0e800e062 tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:53:33.391068 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-0c4f9e90-9499-416c-bf17-1da0e800e062 tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:53:33.391499 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-0c4f9e90-9499-416c-bf17-1da0e800e062 tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:53:33.480621 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.objects.instance [None req-0c4f9e90-9499-416c-bf17-1da0e800e062 tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] Lazy-loading 'services' on Instance uuid 88867ead-523a-4d55-9311-bdddd200c270 {{(pid=129322) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 26 12:53:33.562215 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: INFO nova.api.openstack.requestlog [None req-0c4f9e90-9499-416c-bf17-1da0e800e062 tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] 10.222.0.75 "DELETE /compute/v2.1/servers/88867ead-523a-4d55-9311-bdddd200c270/os-volume_attachments/1f106872-e01b-46c9-87ce-b31b047c3e22" status: 202 len: 0 microversion: 2.1 time: 0.183123 May 26 12:53:33.562855 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: [pid: 129322|app: 0|req: 596/1172] 10.222.0.75 () {58 vars in 1415 bytes} [Thu May 26 12:53:33 2022] DELETE /compute/v2.1/servers/88867ead-523a-4d55-9311-bdddd200c270/os-volume_attachments/1f106872-e01b-46c9-87ce-b31b047c3e22 => generated 0 bytes in 185 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 26 12:53:33.573716 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi [None req-3562ca11-d6a4-4a1b-a480-c975b9a8bc77 tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] Calling method '>' {{(pid=129321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:53:33.574666 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.compute.api [None req-3562ca11-d6a4-4a1b-a480-c975b9a8bc77 tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] [instance: 88867ead-523a-4d55-9311-bdddd200c270] Fetching instance by UUID {{(pid=129321) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:53:33.582298 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-3562ca11-d6a4-4a1b-a480-c975b9a8bc77 tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:53:33.582748 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-3562ca11-d6a4-4a1b-a480-c975b9a8bc77 tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:53:33.583519 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-3562ca11-d6a4-4a1b-a480-c975b9a8bc77 tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:53:33.584012 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-3562ca11-d6a4-4a1b-a480-c975b9a8bc77 tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:53:33.619187 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: INFO nova.api.openstack.requestlog [None req-3562ca11-d6a4-4a1b-a480-c975b9a8bc77 tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] 10.222.0.75 "GET /compute/v2.1/servers/88867ead-523a-4d55-9311-bdddd200c270/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050737 May 26 12:53:33.619784 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: [pid: 129321|app: 0|req: 577/1173] 10.222.0.75 () {58 vars in 1301 bytes} [Thu May 26 12:53:33 2022] GET /compute/v2.1/servers/88867ead-523a-4d55-9311-bdddd200c270/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 12:53:34.632276 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi [None req-2b26aaba-5f2a-4d04-82ce-de6180217c1d tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] Calling method '>' {{(pid=129322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:53:34.633239 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.compute.api [None req-2b26aaba-5f2a-4d04-82ce-de6180217c1d tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] [instance: 88867ead-523a-4d55-9311-bdddd200c270] Fetching instance by UUID {{(pid=129322) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:53:34.640448 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-2b26aaba-5f2a-4d04-82ce-de6180217c1d tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:53:34.640983 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-2b26aaba-5f2a-4d04-82ce-de6180217c1d tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:53:34.641671 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-2b26aaba-5f2a-4d04-82ce-de6180217c1d tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:53:34.642089 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-2b26aaba-5f2a-4d04-82ce-de6180217c1d tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:53:34.680081 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: INFO nova.api.openstack.requestlog [None req-2b26aaba-5f2a-4d04-82ce-de6180217c1d tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] 10.222.0.75 "GET /compute/v2.1/servers/88867ead-523a-4d55-9311-bdddd200c270/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052775 May 26 12:53:34.680653 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: [pid: 129322|app: 0|req: 597/1174] 10.222.0.75 () {58 vars in 1301 bytes} [Thu May 26 12:53:34 2022] GET /compute/v2.1/servers/88867ead-523a-4d55-9311-bdddd200c270/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 12:53:35.691107 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi [None req-7157e20c-3256-4981-bec9-78f2405df08f tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] Calling method '>' {{(pid=129321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:53:35.692070 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.compute.api [None req-7157e20c-3256-4981-bec9-78f2405df08f tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] [instance: 88867ead-523a-4d55-9311-bdddd200c270] Fetching instance by UUID {{(pid=129321) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:53:35.699515 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-7157e20c-3256-4981-bec9-78f2405df08f tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:53:35.699994 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-7157e20c-3256-4981-bec9-78f2405df08f tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:53:35.700762 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-7157e20c-3256-4981-bec9-78f2405df08f tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:53:35.701191 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-7157e20c-3256-4981-bec9-78f2405df08f tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:53:35.730987 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: INFO nova.api.openstack.requestlog [None req-7157e20c-3256-4981-bec9-78f2405df08f tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] 10.222.0.75 "GET /compute/v2.1/servers/88867ead-523a-4d55-9311-bdddd200c270/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.043905 May 26 12:53:35.731590 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: [pid: 129321|app: 0|req: 578/1175] 10.222.0.75 () {58 vars in 1301 bytes} [Thu May 26 12:53:35 2022] GET /compute/v2.1/servers/88867ead-523a-4d55-9311-bdddd200c270/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 26 12:53:35.795044 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi [None req-1a0dd8be-f4c7-46fe-aac5-e76b3936958f tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] Calling method '>' {{(pid=129322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:53:35.795520 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.compute.api [None req-1a0dd8be-f4c7-46fe-aac5-e76b3936958f tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] [instance: 88867ead-523a-4d55-9311-bdddd200c270] Fetching instance by UUID {{(pid=129322) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:53:35.804819 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-1a0dd8be-f4c7-46fe-aac5-e76b3936958f tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:53:35.805409 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-1a0dd8be-f4c7-46fe-aac5-e76b3936958f tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:53:35.806572 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-1a0dd8be-f4c7-46fe-aac5-e76b3936958f tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:53:35.807270 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-1a0dd8be-f4c7-46fe-aac5-e76b3936958f tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:53:35.833175 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.compute.api [None req-1a0dd8be-f4c7-46fe-aac5-e76b3936958f tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] [instance: 88867ead-523a-4d55-9311-bdddd200c270] Going to try to terminate instance {{(pid=129322) delete /opt/stack/nova/nova/compute/api.py:2664}} May 26 12:53:35.918237 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: INFO nova.api.openstack.requestlog [None req-1a0dd8be-f4c7-46fe-aac5-e76b3936958f tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] 10.222.0.75 "DELETE /compute/v2.1/servers/88867ead-523a-4d55-9311-bdddd200c270" status: 204 len: 0 microversion: 2.1 time: 0.127244 May 26 12:53:35.919139 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: [pid: 129322|app: 0|req: 598/1176] 10.222.0.75 () {58 vars in 1238 bytes} [Thu May 26 12:53:35 2022] DELETE /compute/v2.1/servers/88867ead-523a-4d55-9311-bdddd200c270 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 26 12:53:35.927338 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi [None req-186e3586-e2ef-4879-9a2c-099a2b6b7502 tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] Calling method '>' {{(pid=129321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:53:35.927990 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.compute.api [None req-186e3586-e2ef-4879-9a2c-099a2b6b7502 tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] [instance: 88867ead-523a-4d55-9311-bdddd200c270] Fetching instance by UUID {{(pid=129321) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:53:35.934420 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-186e3586-e2ef-4879-9a2c-099a2b6b7502 tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:53:35.934866 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-186e3586-e2ef-4879-9a2c-099a2b6b7502 tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:53:35.935687 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-186e3586-e2ef-4879-9a2c-099a2b6b7502 tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:53:35.936182 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-186e3586-e2ef-4879-9a2c-099a2b6b7502 tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:53:36.091095 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.policy [None req-186e3586-e2ef-4879-9a2c-099a2b6b7502 tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eddc5d9ac2a74507bca19e06f0051ae1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93d5b6bba38643bfb76f083e230b3d22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129321) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:53:36.098909 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: INFO nova.api.openstack.requestlog [None req-186e3586-e2ef-4879-9a2c-099a2b6b7502 tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] 10.222.0.75 "GET /compute/v2.1/servers/88867ead-523a-4d55-9311-bdddd200c270" status: 200 len: 1682 microversion: 2.1 time: 0.175486 May 26 12:53:36.099485 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: [pid: 129321|app: 0|req: 579/1177] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 26 12:53:35 2022] GET /compute/v2.1/servers/88867ead-523a-4d55-9311-bdddd200c270 => generated 1682 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:53:37.117854 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi [None req-a1671970-87d6-49ef-a5f2-ab66c2be82d0 tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] Calling method '>' {{(pid=129322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:53:37.118505 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.compute.api [None req-a1671970-87d6-49ef-a5f2-ab66c2be82d0 tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] [instance: 88867ead-523a-4d55-9311-bdddd200c270] Fetching instance by UUID {{(pid=129322) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:53:37.125952 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-a1671970-87d6-49ef-a5f2-ab66c2be82d0 tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:53:37.126399 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-a1671970-87d6-49ef-a5f2-ab66c2be82d0 tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:53:37.127166 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-a1671970-87d6-49ef-a5f2-ab66c2be82d0 tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:53:37.127637 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-a1671970-87d6-49ef-a5f2-ab66c2be82d0 tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:53:37.346802 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.policy [None req-a1671970-87d6-49ef-a5f2-ab66c2be82d0 tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eddc5d9ac2a74507bca19e06f0051ae1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93d5b6bba38643bfb76f083e230b3d22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129322) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:53:37.354934 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: INFO nova.api.openstack.requestlog [None req-a1671970-87d6-49ef-a5f2-ab66c2be82d0 tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] 10.222.0.75 "GET /compute/v2.1/servers/88867ead-523a-4d55-9311-bdddd200c270" status: 200 len: 1682 microversion: 2.1 time: 0.241787 May 26 12:53:37.355572 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: [pid: 129322|app: 0|req: 599/1178] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 26 12:53:37 2022] GET /compute/v2.1/servers/88867ead-523a-4d55-9311-bdddd200c270 => generated 1682 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:53:38.239015 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi [None req-38776f55-a643-44ae-8a78-5e4e3e6e334c tempest-TestVolumeBootPattern-1304354335 tempest-TestVolumeBootPattern-1304354335-project] Calling method '>' {{(pid=129321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:53:38.241646 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi [req-d223bd2c-ba53-4882-9116-56f1136777fd req-63326533-f3e7-44a3-b867-32ebe9a85554 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "657f7e4e-0bc0-4594-8210-767d8e63dfec", "tag": "c9abc1b1-291f-4a53-ba39-f482d780eca0"}]} {{(pid=129322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 12:53:38.250895 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.compute.api [None req-38776f55-a643-44ae-8a78-5e4e3e6e334c tempest-TestVolumeBootPattern-1304354335 tempest-TestVolumeBootPattern-1304354335-project] [instance: 657f7e4e-0bc0-4594-8210-767d8e63dfec] Fetching instance by UUID {{(pid=129321) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:53:38.257689 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-38776f55-a643-44ae-8a78-5e4e3e6e334c tempest-TestVolumeBootPattern-1304354335 tempest-TestVolumeBootPattern-1304354335-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:53:38.257955 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [req-d223bd2c-ba53-4882-9116-56f1136777fd req-63326533-f3e7-44a3-b867-32ebe9a85554 service nova] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:53:38.258142 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-38776f55-a643-44ae-8a78-5e4e3e6e334c tempest-TestVolumeBootPattern-1304354335 tempest-TestVolumeBootPattern-1304354335-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:53:38.258738 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [req-d223bd2c-ba53-4882-9116-56f1136777fd req-63326533-f3e7-44a3-b867-32ebe9a85554 service nova] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:53:38.258915 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-38776f55-a643-44ae-8a78-5e4e3e6e334c tempest-TestVolumeBootPattern-1304354335 tempest-TestVolumeBootPattern-1304354335-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:53:38.259350 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-38776f55-a643-44ae-8a78-5e4e3e6e334c tempest-TestVolumeBootPattern-1304354335 tempest-TestVolumeBootPattern-1304354335-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:53:38.272087 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: INFO nova.api.openstack.compute.server_external_events [req-d223bd2c-ba53-4882-9116-56f1136777fd req-63326533-f3e7-44a3-b867-32ebe9a85554 service nova] Creating event network-changed:c9abc1b1-291f-4a53-ba39-f482d780eca0 for instance 657f7e4e-0bc0-4594-8210-767d8e63dfec on hv-cinder-81966 May 26 12:53:38.282361 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: INFO nova.api.openstack.requestlog [req-d223bd2c-ba53-4882-9116-56f1136777fd req-63326533-f3e7-44a3-b867-32ebe9a85554 service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049126 May 26 12:53:38.286614 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: [pid: 129322|app: 0|req: 600/1179] 10.222.0.75 () {64 vars in 1317 bytes} [Thu May 26 12:53:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 12:53:38.292868 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.compute.api [None req-38776f55-a643-44ae-8a78-5e4e3e6e334c tempest-TestVolumeBootPattern-1304354335 tempest-TestVolumeBootPattern-1304354335-project] [instance: 657f7e4e-0bc0-4594-8210-767d8e63dfec] Going to try to terminate instance {{(pid=129321) delete /opt/stack/nova/nova/compute/api.py:2664}} May 26 12:53:38.378904 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi [None req-d4a7d337-3854-474f-9348-a2211b2c50aa tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] Calling method '>' {{(pid=129322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:53:38.380246 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.compute.api [None req-d4a7d337-3854-474f-9348-a2211b2c50aa tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] [instance: 88867ead-523a-4d55-9311-bdddd200c270] Fetching instance by UUID {{(pid=129322) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:53:38.383883 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: INFO nova.api.openstack.requestlog [None req-38776f55-a643-44ae-8a78-5e4e3e6e334c tempest-TestVolumeBootPattern-1304354335 tempest-TestVolumeBootPattern-1304354335-project] 10.222.0.75 "DELETE /compute/v2.1/servers/657f7e4e-0bc0-4594-8210-767d8e63dfec" status: 204 len: 0 microversion: 2.1 time: 0.153318 May 26 12:53:38.388431 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: [pid: 129321|app: 0|req: 580/1180] 10.222.0.75 () {58 vars in 1238 bytes} [Thu May 26 12:53:38 2022] DELETE /compute/v2.1/servers/657f7e4e-0bc0-4594-8210-767d8e63dfec => generated 0 bytes in 156 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 26 12:53:38.389256 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-d4a7d337-3854-474f-9348-a2211b2c50aa tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:53:38.389940 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-d4a7d337-3854-474f-9348-a2211b2c50aa tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:53:38.391083 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-d4a7d337-3854-474f-9348-a2211b2c50aa tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:53:38.392135 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-d4a7d337-3854-474f-9348-a2211b2c50aa tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:53:38.394698 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi [None req-4de17c05-1b6c-4e6e-85e5-297e75145c3d tempest-TestVolumeBootPattern-1304354335 tempest-TestVolumeBootPattern-1304354335-project] Calling method '>' {{(pid=129321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:53:38.395129 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.compute.api [None req-4de17c05-1b6c-4e6e-85e5-297e75145c3d tempest-TestVolumeBootPattern-1304354335 tempest-TestVolumeBootPattern-1304354335-project] [instance: 657f7e4e-0bc0-4594-8210-767d8e63dfec] Fetching instance by UUID {{(pid=129321) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:53:38.403183 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-4de17c05-1b6c-4e6e-85e5-297e75145c3d tempest-TestVolumeBootPattern-1304354335 tempest-TestVolumeBootPattern-1304354335-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:53:38.403831 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-4de17c05-1b6c-4e6e-85e5-297e75145c3d tempest-TestVolumeBootPattern-1304354335 tempest-TestVolumeBootPattern-1304354335-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:53:38.404620 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-4de17c05-1b6c-4e6e-85e5-297e75145c3d tempest-TestVolumeBootPattern-1304354335 tempest-TestVolumeBootPattern-1304354335-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:53:38.405053 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-4de17c05-1b6c-4e6e-85e5-297e75145c3d tempest-TestVolumeBootPattern-1304354335 tempest-TestVolumeBootPattern-1304354335-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:53:38.541543 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.policy [None req-d4a7d337-3854-474f-9348-a2211b2c50aa tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eddc5d9ac2a74507bca19e06f0051ae1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93d5b6bba38643bfb76f083e230b3d22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129322) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:53:38.550777 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: INFO nova.api.openstack.requestlog [None req-d4a7d337-3854-474f-9348-a2211b2c50aa tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] 10.222.0.75 "GET /compute/v2.1/servers/88867ead-523a-4d55-9311-bdddd200c270" status: 200 len: 1682 microversion: 2.1 time: 0.176311 May 26 12:53:38.552779 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: [pid: 129322|app: 0|req: 601/1181] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 26 12:53:38 2022] GET /compute/v2.1/servers/88867ead-523a-4d55-9311-bdddd200c270 => generated 1682 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 12:53:38.621306 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi [None req-5790abe8-f181-4148-8268-c6c1e5e5e369 tempest-AttachVolumeTestJSON-1454716698 tempest-AttachVolumeTestJSON-1454716698-project] Calling method '>' {{(pid=129322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:53:38.621306 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.compute.api [None req-5790abe8-f181-4148-8268-c6c1e5e5e369 tempest-AttachVolumeTestJSON-1454716698 tempest-AttachVolumeTestJSON-1454716698-project] [instance: 98a9eaba-a08a-4883-9549-883c38590393] Fetching instance by UUID {{(pid=129322) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:53:38.627132 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-5790abe8-f181-4148-8268-c6c1e5e5e369 tempest-AttachVolumeTestJSON-1454716698 tempest-AttachVolumeTestJSON-1454716698-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:53:38.627735 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-5790abe8-f181-4148-8268-c6c1e5e5e369 tempest-AttachVolumeTestJSON-1454716698 tempest-AttachVolumeTestJSON-1454716698-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:53:38.628602 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-5790abe8-f181-4148-8268-c6c1e5e5e369 tempest-AttachVolumeTestJSON-1454716698 tempest-AttachVolumeTestJSON-1454716698-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:53:38.629146 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-5790abe8-f181-4148-8268-c6c1e5e5e369 tempest-AttachVolumeTestJSON-1454716698 tempest-AttachVolumeTestJSON-1454716698-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:53:38.653678 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: INFO nova.api.openstack.requestlog [None req-5790abe8-f181-4148-8268-c6c1e5e5e369 tempest-AttachVolumeTestJSON-1454716698 tempest-AttachVolumeTestJSON-1454716698-project] 10.222.0.75 "GET /compute/v2.1/servers/98a9eaba-a08a-4883-9549-883c38590393/ips" status: 200 len: 146 microversion: 2.1 time: 0.100394 May 26 12:53:38.654597 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: [pid: 129322|app: 0|req: 602/1182] 10.222.0.75 () {58 vars in 1247 bytes} [Thu May 26 12:53:38 2022] GET /compute/v2.1/servers/98a9eaba-a08a-4883-9549-883c38590393/ips => generated 146 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 12:53:38.674491 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.policy [None req-4de17c05-1b6c-4e6e-85e5-297e75145c3d tempest-TestVolumeBootPattern-1304354335 tempest-TestVolumeBootPattern-1304354335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab469b18ce0444d9884cdddc34ef7247', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fb41c547884511893b768b833f4e90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129321) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:53:38.682558 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: INFO nova.api.openstack.requestlog [None req-4de17c05-1b6c-4e6e-85e5-297e75145c3d tempest-TestVolumeBootPattern-1304354335 tempest-TestVolumeBootPattern-1304354335-project] 10.222.0.75 "GET /compute/v2.1/servers/657f7e4e-0bc0-4594-8210-767d8e63dfec" status: 200 len: 1577 microversion: 2.1 time: 0.292840 May 26 12:53:38.694070 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: [pid: 129321|app: 0|req: 581/1183] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 26 12:53:38 2022] GET /compute/v2.1/servers/657f7e4e-0bc0-4594-8210-767d8e63dfec => generated 1577 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:53:39.356580 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi [req-02679853-5a61-4aa1-a12f-8024a4a5f08c req-27774beb-795d-4672-beea-791215cffada service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "88867ead-523a-4d55-9311-bdddd200c270", "name": "network-vif-deleted", "tag": "7c579d53-90ff-485d-b901-e248a1c762b2"}]} {{(pid=129322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 12:53:39.364658 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [req-02679853-5a61-4aa1-a12f-8024a4a5f08c req-27774beb-795d-4672-beea-791215cffada service nova] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:53:39.365110 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [req-02679853-5a61-4aa1-a12f-8024a4a5f08c req-27774beb-795d-4672-beea-791215cffada service nova] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:53:39.377890 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: INFO nova.api.openstack.compute.server_external_events [req-02679853-5a61-4aa1-a12f-8024a4a5f08c req-27774beb-795d-4672-beea-791215cffada service nova] Creating event network-vif-deleted:7c579d53-90ff-485d-b901-e248a1c762b2 for instance 88867ead-523a-4d55-9311-bdddd200c270 on hv-cinder-81966 May 26 12:53:39.382844 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: INFO nova.api.openstack.requestlog [req-02679853-5a61-4aa1-a12f-8024a4a5f08c req-27774beb-795d-4672-beea-791215cffada service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.090924 May 26 12:53:39.383712 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: [pid: 129322|app: 0|req: 603/1184] 10.222.0.75 () {64 vars in 1317 bytes} [Thu May 26 12:53:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 12:53:39.571041 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi [None req-b5e86a2f-1d18-4b65-bb81-087637e094a8 tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] Calling method '>' {{(pid=129321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:53:39.572246 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.compute.api [None req-b5e86a2f-1d18-4b65-bb81-087637e094a8 tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] [instance: 88867ead-523a-4d55-9311-bdddd200c270] Fetching instance by UUID {{(pid=129321) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:53:39.579312 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-b5e86a2f-1d18-4b65-bb81-087637e094a8 tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:53:39.579870 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-b5e86a2f-1d18-4b65-bb81-087637e094a8 tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:53:39.580714 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-b5e86a2f-1d18-4b65-bb81-087637e094a8 tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:53:39.581153 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-b5e86a2f-1d18-4b65-bb81-087637e094a8 tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:53:39.683872 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.policy [None req-b5e86a2f-1d18-4b65-bb81-087637e094a8 tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eddc5d9ac2a74507bca19e06f0051ae1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93d5b6bba38643bfb76f083e230b3d22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129321) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:53:39.692177 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: INFO nova.api.openstack.requestlog [None req-b5e86a2f-1d18-4b65-bb81-087637e094a8 tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] 10.222.0.75 "GET /compute/v2.1/servers/88867ead-523a-4d55-9311-bdddd200c270" status: 200 len: 1615 microversion: 2.1 time: 0.127299 May 26 12:53:39.693061 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: [pid: 129321|app: 0|req: 582/1185] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 26 12:53:39 2022] GET /compute/v2.1/servers/88867ead-523a-4d55-9311-bdddd200c270 => generated 1615 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 12:53:39.710985 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi [None req-58b72f9d-08d6-42df-8b77-386fbddce9cc tempest-TestVolumeBootPattern-1304354335 tempest-TestVolumeBootPattern-1304354335-project] Calling method '>' {{(pid=129322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:53:39.712102 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.compute.api [None req-58b72f9d-08d6-42df-8b77-386fbddce9cc tempest-TestVolumeBootPattern-1304354335 tempest-TestVolumeBootPattern-1304354335-project] [instance: 657f7e4e-0bc0-4594-8210-767d8e63dfec] Fetching instance by UUID {{(pid=129322) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:53:39.721055 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-58b72f9d-08d6-42df-8b77-386fbddce9cc tempest-TestVolumeBootPattern-1304354335 tempest-TestVolumeBootPattern-1304354335-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:53:39.721785 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-58b72f9d-08d6-42df-8b77-386fbddce9cc tempest-TestVolumeBootPattern-1304354335 tempest-TestVolumeBootPattern-1304354335-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:53:39.722554 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-58b72f9d-08d6-42df-8b77-386fbddce9cc tempest-TestVolumeBootPattern-1304354335 tempest-TestVolumeBootPattern-1304354335-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:53:39.722984 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-58b72f9d-08d6-42df-8b77-386fbddce9cc tempest-TestVolumeBootPattern-1304354335 tempest-TestVolumeBootPattern-1304354335-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:53:39.873638 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.policy [None req-58b72f9d-08d6-42df-8b77-386fbddce9cc tempest-TestVolumeBootPattern-1304354335 tempest-TestVolumeBootPattern-1304354335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab469b18ce0444d9884cdddc34ef7247', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fb41c547884511893b768b833f4e90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129322) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:53:39.881316 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: INFO nova.api.openstack.requestlog [None req-58b72f9d-08d6-42df-8b77-386fbddce9cc tempest-TestVolumeBootPattern-1304354335 tempest-TestVolumeBootPattern-1304354335-project] 10.222.0.75 "GET /compute/v2.1/servers/657f7e4e-0bc0-4594-8210-767d8e63dfec" status: 200 len: 1577 microversion: 2.1 time: 0.182249 May 26 12:53:39.881899 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: [pid: 129322|app: 0|req: 604/1186] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 26 12:53:39 2022] GET /compute/v2.1/servers/657f7e4e-0bc0-4594-8210-767d8e63dfec => generated 1577 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:53:40.029232 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi [None req-fa7d40f4-d23e-4bf6-8d36-a6209ce0bda3 tempest-AttachVolumeTestJSON-1454716698 tempest-AttachVolumeTestJSON-1454716698-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ff4dff63-7462-48ff-baf9-ed19b3ff48b4"}} {{(pid=129321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 12:53:40.030400 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.compute.api [None req-fa7d40f4-d23e-4bf6-8d36-a6209ce0bda3 tempest-AttachVolumeTestJSON-1454716698 tempest-AttachVolumeTestJSON-1454716698-project] [instance: 98a9eaba-a08a-4883-9549-883c38590393] Fetching instance by UUID {{(pid=129321) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:53:40.037047 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-fa7d40f4-d23e-4bf6-8d36-a6209ce0bda3 tempest-AttachVolumeTestJSON-1454716698 tempest-AttachVolumeTestJSON-1454716698-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:53:40.037606 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-fa7d40f4-d23e-4bf6-8d36-a6209ce0bda3 tempest-AttachVolumeTestJSON-1454716698 tempest-AttachVolumeTestJSON-1454716698-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:53:40.038837 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-fa7d40f4-d23e-4bf6-8d36-a6209ce0bda3 tempest-AttachVolumeTestJSON-1454716698 tempest-AttachVolumeTestJSON-1454716698-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:53:40.039113 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-fa7d40f4-d23e-4bf6-8d36-a6209ce0bda3 tempest-AttachVolumeTestJSON-1454716698 tempest-AttachVolumeTestJSON-1454716698-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:53:40.655743 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: INFO nova.api.openstack.requestlog [None req-fa7d40f4-d23e-4bf6-8d36-a6209ce0bda3 tempest-AttachVolumeTestJSON-1454716698 tempest-AttachVolumeTestJSON-1454716698-project] 10.222.0.75 "POST /compute/v2.1/servers/98a9eaba-a08a-4883-9549-883c38590393/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.630881 May 26 12:53:40.657631 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: [pid: 129321|app: 0|req: 583/1187] 10.222.0.75 () {60 vars in 1322 bytes} [Thu May 26 12:53:40 2022] POST /compute/v2.1/servers/98a9eaba-a08a-4883-9549-883c38590393/os-volume_attachments => generated 194 bytes in 634 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 26 12:53:40.714294 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi [None req-acfd69de-9f3a-4eeb-9cc9-4fa61d339eaa tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] Calling method '>' {{(pid=129322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:53:40.714991 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.compute.api [None req-acfd69de-9f3a-4eeb-9cc9-4fa61d339eaa tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] [instance: 88867ead-523a-4d55-9311-bdddd200c270] Fetching instance by UUID {{(pid=129322) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:53:40.722996 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-acfd69de-9f3a-4eeb-9cc9-4fa61d339eaa tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:53:40.724114 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-acfd69de-9f3a-4eeb-9cc9-4fa61d339eaa tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:53:40.725638 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-acfd69de-9f3a-4eeb-9cc9-4fa61d339eaa tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:53:40.726199 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-acfd69de-9f3a-4eeb-9cc9-4fa61d339eaa tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:53:40.746916 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: INFO nova.api.openstack.wsgi [None req-acfd69de-9f3a-4eeb-9cc9-4fa61d339eaa tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] HTTP exception thrown: Instance 88867ead-523a-4d55-9311-bdddd200c270 could not be found. May 26 12:53:40.748798 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi [None req-acfd69de-9f3a-4eeb-9cc9-4fa61d339eaa tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] Request method failure captured: May 26 12:53:40.748798 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: request: GET /compute/v2.1/servers/88867ead-523a-4d55-9311-bdddd200c270 HTTP/1.1 May 26 12:53:40.748798 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: Accept: application/json May 26 12:53:40.748798 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: Accept-Encoding: identity May 26 12:53:40.748798 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: Connection: close May 26 12:53:40.748798 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: Content-Length: 0 May 26 12:53:40.748798 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: Content-Type: application/json May 26 12:53:40.748798 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: Host: 10.222.0.75 May 26 12:53:40.748798 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: Openstack-System-Scope: None May 26 12:53:40.748798 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: User-Agent: python-urllib3/1.26.9 May 26 12:53:40.748798 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: X-Auth-Token: gAAAAABij3dy_ejiT_65wXWPYwZfIN-6WeUbfvEBcCDgX9L01CFqFU-nwaxJgQr_xdeJZky3mnpsSEy0WtYtz-shYs9kb1EXqBcjtE4c5z7FWjh8oWZK7TxUIPSLNV7p0eRBTjtvtICj3UXIwBcd_3erDIcqb3pLxZywjxdf6YmqLjQWXxRzhB0 May 26 12:53:40.748798 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: X-Domain-Id: None May 26 12:53:40.748798 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: X-Domain-Name: None May 26 12:53:40.748798 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: X-Identity-Status: Confirmed May 26 12:53:40.748798 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: X-Is-Admin-Project: True May 26 12:53:40.748798 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: X-Project-Domain-Id: default May 26 12:53:40.748798 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: X-Project-Domain-Name: Default May 26 12:53:40.748798 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: X-Project-Id: 93d5b6bba38643bfb76f083e230b3d22 May 26 12:53:40.748798 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: X-Project-Name: tempest-AttachVolumeNegativeTest-1109191477 May 26 12:53:40.748798 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: X-Role: member,reader May 26 12:53:40.748798 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: X-Roles: member,reader May 26 12:53:40.750814 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/93d5b6bba38643bfb76f083e230b3d22"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.75:8080", "publicURL": "http://10.222.0.75:8080/v1/AUTH_93d5b6bba38643bfb76f083e230b3d22"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2/93d5b6bba38643bfb76f083e230b3d22"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/93d5b6bba38643bfb76f083e230b3d22"}]}] May 26 12:53:40.750814 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: X-Tenant: tempest-AttachVolumeNegativeTest-1109191477 May 26 12:53:40.750814 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: X-Tenant-Id: 93d5b6bba38643bfb76f083e230b3d22 May 26 12:53:40.750814 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1109191477 May 26 12:53:40.750814 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: X-User: tempest-AttachVolumeNegativeTest-1109191477-project May 26 12:53:40.750814 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: X-User-Domain-Id: default May 26 12:53:40.750814 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: X-User-Domain-Name: Default May 26 12:53:40.750814 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: X-User-Id: eddc5d9ac2a74507bca19e06f0051ae1 May 26 12:53:40.750814 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: X-User-Name: tempest-AttachVolumeNegativeTest-1109191477-project May 26 12:53:40.750814 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: method: > May 26 12:53:40.750814 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: exception: Instance 88867ead-523a-4d55-9311-bdddd200c270 could not be found. May 26 12:53:40.750814 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: action_args: {'id': '88867ead-523a-4d55-9311-bdddd200c270'} May 26 12:53:40.751938 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: {{(pid=129322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 12:53:40.751938 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 12:53:40.751938 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 26 12:53:40.751938 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 26 12:53:40.751938 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 26 12:53:40.751938 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 26 12:53:40.751938 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 26 12:53:40.751938 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 26 12:53:40.751938 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 26 12:53:40.751938 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 26 12:53:40.751938 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 88867ead-523a-4d55-9311-bdddd200c270 could not be found. May 26 12:53:40.751938 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi May 26 12:53:40.751938 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 12:53:40.751938 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi May 26 12:53:40.751938 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 12:53:40.751938 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 12:53:40.751938 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 12:53:40.751938 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 12:53:40.751938 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 12:53:40.751938 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 12:53:40.753553 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 12:53:40.753553 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 26 12:53:40.753553 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 26 12:53:40.753553 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 26 12:53:40.753553 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 26 12:53:40.753553 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 26 12:53:40.753553 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 12:53:40.753553 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 88867ead-523a-4d55-9311-bdddd200c270 could not be found. May 26 12:53:40.753553 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi May 26 12:53:40.753553 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 12:53:40.753553 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi May 26 12:53:40.753553 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 12:53:40.753553 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 12:53:40.753553 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 12:53:40.753553 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 12:53:40.753553 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 12:53:40.753553 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 88867ead-523a-4d55-9311-bdddd200c270 could not be found. May 26 12:53:40.753553 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi May 26 12:53:40.756306 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi [None req-acfd69de-9f3a-4eeb-9cc9-4fa61d339eaa tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] Returning 404 to user: Instance 88867ead-523a-4d55-9311-bdddd200c270 could not be found. {{(pid=129322) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 12:53:40.757313 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: INFO nova.api.openstack.requestlog [None req-acfd69de-9f3a-4eeb-9cc9-4fa61d339eaa tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] 10.222.0.75 "GET /compute/v2.1/servers/88867ead-523a-4d55-9311-bdddd200c270" status: 404 len: 111 microversion: 2.1 time: 0.047739 May 26 12:53:40.760321 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: [pid: 129322|app: 0|req: 605/1188] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 26 12:53:40 2022] GET /compute/v2.1/servers/88867ead-523a-4d55-9311-bdddd200c270 => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 26 12:53:40.768308 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi [None req-3da68948-5735-4b05-a090-1448dad3ac44 tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] Calling method '.version_select at 0x7f8308094a60>' {{(pid=129321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:53:40.792267 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: INFO nova.api.openstack.requestlog [None req-3da68948-5735-4b05-a090-1448dad3ac44 tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] 10.222.0.75 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1508501543" status: 202 len: 0 microversion: 2.1 time: 0.028805 May 26 12:53:40.793062 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: [pid: 129321|app: 0|req: 584/1189] 10.222.0.75 () {58 vars in 1220 bytes} [Thu May 26 12:53:40 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1508501543 => generated 0 bytes in 31 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 26 12:53:40.901310 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi [None req-937cdac8-2cda-40af-b60c-e2362a15e422 tempest-TestVolumeBootPattern-1304354335 tempest-TestVolumeBootPattern-1304354335-project] Calling method '>' {{(pid=129322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:53:40.903212 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.compute.api [None req-937cdac8-2cda-40af-b60c-e2362a15e422 tempest-TestVolumeBootPattern-1304354335 tempest-TestVolumeBootPattern-1304354335-project] [instance: 657f7e4e-0bc0-4594-8210-767d8e63dfec] Fetching instance by UUID {{(pid=129322) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:53:40.910078 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-937cdac8-2cda-40af-b60c-e2362a15e422 tempest-TestVolumeBootPattern-1304354335 tempest-TestVolumeBootPattern-1304354335-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:53:40.910793 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-937cdac8-2cda-40af-b60c-e2362a15e422 tempest-TestVolumeBootPattern-1304354335 tempest-TestVolumeBootPattern-1304354335-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:53:40.911851 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-937cdac8-2cda-40af-b60c-e2362a15e422 tempest-TestVolumeBootPattern-1304354335 tempest-TestVolumeBootPattern-1304354335-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:53:40.912505 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-937cdac8-2cda-40af-b60c-e2362a15e422 tempest-TestVolumeBootPattern-1304354335 tempest-TestVolumeBootPattern-1304354335-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:53:41.078123 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.policy [None req-937cdac8-2cda-40af-b60c-e2362a15e422 tempest-TestVolumeBootPattern-1304354335 tempest-TestVolumeBootPattern-1304354335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab469b18ce0444d9884cdddc34ef7247', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fb41c547884511893b768b833f4e90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129322) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:53:41.086005 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: INFO nova.api.openstack.requestlog [None req-937cdac8-2cda-40af-b60c-e2362a15e422 tempest-TestVolumeBootPattern-1304354335 tempest-TestVolumeBootPattern-1304354335-project] 10.222.0.75 "GET /compute/v2.1/servers/657f7e4e-0bc0-4594-8210-767d8e63dfec" status: 200 len: 1577 microversion: 2.1 time: 0.189050 May 26 12:53:41.086658 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: [pid: 129322|app: 0|req: 606/1190] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 26 12:53:40 2022] GET /compute/v2.1/servers/657f7e4e-0bc0-4594-8210-767d8e63dfec => generated 1577 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:53:41.777007 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi [req-d47f9411-d4c9-4a7a-8262-6fb568abc444 req-2a9951c9-ce5e-40f9-85ac-91508ff663d1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "657f7e4e-0bc0-4594-8210-767d8e63dfec", "name": "network-vif-deleted", "tag": "c9abc1b1-291f-4a53-ba39-f482d780eca0"}]} {{(pid=129321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 12:53:41.790128 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [req-d47f9411-d4c9-4a7a-8262-6fb568abc444 req-2a9951c9-ce5e-40f9-85ac-91508ff663d1 service nova] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:53:41.791421 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [req-d47f9411-d4c9-4a7a-8262-6fb568abc444 req-2a9951c9-ce5e-40f9-85ac-91508ff663d1 service nova] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:53:41.809108 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: INFO nova.api.openstack.compute.server_external_events [req-d47f9411-d4c9-4a7a-8262-6fb568abc444 req-2a9951c9-ce5e-40f9-85ac-91508ff663d1 service nova] Creating event network-vif-deleted:c9abc1b1-291f-4a53-ba39-f482d780eca0 for instance 657f7e4e-0bc0-4594-8210-767d8e63dfec on hv-cinder-81966 May 26 12:53:41.815192 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: INFO nova.api.openstack.requestlog [req-d47f9411-d4c9-4a7a-8262-6fb568abc444 req-2a9951c9-ce5e-40f9-85ac-91508ff663d1 service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041962 May 26 12:53:41.816322 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: [pid: 129321|app: 0|req: 585/1191] 10.222.0.75 () {64 vars in 1317 bytes} [Thu May 26 12:53:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 12:53:41.948094 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi [None req-f6ba71d8-4d1d-4833-bbf0-d3b153f0e6c6 tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] Action: 'create', calling method: .version_select at 0x7f830d29e040>, body: {"keypair": {"name": "tempest-keypair-1004492705", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD6BgYx4eBiMHvKP5TMXvisBtbW9o61HtMCqYTPUlGsX0sexApYx/bynaXzBxrkJ4Lr+nDIPtgEg1bSht5yOOSSKm8U2N2K8p3O3rOtFQrjsRftQ9NN5jITMhkDIg9OWxA=="}} {{(pid=129322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 12:53:41.963206 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.quota [None req-f6ba71d8-4d1d-4833-bbf0-d3b153f0e6c6 tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] Getting quotas for project 93d5b6bba38643bfb76f083e230b3d22. Resources: {'key_pairs'} {{(pid=129322) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 26 12:53:41.967892 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.quota [None req-f6ba71d8-4d1d-4833-bbf0-d3b153f0e6c6 tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] Getting quotas for user eddc5d9ac2a74507bca19e06f0051ae1 and project 93d5b6bba38643bfb76f083e230b3d22. Resources: {'key_pairs'} {{(pid=129322) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 26 12:53:41.993187 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: INFO nova.api.openstack.requestlog [None req-f6ba71d8-4d1d-4833-bbf0-d3b153f0e6c6 tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] 10.222.0.75 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.048970 May 26 12:53:41.993735 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: [pid: 129322|app: 0|req: 607/1192] 10.222.0.75 () {60 vars in 1158 bytes} [Thu May 26 12:53:41 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 12:53:42.107900 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi [None req-7fdb42c7-45cc-4477-b3ac-cc5b517854f7 tempest-TestVolumeBootPattern-1304354335 tempest-TestVolumeBootPattern-1304354335-project] Calling method '>' {{(pid=129321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:53:42.109395 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.compute.api [None req-7fdb42c7-45cc-4477-b3ac-cc5b517854f7 tempest-TestVolumeBootPattern-1304354335 tempest-TestVolumeBootPattern-1304354335-project] [instance: 657f7e4e-0bc0-4594-8210-767d8e63dfec] Fetching instance by UUID {{(pid=129321) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:53:42.118025 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-7fdb42c7-45cc-4477-b3ac-cc5b517854f7 tempest-TestVolumeBootPattern-1304354335 tempest-TestVolumeBootPattern-1304354335-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:53:42.118727 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-7fdb42c7-45cc-4477-b3ac-cc5b517854f7 tempest-TestVolumeBootPattern-1304354335 tempest-TestVolumeBootPattern-1304354335-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:53:42.119872 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-7fdb42c7-45cc-4477-b3ac-cc5b517854f7 tempest-TestVolumeBootPattern-1304354335 tempest-TestVolumeBootPattern-1304354335-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:53:42.120632 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-7fdb42c7-45cc-4477-b3ac-cc5b517854f7 tempest-TestVolumeBootPattern-1304354335 tempest-TestVolumeBootPattern-1304354335-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:53:42.203881 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.policy [None req-7fdb42c7-45cc-4477-b3ac-cc5b517854f7 tempest-TestVolumeBootPattern-1304354335 tempest-TestVolumeBootPattern-1304354335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab469b18ce0444d9884cdddc34ef7247', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fb41c547884511893b768b833f4e90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129321) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:53:42.212488 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: INFO nova.api.openstack.requestlog [None req-7fdb42c7-45cc-4477-b3ac-cc5b517854f7 tempest-TestVolumeBootPattern-1304354335 tempest-TestVolumeBootPattern-1304354335-project] 10.222.0.75 "GET /compute/v2.1/servers/657f7e4e-0bc0-4594-8210-767d8e63dfec" status: 200 len: 1225 microversion: 2.1 time: 0.110448 May 26 12:53:42.222764 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: [pid: 129321|app: 0|req: 586/1193] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 26 12:53:42 2022] GET /compute/v2.1/servers/657f7e4e-0bc0-4594-8210-767d8e63dfec => generated 1225 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:53:43.230355 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi [None req-59791a12-7f25-45c0-a603-078600795519 tempest-TestVolumeBootPattern-1304354335 tempest-TestVolumeBootPattern-1304354335-project] Calling method '>' {{(pid=129322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:53:43.231371 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.compute.api [None req-59791a12-7f25-45c0-a603-078600795519 tempest-TestVolumeBootPattern-1304354335 tempest-TestVolumeBootPattern-1304354335-project] [instance: 657f7e4e-0bc0-4594-8210-767d8e63dfec] Fetching instance by UUID {{(pid=129322) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:53:43.238973 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-59791a12-7f25-45c0-a603-078600795519 tempest-TestVolumeBootPattern-1304354335 tempest-TestVolumeBootPattern-1304354335-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:53:43.238973 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-59791a12-7f25-45c0-a603-078600795519 tempest-TestVolumeBootPattern-1304354335 tempest-TestVolumeBootPattern-1304354335-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:53:43.239693 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-59791a12-7f25-45c0-a603-078600795519 tempest-TestVolumeBootPattern-1304354335 tempest-TestVolumeBootPattern-1304354335-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:53:43.240386 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-59791a12-7f25-45c0-a603-078600795519 tempest-TestVolumeBootPattern-1304354335 tempest-TestVolumeBootPattern-1304354335-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:53:43.254400 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: INFO nova.api.openstack.wsgi [None req-59791a12-7f25-45c0-a603-078600795519 tempest-TestVolumeBootPattern-1304354335 tempest-TestVolumeBootPattern-1304354335-project] HTTP exception thrown: Instance 657f7e4e-0bc0-4594-8210-767d8e63dfec could not be found. May 26 12:53:43.256175 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi [None req-59791a12-7f25-45c0-a603-078600795519 tempest-TestVolumeBootPattern-1304354335 tempest-TestVolumeBootPattern-1304354335-project] Request method failure captured: May 26 12:53:43.256175 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: request: GET /compute/v2.1/servers/657f7e4e-0bc0-4594-8210-767d8e63dfec HTTP/1.1 May 26 12:53:43.256175 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: Accept: application/json May 26 12:53:43.256175 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: Accept-Encoding: identity May 26 12:53:43.256175 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: Connection: close May 26 12:53:43.256175 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: Content-Length: 0 May 26 12:53:43.256175 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: Content-Type: application/json May 26 12:53:43.256175 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: Host: 10.222.0.75 May 26 12:53:43.256175 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: Openstack-System-Scope: None May 26 12:53:43.256175 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: User-Agent: python-urllib3/1.26.9 May 26 12:53:43.256175 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: X-Auth-Token: gAAAAABij3ZYnnQSOjd0sWax7VYUWN6gzPhz8PA68yBKbpbl44ztpHdpGCRT5OTjH4mK7k5RUbM9n2BHMaQqTaPiaGVVrYiHYtBG0MmM1aMhd-X0oiDBwHF_1in7JqJZE2_08VQXydhfFCXEAAaHZONGGU73Q7O2hxQn12upcSRYehzmIlzQIBo May 26 12:53:43.256175 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: X-Domain-Id: None May 26 12:53:43.256175 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: X-Domain-Name: None May 26 12:53:43.256175 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: X-Identity-Status: Confirmed May 26 12:53:43.256175 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: X-Is-Admin-Project: True May 26 12:53:43.256175 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: X-Project-Domain-Id: default May 26 12:53:43.256175 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: X-Project-Domain-Name: Default May 26 12:53:43.256175 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: X-Project-Id: d6fb41c547884511893b768b833f4e90 May 26 12:53:43.256175 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: X-Project-Name: tempest-TestVolumeBootPattern-1304354335 May 26 12:53:43.256175 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: X-Role: member,reader May 26 12:53:43.256175 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: X-Roles: member,reader May 26 12:53:43.257647 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/d6fb41c547884511893b768b833f4e90"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.75:8080", "publicURL": "http://10.222.0.75:8080/v1/AUTH_d6fb41c547884511893b768b833f4e90"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2/d6fb41c547884511893b768b833f4e90"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/d6fb41c547884511893b768b833f4e90"}]}] May 26 12:53:43.257647 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: X-Tenant: tempest-TestVolumeBootPattern-1304354335 May 26 12:53:43.257647 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: X-Tenant-Id: d6fb41c547884511893b768b833f4e90 May 26 12:53:43.257647 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: X-Tenant-Name: tempest-TestVolumeBootPattern-1304354335 May 26 12:53:43.257647 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: X-User: tempest-TestVolumeBootPattern-1304354335-project May 26 12:53:43.257647 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: X-User-Domain-Id: default May 26 12:53:43.257647 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: X-User-Domain-Name: Default May 26 12:53:43.257647 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: X-User-Id: ab469b18ce0444d9884cdddc34ef7247 May 26 12:53:43.257647 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: X-User-Name: tempest-TestVolumeBootPattern-1304354335-project May 26 12:53:43.257647 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: method: > May 26 12:53:43.257647 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: exception: Instance 657f7e4e-0bc0-4594-8210-767d8e63dfec could not be found. May 26 12:53:43.257647 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: action_args: {'id': '657f7e4e-0bc0-4594-8210-767d8e63dfec'} May 26 12:53:43.258605 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: {{(pid=129322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 12:53:43.258605 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 12:53:43.258605 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 26 12:53:43.258605 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 26 12:53:43.258605 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 26 12:53:43.258605 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 26 12:53:43.258605 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 26 12:53:43.258605 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 26 12:53:43.258605 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 26 12:53:43.258605 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 26 12:53:43.258605 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 657f7e4e-0bc0-4594-8210-767d8e63dfec could not be found. May 26 12:53:43.258605 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi May 26 12:53:43.258605 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 12:53:43.258605 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi May 26 12:53:43.258605 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 12:53:43.258605 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 12:53:43.258605 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 12:53:43.258605 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 12:53:43.258605 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 12:53:43.258605 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 12:53:43.259923 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 12:53:43.259923 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 26 12:53:43.259923 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 26 12:53:43.259923 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 26 12:53:43.259923 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 26 12:53:43.259923 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 26 12:53:43.259923 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 12:53:43.259923 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 657f7e4e-0bc0-4594-8210-767d8e63dfec could not be found. May 26 12:53:43.259923 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi May 26 12:53:43.259923 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 12:53:43.259923 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi May 26 12:53:43.259923 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 12:53:43.259923 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 12:53:43.259923 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 12:53:43.259923 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 12:53:43.259923 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 12:53:43.259923 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 657f7e4e-0bc0-4594-8210-767d8e63dfec could not be found. May 26 12:53:43.259923 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi May 26 12:53:43.261140 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi [None req-59791a12-7f25-45c0-a603-078600795519 tempest-TestVolumeBootPattern-1304354335 tempest-TestVolumeBootPattern-1304354335-project] Returning 404 to user: Instance 657f7e4e-0bc0-4594-8210-767d8e63dfec could not be found. {{(pid=129322) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 12:53:43.261140 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: INFO nova.api.openstack.requestlog [None req-59791a12-7f25-45c0-a603-078600795519 tempest-TestVolumeBootPattern-1304354335 tempest-TestVolumeBootPattern-1304354335-project] 10.222.0.75 "GET /compute/v2.1/servers/657f7e4e-0bc0-4594-8210-767d8e63dfec" status: 404 len: 111 microversion: 2.1 time: 0.031717 May 26 12:53:43.261140 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: [pid: 129322|app: 0|req: 608/1194] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 26 12:53:43 2022] GET /compute/v2.1/servers/657f7e4e-0bc0-4594-8210-767d8e63dfec => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 26 12:53:43.341371 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi [None req-405228fe-f961-4e3c-acf3-b7a378c41cee tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1097533331", "imageRef": "1e3c323d-d797-4e6d-bd9a-482d90084b0c", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "0b8803cb-8e70-473c-b131-a8a5b912880c"}], "security_groups": [{"name": "tempest-securitygroup--1684416289"}], "key_name": "tempest-keypair-1004492705", "user_data": "}} {{(pid=129321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 12:53:43.452421 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.network.neutron [None req-405228fe-f961-4e3c-acf3-b7a378c41cee tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] validate_networks() for [('0b8803cb-8e70-473c-b131-a8a5b912880c', None, None, None, None, None)] {{(pid=129321) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 26 12:53:43.893205 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.virt.hardware [None req-405228fe-f961-4e3c-acf3-b7a378c41cee tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] Flavor limits 0:0:0 {{(pid=129321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 26 12:53:43.893635 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.virt.hardware [None req-405228fe-f961-4e3c-acf3-b7a378c41cee tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] Image limits 0:0:0 {{(pid=129321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 26 12:53:43.894038 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.virt.hardware [None req-405228fe-f961-4e3c-acf3-b7a378c41cee tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] Flavor pref 0:0:0 {{(pid=129321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 26 12:53:43.894439 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.virt.hardware [None req-405228fe-f961-4e3c-acf3-b7a378c41cee tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] Image pref 0:0:0 {{(pid=129321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 26 12:53:43.894844 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.virt.hardware [None req-405228fe-f961-4e3c-acf3-b7a378c41cee tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 26 12:53:43.906279 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-405228fe-f961-4e3c-acf3-b7a378c41cee tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:53:43.906738 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-405228fe-f961-4e3c-acf3-b7a378c41cee tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:53:43.909389 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-405228fe-f961-4e3c-acf3-b7a378c41cee tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:53:43.909389 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-405228fe-f961-4e3c-acf3-b7a378c41cee tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:53:43.925080 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.quota [None req-405228fe-f961-4e3c-acf3-b7a378c41cee tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] Getting quotas for project 93d5b6bba38643bfb76f083e230b3d22. Resources: {'instances', 'cores', 'ram'} {{(pid=129321) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 26 12:53:43.929288 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.quota [None req-405228fe-f961-4e3c-acf3-b7a378c41cee tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] Getting quotas for user eddc5d9ac2a74507bca19e06f0051ae1 and project 93d5b6bba38643bfb76f083e230b3d22. Resources: {'instances', 'cores', 'ram'} {{(pid=129321) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 26 12:53:43.940960 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.compute.api [None req-405228fe-f961-4e3c-acf3-b7a378c41cee tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] Going to run 1 instances... {{(pid=129321) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 26 12:53:43.943271 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.compute.api [None req-405228fe-f961-4e3c-acf3-b7a378c41cee tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] [instance: e9e3e084-4a1a-4d21-b2e9-b51f79287094] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1e3c323d-d797-4e6d-bd9a-482d90084b0c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129321) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 26 12:53:43.993445 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: INFO nova.api.openstack.requestlog [None req-405228fe-f961-4e3c-acf3-b7a378c41cee tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] 10.222.0.75 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.656597 May 26 12:53:43.994040 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: [pid: 129321|app: 0|req: 587/1195] 10.222.0.75 () {60 vars in 1146 bytes} [Thu May 26 12:53:43 2022] POST /compute/v2.1/servers => generated 402 bytes in 658 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 26 12:53:44.004690 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi [None req-53573b5c-cb46-4636-bc4d-b0aedf635cef tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] Calling method '>' {{(pid=129322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:53:44.005312 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.compute.api [None req-53573b5c-cb46-4636-bc4d-b0aedf635cef tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] [instance: e9e3e084-4a1a-4d21-b2e9-b51f79287094] Fetching instance by UUID {{(pid=129322) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:53:44.062368 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.policy [None req-53573b5c-cb46-4636-bc4d-b0aedf635cef tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eddc5d9ac2a74507bca19e06f0051ae1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93d5b6bba38643bfb76f083e230b3d22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129322) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:53:44.069085 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: INFO nova.api.openstack.requestlog [None req-53573b5c-cb46-4636-bc4d-b0aedf635cef tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] 10.222.0.75 "GET /compute/v2.1/servers/e9e3e084-4a1a-4d21-b2e9-b51f79287094" status: 200 len: 1242 microversion: 2.1 time: 0.068280 May 26 12:53:44.069772 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: [pid: 129322|app: 0|req: 609/1196] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 26 12:53:43 2022] GET /compute/v2.1/servers/e9e3e084-4a1a-4d21-b2e9-b51f79287094 => generated 1242 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:53:45.087294 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi [None req-92fc6243-1345-41dc-aac8-f5c13261d965 tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] Calling method '>' {{(pid=129321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:53:45.087916 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.compute.api [None req-92fc6243-1345-41dc-aac8-f5c13261d965 tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] [instance: e9e3e084-4a1a-4d21-b2e9-b51f79287094] Fetching instance by UUID {{(pid=129321) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:53:45.095305 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-92fc6243-1345-41dc-aac8-f5c13261d965 tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:53:45.095851 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-92fc6243-1345-41dc-aac8-f5c13261d965 tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:53:45.096828 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-92fc6243-1345-41dc-aac8-f5c13261d965 tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:53:45.097276 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-92fc6243-1345-41dc-aac8-f5c13261d965 tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:53:45.101762 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG dbcounter [-] [129321] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=4,nova_cell1:INSERT=3 {{(pid=129321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:53:45.173342 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.policy [None req-92fc6243-1345-41dc-aac8-f5c13261d965 tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eddc5d9ac2a74507bca19e06f0051ae1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93d5b6bba38643bfb76f083e230b3d22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129321) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:53:45.181135 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: INFO nova.api.openstack.requestlog [None req-92fc6243-1345-41dc-aac8-f5c13261d965 tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] 10.222.0.75 "GET /compute/v2.1/servers/e9e3e084-4a1a-4d21-b2e9-b51f79287094" status: 200 len: 1302 microversion: 2.1 time: 0.098564 May 26 12:53:45.189144 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: [pid: 129321|app: 0|req: 588/1197] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 26 12:53:45 2022] GET /compute/v2.1/servers/e9e3e084-4a1a-4d21-b2e9-b51f79287094 => generated 1302 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:53:46.199396 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi [None req-dd6ff6c5-39ab-4476-a587-9eb341ee561e tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] Calling method '>' {{(pid=129322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:53:46.200957 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.compute.api [None req-dd6ff6c5-39ab-4476-a587-9eb341ee561e tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] [instance: e9e3e084-4a1a-4d21-b2e9-b51f79287094] Fetching instance by UUID {{(pid=129322) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:53:46.210240 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-dd6ff6c5-39ab-4476-a587-9eb341ee561e tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:53:46.211096 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-dd6ff6c5-39ab-4476-a587-9eb341ee561e tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:53:46.212387 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-dd6ff6c5-39ab-4476-a587-9eb341ee561e tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:53:46.213027 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-dd6ff6c5-39ab-4476-a587-9eb341ee561e tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:53:46.465375 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.policy [None req-dd6ff6c5-39ab-4476-a587-9eb341ee561e tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eddc5d9ac2a74507bca19e06f0051ae1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93d5b6bba38643bfb76f083e230b3d22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129322) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:53:46.473406 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: INFO nova.api.openstack.requestlog [None req-dd6ff6c5-39ab-4476-a587-9eb341ee561e tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] 10.222.0.75 "GET /compute/v2.1/servers/e9e3e084-4a1a-4d21-b2e9-b51f79287094" status: 200 len: 1368 microversion: 2.1 time: 0.278728 May 26 12:53:46.476555 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi [None req-59a7f100-0d45-4201-898d-3fc833d0e5c5 tempest-TestVolumeBootPattern-1304354335 tempest-TestVolumeBootPattern-1304354335-project] Calling method '>' {{(pid=129321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:53:46.478174 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.compute.api [None req-59a7f100-0d45-4201-898d-3fc833d0e5c5 tempest-TestVolumeBootPattern-1304354335 tempest-TestVolumeBootPattern-1304354335-project] [instance: 91eb2cfb-795d-4d5c-8921-892b58ae4fa6] Fetching instance by UUID {{(pid=129321) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:53:46.485227 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: [pid: 129322|app: 0|req: 610/1198] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 26 12:53:46 2022] GET /compute/v2.1/servers/e9e3e084-4a1a-4d21-b2e9-b51f79287094 => generated 1368 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:53:46.491819 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi [req-dcb02a86-af26-41e5-b715-89f4f75c6264 req-14c32837-39cc-4b11-bdaf-93f660c5cb70 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "91eb2cfb-795d-4d5c-8921-892b58ae4fa6", "tag": "fefc8d50-0c80-4088-adf1-045e8ac58366"}]} {{(pid=129322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 12:53:46.496852 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-59a7f100-0d45-4201-898d-3fc833d0e5c5 tempest-TestVolumeBootPattern-1304354335 tempest-TestVolumeBootPattern-1304354335-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:53:46.497300 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-59a7f100-0d45-4201-898d-3fc833d0e5c5 tempest-TestVolumeBootPattern-1304354335 tempest-TestVolumeBootPattern-1304354335-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:53:46.498079 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-59a7f100-0d45-4201-898d-3fc833d0e5c5 tempest-TestVolumeBootPattern-1304354335 tempest-TestVolumeBootPattern-1304354335-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:53:46.498505 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-59a7f100-0d45-4201-898d-3fc833d0e5c5 tempest-TestVolumeBootPattern-1304354335 tempest-TestVolumeBootPattern-1304354335-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:53:46.508241 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [req-dcb02a86-af26-41e5-b715-89f4f75c6264 req-14c32837-39cc-4b11-bdaf-93f660c5cb70 service nova] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:53:46.508991 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [req-dcb02a86-af26-41e5-b715-89f4f75c6264 req-14c32837-39cc-4b11-bdaf-93f660c5cb70 service nova] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:53:46.526615 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: INFO nova.api.openstack.compute.server_external_events [req-dcb02a86-af26-41e5-b715-89f4f75c6264 req-14c32837-39cc-4b11-bdaf-93f660c5cb70 service nova] Creating event network-changed:fefc8d50-0c80-4088-adf1-045e8ac58366 for instance 91eb2cfb-795d-4d5c-8921-892b58ae4fa6 on hv-cinder-81966 May 26 12:53:46.543796 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: INFO nova.api.openstack.requestlog [req-dcb02a86-af26-41e5-b715-89f4f75c6264 req-14c32837-39cc-4b11-bdaf-93f660c5cb70 service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057166 May 26 12:53:46.547483 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.compute.api [None req-59a7f100-0d45-4201-898d-3fc833d0e5c5 tempest-TestVolumeBootPattern-1304354335 tempest-TestVolumeBootPattern-1304354335-project] [instance: 91eb2cfb-795d-4d5c-8921-892b58ae4fa6] Going to try to terminate instance {{(pid=129321) delete /opt/stack/nova/nova/compute/api.py:2664}} May 26 12:53:46.548352 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: [pid: 129322|app: 0|req: 611/1199] 10.222.0.75 () {64 vars in 1317 bytes} [Thu May 26 12:53:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 12:53:46.659204 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: INFO nova.api.openstack.requestlog [None req-59a7f100-0d45-4201-898d-3fc833d0e5c5 tempest-TestVolumeBootPattern-1304354335 tempest-TestVolumeBootPattern-1304354335-project] 10.222.0.75 "DELETE /compute/v2.1/servers/91eb2cfb-795d-4d5c-8921-892b58ae4fa6" status: 204 len: 0 microversion: 2.1 time: 0.188671 May 26 12:53:46.660648 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: [pid: 129321|app: 0|req: 589/1200] 10.222.0.75 () {58 vars in 1238 bytes} [Thu May 26 12:53:46 2022] DELETE /compute/v2.1/servers/91eb2cfb-795d-4d5c-8921-892b58ae4fa6 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 26 12:53:46.669311 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi [None req-055e4f09-feae-4ef3-90d4-68a7777c7a9e tempest-TestVolumeBootPattern-1304354335 tempest-TestVolumeBootPattern-1304354335-project] Calling method '>' {{(pid=129322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:53:46.670259 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.compute.api [None req-055e4f09-feae-4ef3-90d4-68a7777c7a9e tempest-TestVolumeBootPattern-1304354335 tempest-TestVolumeBootPattern-1304354335-project] [instance: 91eb2cfb-795d-4d5c-8921-892b58ae4fa6] Fetching instance by UUID {{(pid=129322) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:53:46.680240 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-055e4f09-feae-4ef3-90d4-68a7777c7a9e tempest-TestVolumeBootPattern-1304354335 tempest-TestVolumeBootPattern-1304354335-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:53:46.681027 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-055e4f09-feae-4ef3-90d4-68a7777c7a9e tempest-TestVolumeBootPattern-1304354335 tempest-TestVolumeBootPattern-1304354335-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:53:46.682012 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-055e4f09-feae-4ef3-90d4-68a7777c7a9e tempest-TestVolumeBootPattern-1304354335 tempest-TestVolumeBootPattern-1304354335-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:53:46.682651 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-055e4f09-feae-4ef3-90d4-68a7777c7a9e tempest-TestVolumeBootPattern-1304354335 tempest-TestVolumeBootPattern-1304354335-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:53:46.706340 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG dbcounter [-] [129322] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=129322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:53:46.780911 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi [req-8bbbd81e-0f76-4ffb-b85c-1ad8c5ffd703 req-8660ee3f-4820-44c4-ab55-d05e4cfd456d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e9e3e084-4a1a-4d21-b2e9-b51f79287094", "tag": "9e80b77e-f708-4605-b98a-5347a654dd4b"}]} {{(pid=129321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 12:53:46.793746 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [req-8bbbd81e-0f76-4ffb-b85c-1ad8c5ffd703 req-8660ee3f-4820-44c4-ab55-d05e4cfd456d service nova] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:53:46.794198 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [req-8bbbd81e-0f76-4ffb-b85c-1ad8c5ffd703 req-8660ee3f-4820-44c4-ab55-d05e4cfd456d service nova] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:53:46.820821 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: INFO nova.api.openstack.compute.server_external_events [req-8bbbd81e-0f76-4ffb-b85c-1ad8c5ffd703 req-8660ee3f-4820-44c4-ab55-d05e4cfd456d service nova] Creating event network-changed:9e80b77e-f708-4605-b98a-5347a654dd4b for instance e9e3e084-4a1a-4d21-b2e9-b51f79287094 on hv-cinder-81966 May 26 12:53:46.826148 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: INFO nova.api.openstack.requestlog [req-8bbbd81e-0f76-4ffb-b85c-1ad8c5ffd703 req-8660ee3f-4820-44c4-ab55-d05e4cfd456d service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050077 May 26 12:53:46.827470 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: [pid: 129321|app: 0|req: 590/1201] 10.222.0.75 () {64 vars in 1317 bytes} [Thu May 26 12:53:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 26 12:53:46.853783 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.policy [None req-055e4f09-feae-4ef3-90d4-68a7777c7a9e tempest-TestVolumeBootPattern-1304354335 tempest-TestVolumeBootPattern-1304354335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab469b18ce0444d9884cdddc34ef7247', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fb41c547884511893b768b833f4e90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129322) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:53:46.863177 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: INFO nova.api.openstack.requestlog [None req-055e4f09-feae-4ef3-90d4-68a7777c7a9e tempest-TestVolumeBootPattern-1304354335 tempest-TestVolumeBootPattern-1304354335-project] 10.222.0.75 "GET /compute/v2.1/servers/91eb2cfb-795d-4d5c-8921-892b58ae4fa6" status: 200 len: 1577 microversion: 2.1 time: 0.198095 May 26 12:53:46.863804 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: [pid: 129322|app: 0|req: 612/1202] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 26 12:53:46 2022] GET /compute/v2.1/servers/91eb2cfb-795d-4d5c-8921-892b58ae4fa6 => generated 1577 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:53:47.492304 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi [None req-577a30b8-b18d-4482-a3b8-cae47b104923 tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] Calling method '>' {{(pid=129321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:53:47.493013 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.compute.api [None req-577a30b8-b18d-4482-a3b8-cae47b104923 tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] [instance: e9e3e084-4a1a-4d21-b2e9-b51f79287094] Fetching instance by UUID {{(pid=129321) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:53:47.500514 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-577a30b8-b18d-4482-a3b8-cae47b104923 tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:53:47.501054 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-577a30b8-b18d-4482-a3b8-cae47b104923 tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:53:47.501927 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-577a30b8-b18d-4482-a3b8-cae47b104923 tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:53:47.502459 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-577a30b8-b18d-4482-a3b8-cae47b104923 tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:53:47.649074 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.policy [None req-577a30b8-b18d-4482-a3b8-cae47b104923 tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eddc5d9ac2a74507bca19e06f0051ae1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93d5b6bba38643bfb76f083e230b3d22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129321) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:53:47.658761 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: INFO nova.api.openstack.requestlog [None req-577a30b8-b18d-4482-a3b8-cae47b104923 tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] 10.222.0.75 "GET /compute/v2.1/servers/e9e3e084-4a1a-4d21-b2e9-b51f79287094" status: 200 len: 1368 microversion: 2.1 time: 0.171377 May 26 12:53:47.659506 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: [pid: 129321|app: 0|req: 591/1203] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 26 12:53:47 2022] GET /compute/v2.1/servers/e9e3e084-4a1a-4d21-b2e9-b51f79287094 => generated 1368 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:53:47.880543 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi [None req-76815157-e6d4-404e-8b15-52875445077c tempest-TestVolumeBootPattern-1304354335 tempest-TestVolumeBootPattern-1304354335-project] Calling method '>' {{(pid=129322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:53:47.881098 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.compute.api [None req-76815157-e6d4-404e-8b15-52875445077c tempest-TestVolumeBootPattern-1304354335 tempest-TestVolumeBootPattern-1304354335-project] [instance: 91eb2cfb-795d-4d5c-8921-892b58ae4fa6] Fetching instance by UUID {{(pid=129322) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:53:47.888005 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-76815157-e6d4-404e-8b15-52875445077c tempest-TestVolumeBootPattern-1304354335 tempest-TestVolumeBootPattern-1304354335-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:53:47.888451 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-76815157-e6d4-404e-8b15-52875445077c tempest-TestVolumeBootPattern-1304354335 tempest-TestVolumeBootPattern-1304354335-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:53:47.889203 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-76815157-e6d4-404e-8b15-52875445077c tempest-TestVolumeBootPattern-1304354335 tempest-TestVolumeBootPattern-1304354335-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:53:47.889630 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-76815157-e6d4-404e-8b15-52875445077c tempest-TestVolumeBootPattern-1304354335 tempest-TestVolumeBootPattern-1304354335-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:53:48.024524 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.policy [None req-76815157-e6d4-404e-8b15-52875445077c tempest-TestVolumeBootPattern-1304354335 tempest-TestVolumeBootPattern-1304354335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab469b18ce0444d9884cdddc34ef7247', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fb41c547884511893b768b833f4e90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129322) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:53:48.033987 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: INFO nova.api.openstack.requestlog [None req-76815157-e6d4-404e-8b15-52875445077c tempest-TestVolumeBootPattern-1304354335 tempest-TestVolumeBootPattern-1304354335-project] 10.222.0.75 "GET /compute/v2.1/servers/91eb2cfb-795d-4d5c-8921-892b58ae4fa6" status: 200 len: 1577 microversion: 2.1 time: 0.157370 May 26 12:53:48.034782 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: [pid: 129322|app: 0|req: 613/1204] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 26 12:53:47 2022] GET /compute/v2.1/servers/91eb2cfb-795d-4d5c-8921-892b58ae4fa6 => generated 1577 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:53:48.679455 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi [None req-236b7652-87dc-4740-9348-9c7f89f9ae52 tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] Calling method '>' {{(pid=129321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:53:48.680128 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.compute.api [None req-236b7652-87dc-4740-9348-9c7f89f9ae52 tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] [instance: e9e3e084-4a1a-4d21-b2e9-b51f79287094] Fetching instance by UUID {{(pid=129321) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:53:48.689925 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-236b7652-87dc-4740-9348-9c7f89f9ae52 tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:53:48.690365 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-236b7652-87dc-4740-9348-9c7f89f9ae52 tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:53:48.691118 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-236b7652-87dc-4740-9348-9c7f89f9ae52 tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:53:48.691514 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-236b7652-87dc-4740-9348-9c7f89f9ae52 tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:53:49.010062 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.policy [None req-236b7652-87dc-4740-9348-9c7f89f9ae52 tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eddc5d9ac2a74507bca19e06f0051ae1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93d5b6bba38643bfb76f083e230b3d22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129321) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:53:49.018998 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: INFO nova.api.openstack.requestlog [None req-236b7652-87dc-4740-9348-9c7f89f9ae52 tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] 10.222.0.75 "GET /compute/v2.1/servers/e9e3e084-4a1a-4d21-b2e9-b51f79287094" status: 200 len: 1368 microversion: 2.1 time: 0.345765 May 26 12:53:49.026717 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: [pid: 129321|app: 0|req: 592/1205] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 26 12:53:48 2022] GET /compute/v2.1/servers/e9e3e084-4a1a-4d21-b2e9-b51f79287094 => generated 1368 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:53:49.053773 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi [None req-ce717def-cbea-48bc-a459-e5d2a2f2d958 tempest-TestVolumeBootPattern-1304354335 tempest-TestVolumeBootPattern-1304354335-project] Calling method '>' {{(pid=129322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:53:49.054384 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.compute.api [None req-ce717def-cbea-48bc-a459-e5d2a2f2d958 tempest-TestVolumeBootPattern-1304354335 tempest-TestVolumeBootPattern-1304354335-project] [instance: 91eb2cfb-795d-4d5c-8921-892b58ae4fa6] Fetching instance by UUID {{(pid=129322) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:53:49.061898 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-ce717def-cbea-48bc-a459-e5d2a2f2d958 tempest-TestVolumeBootPattern-1304354335 tempest-TestVolumeBootPattern-1304354335-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:53:49.062196 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-ce717def-cbea-48bc-a459-e5d2a2f2d958 tempest-TestVolumeBootPattern-1304354335 tempest-TestVolumeBootPattern-1304354335-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:53:49.063348 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-ce717def-cbea-48bc-a459-e5d2a2f2d958 tempest-TestVolumeBootPattern-1304354335 tempest-TestVolumeBootPattern-1304354335-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:53:49.063726 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-ce717def-cbea-48bc-a459-e5d2a2f2d958 tempest-TestVolumeBootPattern-1304354335 tempest-TestVolumeBootPattern-1304354335-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:53:49.207734 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.policy [None req-ce717def-cbea-48bc-a459-e5d2a2f2d958 tempest-TestVolumeBootPattern-1304354335 tempest-TestVolumeBootPattern-1304354335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab469b18ce0444d9884cdddc34ef7247', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fb41c547884511893b768b833f4e90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129322) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:53:49.216108 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: INFO nova.api.openstack.requestlog [None req-ce717def-cbea-48bc-a459-e5d2a2f2d958 tempest-TestVolumeBootPattern-1304354335 tempest-TestVolumeBootPattern-1304354335-project] 10.222.0.75 "GET /compute/v2.1/servers/91eb2cfb-795d-4d5c-8921-892b58ae4fa6" status: 200 len: 1577 microversion: 2.1 time: 0.166234 May 26 12:53:49.226151 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: [pid: 129322|app: 0|req: 614/1206] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 26 12:53:49 2022] GET /compute/v2.1/servers/91eb2cfb-795d-4d5c-8921-892b58ae4fa6 => generated 1577 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:53:49.319833 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi [None req-45d45ffd-4128-4f81-898a-89e9ceaf6913 tempest-AttachVolumeTestJSON-1454716698 tempest-AttachVolumeTestJSON-1454716698-project] Calling method '>' {{(pid=129321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:53:49.320724 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.compute.api [None req-45d45ffd-4128-4f81-898a-89e9ceaf6913 tempest-AttachVolumeTestJSON-1454716698 tempest-AttachVolumeTestJSON-1454716698-project] [instance: 98a9eaba-a08a-4883-9549-883c38590393] Fetching instance by UUID {{(pid=129321) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:53:49.326864 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-45d45ffd-4128-4f81-898a-89e9ceaf6913 tempest-AttachVolumeTestJSON-1454716698 tempest-AttachVolumeTestJSON-1454716698-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:53:49.327313 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-45d45ffd-4128-4f81-898a-89e9ceaf6913 tempest-AttachVolumeTestJSON-1454716698 tempest-AttachVolumeTestJSON-1454716698-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:53:49.328486 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-45d45ffd-4128-4f81-898a-89e9ceaf6913 tempest-AttachVolumeTestJSON-1454716698 tempest-AttachVolumeTestJSON-1454716698-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:53:49.328925 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-45d45ffd-4128-4f81-898a-89e9ceaf6913 tempest-AttachVolumeTestJSON-1454716698 tempest-AttachVolumeTestJSON-1454716698-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:53:49.359846 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: INFO nova.api.openstack.requestlog [None req-45d45ffd-4128-4f81-898a-89e9ceaf6913 tempest-AttachVolumeTestJSON-1454716698 tempest-AttachVolumeTestJSON-1454716698-project] 10.222.0.75 "GET /compute/v2.1/servers/98a9eaba-a08a-4883-9549-883c38590393/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043972 May 26 12:53:49.360380 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: [pid: 129321|app: 0|req: 593/1207] 10.222.0.75 () {58 vars in 1301 bytes} [Thu May 26 12:53:49 2022] GET /compute/v2.1/servers/98a9eaba-a08a-4883-9549-883c38590393/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 12:53:49.371107 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi [None req-c37ed36d-15e1-47b2-8b19-a9694072eff0 tempest-AttachVolumeTestJSON-1454716698 tempest-AttachVolumeTestJSON-1454716698-project] Calling method '>' {{(pid=129322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:53:49.371735 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.compute.api [None req-c37ed36d-15e1-47b2-8b19-a9694072eff0 tempest-AttachVolumeTestJSON-1454716698 tempest-AttachVolumeTestJSON-1454716698-project] [instance: 98a9eaba-a08a-4883-9549-883c38590393] Fetching instance by UUID {{(pid=129322) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:53:49.378061 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-c37ed36d-15e1-47b2-8b19-a9694072eff0 tempest-AttachVolumeTestJSON-1454716698 tempest-AttachVolumeTestJSON-1454716698-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:53:49.378510 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-c37ed36d-15e1-47b2-8b19-a9694072eff0 tempest-AttachVolumeTestJSON-1454716698 tempest-AttachVolumeTestJSON-1454716698-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:53:49.379280 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-c37ed36d-15e1-47b2-8b19-a9694072eff0 tempest-AttachVolumeTestJSON-1454716698 tempest-AttachVolumeTestJSON-1454716698-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:53:49.379925 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-c37ed36d-15e1-47b2-8b19-a9694072eff0 tempest-AttachVolumeTestJSON-1454716698 tempest-AttachVolumeTestJSON-1454716698-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:53:49.410336 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: INFO nova.api.openstack.requestlog [None req-c37ed36d-15e1-47b2-8b19-a9694072eff0 tempest-AttachVolumeTestJSON-1454716698 tempest-AttachVolumeTestJSON-1454716698-project] 10.222.0.75 "GET /compute/v2.1/servers/98a9eaba-a08a-4883-9549-883c38590393/os-volume_attachments/ff4dff63-7462-48ff-baf9-ed19b3ff48b4" status: 200 len: 194 microversion: 2.1 time: 0.043473 May 26 12:53:49.410938 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: [pid: 129322|app: 0|req: 615/1208] 10.222.0.75 () {58 vars in 1412 bytes} [Thu May 26 12:53:49 2022] GET /compute/v2.1/servers/98a9eaba-a08a-4883-9549-883c38590393/os-volume_attachments/ff4dff63-7462-48ff-baf9-ed19b3ff48b4 => generated 194 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 12:53:49.925751 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi [req-70d6f5d0-a084-4608-81be-1aa767578c9c req-0588e21d-bc61-48c4-9e16-1f5f28da58e4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "91eb2cfb-795d-4d5c-8921-892b58ae4fa6", "name": "network-vif-deleted", "tag": "fefc8d50-0c80-4088-adf1-045e8ac58366"}]} {{(pid=129321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 12:53:49.938801 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [req-70d6f5d0-a084-4608-81be-1aa767578c9c req-0588e21d-bc61-48c4-9e16-1f5f28da58e4 service nova] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:53:49.939182 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [req-70d6f5d0-a084-4608-81be-1aa767578c9c req-0588e21d-bc61-48c4-9e16-1f5f28da58e4 service nova] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:53:49.950602 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: INFO nova.api.openstack.compute.server_external_events [req-70d6f5d0-a084-4608-81be-1aa767578c9c req-0588e21d-bc61-48c4-9e16-1f5f28da58e4 service nova] Creating event network-vif-deleted:fefc8d50-0c80-4088-adf1-045e8ac58366 for instance 91eb2cfb-795d-4d5c-8921-892b58ae4fa6 on hv-cinder-81966 May 26 12:53:49.955778 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: INFO nova.api.openstack.requestlog [req-70d6f5d0-a084-4608-81be-1aa767578c9c req-0588e21d-bc61-48c4-9e16-1f5f28da58e4 service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036817 May 26 12:53:49.956358 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: [pid: 129321|app: 0|req: 594/1209] 10.222.0.75 () {64 vars in 1317 bytes} [Thu May 26 12:53:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 12:53:50.036583 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi [None req-3c2b047d-2556-44ca-9b5d-9b420b496f3c tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] Calling method '>' {{(pid=129322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:53:50.037190 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.compute.api [None req-3c2b047d-2556-44ca-9b5d-9b420b496f3c tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] [instance: e9e3e084-4a1a-4d21-b2e9-b51f79287094] Fetching instance by UUID {{(pid=129322) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:53:50.044027 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-3c2b047d-2556-44ca-9b5d-9b420b496f3c tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:53:50.044488 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-3c2b047d-2556-44ca-9b5d-9b420b496f3c tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:53:50.045267 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-3c2b047d-2556-44ca-9b5d-9b420b496f3c tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:53:50.045695 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-3c2b047d-2556-44ca-9b5d-9b420b496f3c tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:53:50.193363 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.policy [None req-3c2b047d-2556-44ca-9b5d-9b420b496f3c tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eddc5d9ac2a74507bca19e06f0051ae1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93d5b6bba38643bfb76f083e230b3d22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129322) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:53:50.201835 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: INFO nova.api.openstack.requestlog [None req-3c2b047d-2556-44ca-9b5d-9b420b496f3c tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] 10.222.0.75 "GET /compute/v2.1/servers/e9e3e084-4a1a-4d21-b2e9-b51f79287094" status: 200 len: 1368 microversion: 2.1 time: 0.169067 May 26 12:53:50.202411 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: [pid: 129322|app: 0|req: 616/1210] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 26 12:53:50 2022] GET /compute/v2.1/servers/e9e3e084-4a1a-4d21-b2e9-b51f79287094 => generated 1368 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:53:50.234483 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi [None req-30c63b92-e318-4928-902d-201a96b1865e tempest-TestVolumeBootPattern-1304354335 tempest-TestVolumeBootPattern-1304354335-project] Calling method '>' {{(pid=129321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:53:50.235275 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.compute.api [None req-30c63b92-e318-4928-902d-201a96b1865e tempest-TestVolumeBootPattern-1304354335 tempest-TestVolumeBootPattern-1304354335-project] [instance: 91eb2cfb-795d-4d5c-8921-892b58ae4fa6] Fetching instance by UUID {{(pid=129321) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:53:50.242463 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-30c63b92-e318-4928-902d-201a96b1865e tempest-TestVolumeBootPattern-1304354335 tempest-TestVolumeBootPattern-1304354335-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:53:50.242984 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-30c63b92-e318-4928-902d-201a96b1865e tempest-TestVolumeBootPattern-1304354335 tempest-TestVolumeBootPattern-1304354335-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:53:50.243905 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-30c63b92-e318-4928-902d-201a96b1865e tempest-TestVolumeBootPattern-1304354335 tempest-TestVolumeBootPattern-1304354335-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:53:50.244401 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-30c63b92-e318-4928-902d-201a96b1865e tempest-TestVolumeBootPattern-1304354335 tempest-TestVolumeBootPattern-1304354335-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:53:50.319530 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.policy [None req-30c63b92-e318-4928-902d-201a96b1865e tempest-TestVolumeBootPattern-1304354335 tempest-TestVolumeBootPattern-1304354335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab469b18ce0444d9884cdddc34ef7247', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fb41c547884511893b768b833f4e90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129321) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:53:50.331435 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: INFO nova.api.openstack.requestlog [None req-30c63b92-e318-4928-902d-201a96b1865e tempest-TestVolumeBootPattern-1304354335 tempest-TestVolumeBootPattern-1304354335-project] 10.222.0.75 "GET /compute/v2.1/servers/91eb2cfb-795d-4d5c-8921-892b58ae4fa6" status: 200 len: 1391 microversion: 2.1 time: 0.101113 May 26 12:53:50.332285 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: [pid: 129321|app: 0|req: 595/1211] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 26 12:53:50 2022] GET /compute/v2.1/servers/91eb2cfb-795d-4d5c-8921-892b58ae4fa6 => generated 1391 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:53:50.774513 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi [None req-25e18d37-731e-494c-bb4c-1fd4bee3a911 tempest-AttachVolumeTestJSON-1454716698 tempest-AttachVolumeTestJSON-1454716698-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "14143583-df79-4558-8131-18745fce9ed9"}} {{(pid=129322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 12:53:50.776094 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.compute.api [None req-25e18d37-731e-494c-bb4c-1fd4bee3a911 tempest-AttachVolumeTestJSON-1454716698 tempest-AttachVolumeTestJSON-1454716698-project] [instance: 98a9eaba-a08a-4883-9549-883c38590393] Fetching instance by UUID {{(pid=129322) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:53:50.784639 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-25e18d37-731e-494c-bb4c-1fd4bee3a911 tempest-AttachVolumeTestJSON-1454716698 tempest-AttachVolumeTestJSON-1454716698-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:53:50.785096 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-25e18d37-731e-494c-bb4c-1fd4bee3a911 tempest-AttachVolumeTestJSON-1454716698 tempest-AttachVolumeTestJSON-1454716698-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:53:50.785836 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-25e18d37-731e-494c-bb4c-1fd4bee3a911 tempest-AttachVolumeTestJSON-1454716698 tempest-AttachVolumeTestJSON-1454716698-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:53:50.786263 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-25e18d37-731e-494c-bb4c-1fd4bee3a911 tempest-AttachVolumeTestJSON-1454716698 tempest-AttachVolumeTestJSON-1454716698-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:53:51.219584 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi [None req-0918bc71-ee67-476b-91a1-f83a42a0f508 tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] Calling method '>' {{(pid=129321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:53:51.220160 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.compute.api [None req-0918bc71-ee67-476b-91a1-f83a42a0f508 tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] [instance: e9e3e084-4a1a-4d21-b2e9-b51f79287094] Fetching instance by UUID {{(pid=129321) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:53:51.227099 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-0918bc71-ee67-476b-91a1-f83a42a0f508 tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:53:51.227569 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-0918bc71-ee67-476b-91a1-f83a42a0f508 tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:53:51.228322 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-0918bc71-ee67-476b-91a1-f83a42a0f508 tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:53:51.228749 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-0918bc71-ee67-476b-91a1-f83a42a0f508 tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:53:51.365910 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.policy [None req-0918bc71-ee67-476b-91a1-f83a42a0f508 tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eddc5d9ac2a74507bca19e06f0051ae1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93d5b6bba38643bfb76f083e230b3d22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129321) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:53:51.373440 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: INFO nova.api.openstack.requestlog [None req-0918bc71-ee67-476b-91a1-f83a42a0f508 tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] 10.222.0.75 "GET /compute/v2.1/servers/e9e3e084-4a1a-4d21-b2e9-b51f79287094" status: 200 len: 1368 microversion: 2.1 time: 0.157869 May 26 12:53:51.374008 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: [pid: 129321|app: 0|req: 596/1212] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 26 12:53:51 2022] GET /compute/v2.1/servers/e9e3e084-4a1a-4d21-b2e9-b51f79287094 => generated 1368 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:53:51.378637 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi [None req-ec9a910e-f27e-4416-aed4-2876cc9e36c4 tempest-TestVolumeBootPattern-1304354335 tempest-TestVolumeBootPattern-1304354335-project] Calling method '>' {{(pid=129321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:53:51.379234 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.compute.api [None req-ec9a910e-f27e-4416-aed4-2876cc9e36c4 tempest-TestVolumeBootPattern-1304354335 tempest-TestVolumeBootPattern-1304354335-project] [instance: 91eb2cfb-795d-4d5c-8921-892b58ae4fa6] Fetching instance by UUID {{(pid=129321) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:53:51.385291 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-ec9a910e-f27e-4416-aed4-2876cc9e36c4 tempest-TestVolumeBootPattern-1304354335 tempest-TestVolumeBootPattern-1304354335-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:53:51.385730 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-ec9a910e-f27e-4416-aed4-2876cc9e36c4 tempest-TestVolumeBootPattern-1304354335 tempest-TestVolumeBootPattern-1304354335-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:53:51.386482 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-ec9a910e-f27e-4416-aed4-2876cc9e36c4 tempest-TestVolumeBootPattern-1304354335 tempest-TestVolumeBootPattern-1304354335-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:53:51.386907 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-ec9a910e-f27e-4416-aed4-2876cc9e36c4 tempest-TestVolumeBootPattern-1304354335 tempest-TestVolumeBootPattern-1304354335-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:53:51.449440 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.policy [None req-ec9a910e-f27e-4416-aed4-2876cc9e36c4 tempest-TestVolumeBootPattern-1304354335 tempest-TestVolumeBootPattern-1304354335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab469b18ce0444d9884cdddc34ef7247', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fb41c547884511893b768b833f4e90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129321) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:53:51.457347 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: INFO nova.api.openstack.requestlog [None req-ec9a910e-f27e-4416-aed4-2876cc9e36c4 tempest-TestVolumeBootPattern-1304354335 tempest-TestVolumeBootPattern-1304354335-project] 10.222.0.75 "GET /compute/v2.1/servers/91eb2cfb-795d-4d5c-8921-892b58ae4fa6" status: 200 len: 1391 microversion: 2.1 time: 0.082392 May 26 12:53:51.458164 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: [pid: 129321|app: 0|req: 597/1213] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 26 12:53:51 2022] GET /compute/v2.1/servers/91eb2cfb-795d-4d5c-8921-892b58ae4fa6 => generated 1391 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:53:52.291561 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: INFO nova.api.openstack.requestlog [None req-25e18d37-731e-494c-bb4c-1fd4bee3a911 tempest-AttachVolumeTestJSON-1454716698 tempest-AttachVolumeTestJSON-1454716698-project] 10.222.0.75 "POST /compute/v2.1/servers/98a9eaba-a08a-4883-9549-883c38590393/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.520660 May 26 12:53:52.292245 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: [pid: 129322|app: 0|req: 617/1214] 10.222.0.75 () {60 vars in 1322 bytes} [Thu May 26 12:53:50 2022] POST /compute/v2.1/servers/98a9eaba-a08a-4883-9549-883c38590393/os-volume_attachments => generated 194 bytes in 1523 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 12:53:52.391086 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi [None req-3ed8cc86-fdee-4ed1-9b3d-32aadf16bd65 tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] Calling method '>' {{(pid=129321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:53:52.391730 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.compute.api [None req-3ed8cc86-fdee-4ed1-9b3d-32aadf16bd65 tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] [instance: e9e3e084-4a1a-4d21-b2e9-b51f79287094] Fetching instance by UUID {{(pid=129321) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:53:52.399142 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-3ed8cc86-fdee-4ed1-9b3d-32aadf16bd65 tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:53:52.399900 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-3ed8cc86-fdee-4ed1-9b3d-32aadf16bd65 tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:53:52.400661 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-3ed8cc86-fdee-4ed1-9b3d-32aadf16bd65 tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:53:52.401087 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-3ed8cc86-fdee-4ed1-9b3d-32aadf16bd65 tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:53:52.476253 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi [None req-19ff9bdf-a122-4fa3-afb7-6e2bb12498b6 tempest-TestVolumeBootPattern-1304354335 tempest-TestVolumeBootPattern-1304354335-project] Calling method '>' {{(pid=129322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:53:52.477059 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.compute.api [None req-19ff9bdf-a122-4fa3-afb7-6e2bb12498b6 tempest-TestVolumeBootPattern-1304354335 tempest-TestVolumeBootPattern-1304354335-project] [instance: 91eb2cfb-795d-4d5c-8921-892b58ae4fa6] Fetching instance by UUID {{(pid=129322) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:53:52.486212 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-19ff9bdf-a122-4fa3-afb7-6e2bb12498b6 tempest-TestVolumeBootPattern-1304354335 tempest-TestVolumeBootPattern-1304354335-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:53:52.486955 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-19ff9bdf-a122-4fa3-afb7-6e2bb12498b6 tempest-TestVolumeBootPattern-1304354335 tempest-TestVolumeBootPattern-1304354335-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:53:52.488040 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-19ff9bdf-a122-4fa3-afb7-6e2bb12498b6 tempest-TestVolumeBootPattern-1304354335 tempest-TestVolumeBootPattern-1304354335-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:53:52.489010 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-19ff9bdf-a122-4fa3-afb7-6e2bb12498b6 tempest-TestVolumeBootPattern-1304354335 tempest-TestVolumeBootPattern-1304354335-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:53:52.527787 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-19ff9bdf-a122-4fa3-afb7-6e2bb12498b6 tempest-TestVolumeBootPattern-1304354335 tempest-TestVolumeBootPattern-1304354335-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:53:52.528374 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-19ff9bdf-a122-4fa3-afb7-6e2bb12498b6 tempest-TestVolumeBootPattern-1304354335 tempest-TestVolumeBootPattern-1304354335-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:53:52.529076 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.objects.instance [None req-19ff9bdf-a122-4fa3-afb7-6e2bb12498b6 tempest-TestVolumeBootPattern-1304354335 tempest-TestVolumeBootPattern-1304354335-project] Lazy-loading 'fault' on Instance uuid 91eb2cfb-795d-4d5c-8921-892b58ae4fa6 {{(pid=129322) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 26 12:53:52.555947 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.policy [None req-3ed8cc86-fdee-4ed1-9b3d-32aadf16bd65 tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eddc5d9ac2a74507bca19e06f0051ae1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93d5b6bba38643bfb76f083e230b3d22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129321) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:53:52.563373 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: INFO nova.api.openstack.requestlog [None req-3ed8cc86-fdee-4ed1-9b3d-32aadf16bd65 tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] 10.222.0.75 "GET /compute/v2.1/servers/e9e3e084-4a1a-4d21-b2e9-b51f79287094" status: 200 len: 1368 microversion: 2.1 time: 0.176834 May 26 12:53:52.563978 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: [pid: 129321|app: 0|req: 598/1215] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 26 12:53:52 2022] GET /compute/v2.1/servers/e9e3e084-4a1a-4d21-b2e9-b51f79287094 => generated 1368 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:53:52.574033 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.policy [None req-19ff9bdf-a122-4fa3-afb7-6e2bb12498b6 tempest-TestVolumeBootPattern-1304354335 tempest-TestVolumeBootPattern-1304354335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab469b18ce0444d9884cdddc34ef7247', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fb41c547884511893b768b833f4e90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129322) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:53:52.583616 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: INFO nova.api.openstack.requestlog [None req-19ff9bdf-a122-4fa3-afb7-6e2bb12498b6 tempest-TestVolumeBootPattern-1304354335 tempest-TestVolumeBootPattern-1304354335-project] 10.222.0.75 "GET /compute/v2.1/servers/91eb2cfb-795d-4d5c-8921-892b58ae4fa6" status: 200 len: 1230 microversion: 2.1 time: 0.113032 May 26 12:53:52.584206 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: [pid: 129322|app: 0|req: 618/1216] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 26 12:53:52 2022] GET /compute/v2.1/servers/91eb2cfb-795d-4d5c-8921-892b58ae4fa6 => generated 1230 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:53:53.581005 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi [None req-b956df9c-4f57-4e6c-b7e2-7d1b158f8d4e tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] Calling method '>' {{(pid=129321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:53:53.581564 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.compute.api [None req-b956df9c-4f57-4e6c-b7e2-7d1b158f8d4e tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] [instance: e9e3e084-4a1a-4d21-b2e9-b51f79287094] Fetching instance by UUID {{(pid=129321) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:53:53.588702 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-b956df9c-4f57-4e6c-b7e2-7d1b158f8d4e tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:53:53.589148 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-b956df9c-4f57-4e6c-b7e2-7d1b158f8d4e tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:53:53.589901 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-b956df9c-4f57-4e6c-b7e2-7d1b158f8d4e tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:53:53.590330 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-b956df9c-4f57-4e6c-b7e2-7d1b158f8d4e tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:53:53.602107 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi [None req-464e2dc7-6796-4fdf-9e79-66fccea0a6a8 tempest-TestVolumeBootPattern-1304354335 tempest-TestVolumeBootPattern-1304354335-project] Calling method '>' {{(pid=129322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:53:53.602887 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.compute.api [None req-464e2dc7-6796-4fdf-9e79-66fccea0a6a8 tempest-TestVolumeBootPattern-1304354335 tempest-TestVolumeBootPattern-1304354335-project] [instance: 91eb2cfb-795d-4d5c-8921-892b58ae4fa6] Fetching instance by UUID {{(pid=129322) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:53:53.609722 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-464e2dc7-6796-4fdf-9e79-66fccea0a6a8 tempest-TestVolumeBootPattern-1304354335 tempest-TestVolumeBootPattern-1304354335-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:53:53.610170 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-464e2dc7-6796-4fdf-9e79-66fccea0a6a8 tempest-TestVolumeBootPattern-1304354335 tempest-TestVolumeBootPattern-1304354335-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:53:53.610929 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-464e2dc7-6796-4fdf-9e79-66fccea0a6a8 tempest-TestVolumeBootPattern-1304354335 tempest-TestVolumeBootPattern-1304354335-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:53:53.611363 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-464e2dc7-6796-4fdf-9e79-66fccea0a6a8 tempest-TestVolumeBootPattern-1304354335 tempest-TestVolumeBootPattern-1304354335-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:53:53.627474 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: INFO nova.api.openstack.wsgi [None req-464e2dc7-6796-4fdf-9e79-66fccea0a6a8 tempest-TestVolumeBootPattern-1304354335 tempest-TestVolumeBootPattern-1304354335-project] HTTP exception thrown: Instance 91eb2cfb-795d-4d5c-8921-892b58ae4fa6 could not be found. May 26 12:53:53.629173 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi [None req-464e2dc7-6796-4fdf-9e79-66fccea0a6a8 tempest-TestVolumeBootPattern-1304354335 tempest-TestVolumeBootPattern-1304354335-project] Request method failure captured: May 26 12:53:53.629173 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: request: GET /compute/v2.1/servers/91eb2cfb-795d-4d5c-8921-892b58ae4fa6 HTTP/1.1 May 26 12:53:53.629173 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: Accept: application/json May 26 12:53:53.629173 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: Accept-Encoding: identity May 26 12:53:53.629173 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: Connection: close May 26 12:53:53.629173 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: Content-Length: 0 May 26 12:53:53.629173 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: Content-Type: application/json May 26 12:53:53.629173 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: Host: 10.222.0.75 May 26 12:53:53.629173 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: Openstack-System-Scope: None May 26 12:53:53.629173 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: User-Agent: python-urllib3/1.26.9 May 26 12:53:53.629173 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: X-Auth-Token: gAAAAABij3ZYnnQSOjd0sWax7VYUWN6gzPhz8PA68yBKbpbl44ztpHdpGCRT5OTjH4mK7k5RUbM9n2BHMaQqTaPiaGVVrYiHYtBG0MmM1aMhd-X0oiDBwHF_1in7JqJZE2_08VQXydhfFCXEAAaHZONGGU73Q7O2hxQn12upcSRYehzmIlzQIBo May 26 12:53:53.629173 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: X-Domain-Id: None May 26 12:53:53.629173 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: X-Domain-Name: None May 26 12:53:53.629173 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: X-Identity-Status: Confirmed May 26 12:53:53.629173 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: X-Is-Admin-Project: True May 26 12:53:53.629173 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: X-Project-Domain-Id: default May 26 12:53:53.629173 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: X-Project-Domain-Name: Default May 26 12:53:53.629173 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: X-Project-Id: d6fb41c547884511893b768b833f4e90 May 26 12:53:53.629173 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: X-Project-Name: tempest-TestVolumeBootPattern-1304354335 May 26 12:53:53.629173 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: X-Role: member,reader May 26 12:53:53.629173 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: X-Roles: member,reader May 26 12:53:53.630929 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/d6fb41c547884511893b768b833f4e90"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.75:8080", "publicURL": "http://10.222.0.75:8080/v1/AUTH_d6fb41c547884511893b768b833f4e90"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2/d6fb41c547884511893b768b833f4e90"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/d6fb41c547884511893b768b833f4e90"}]}] May 26 12:53:53.630929 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: X-Tenant: tempest-TestVolumeBootPattern-1304354335 May 26 12:53:53.630929 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: X-Tenant-Id: d6fb41c547884511893b768b833f4e90 May 26 12:53:53.630929 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: X-Tenant-Name: tempest-TestVolumeBootPattern-1304354335 May 26 12:53:53.630929 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: X-User: tempest-TestVolumeBootPattern-1304354335-project May 26 12:53:53.630929 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: X-User-Domain-Id: default May 26 12:53:53.630929 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: X-User-Domain-Name: Default May 26 12:53:53.630929 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: X-User-Id: ab469b18ce0444d9884cdddc34ef7247 May 26 12:53:53.630929 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: X-User-Name: tempest-TestVolumeBootPattern-1304354335-project May 26 12:53:53.630929 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: method: > May 26 12:53:53.630929 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: exception: Instance 91eb2cfb-795d-4d5c-8921-892b58ae4fa6 could not be found. May 26 12:53:53.630929 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: action_args: {'id': '91eb2cfb-795d-4d5c-8921-892b58ae4fa6'} May 26 12:53:53.631928 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: {{(pid=129322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 12:53:53.631928 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 12:53:53.631928 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 26 12:53:53.631928 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 26 12:53:53.631928 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 26 12:53:53.631928 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 26 12:53:53.631928 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 26 12:53:53.631928 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 26 12:53:53.631928 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 26 12:53:53.631928 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 26 12:53:53.631928 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 91eb2cfb-795d-4d5c-8921-892b58ae4fa6 could not be found. May 26 12:53:53.631928 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi May 26 12:53:53.631928 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 12:53:53.631928 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi May 26 12:53:53.631928 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 12:53:53.631928 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 12:53:53.631928 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 12:53:53.631928 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 12:53:53.631928 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 12:53:53.631928 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 12:53:53.633340 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 12:53:53.633340 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 26 12:53:53.633340 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 26 12:53:53.633340 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 26 12:53:53.633340 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 26 12:53:53.633340 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 26 12:53:53.633340 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 12:53:53.633340 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 91eb2cfb-795d-4d5c-8921-892b58ae4fa6 could not be found. May 26 12:53:53.633340 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi May 26 12:53:53.633340 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 12:53:53.633340 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi May 26 12:53:53.633340 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 12:53:53.633340 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 12:53:53.633340 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 12:53:53.633340 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 12:53:53.633340 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 12:53:53.633340 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 91eb2cfb-795d-4d5c-8921-892b58ae4fa6 could not be found. May 26 12:53:53.633340 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi May 26 12:53:53.634446 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi [None req-464e2dc7-6796-4fdf-9e79-66fccea0a6a8 tempest-TestVolumeBootPattern-1304354335 tempest-TestVolumeBootPattern-1304354335-project] Returning 404 to user: Instance 91eb2cfb-795d-4d5c-8921-892b58ae4fa6 could not be found. {{(pid=129322) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 12:53:53.634446 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: INFO nova.api.openstack.requestlog [None req-464e2dc7-6796-4fdf-9e79-66fccea0a6a8 tempest-TestVolumeBootPattern-1304354335 tempest-TestVolumeBootPattern-1304354335-project] 10.222.0.75 "GET /compute/v2.1/servers/91eb2cfb-795d-4d5c-8921-892b58ae4fa6" status: 404 len: 111 microversion: 2.1 time: 0.033256 May 26 12:53:53.634446 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: [pid: 129322|app: 0|req: 619/1217] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 26 12:53:53 2022] GET /compute/v2.1/servers/91eb2cfb-795d-4d5c-8921-892b58ae4fa6 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 26 12:53:53.729532 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.policy [None req-b956df9c-4f57-4e6c-b7e2-7d1b158f8d4e tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eddc5d9ac2a74507bca19e06f0051ae1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93d5b6bba38643bfb76f083e230b3d22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129321) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:53:53.738933 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: INFO nova.api.openstack.requestlog [None req-b956df9c-4f57-4e6c-b7e2-7d1b158f8d4e tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] 10.222.0.75 "GET /compute/v2.1/servers/e9e3e084-4a1a-4d21-b2e9-b51f79287094" status: 200 len: 1368 microversion: 2.1 time: 0.161783 May 26 12:53:53.740012 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: [pid: 129321|app: 0|req: 599/1218] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 26 12:53:53 2022] GET /compute/v2.1/servers/e9e3e084-4a1a-4d21-b2e9-b51f79287094 => generated 1368 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:53:54.285108 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi [None req-cc4d691d-1959-46f1-a0fb-6336dc4bed13 tempest-TestVolumeBootPattern-1304354335 tempest-TestVolumeBootPattern-1304354335-project] Calling method '>' {{(pid=129322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:53:54.285640 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.compute.api [None req-cc4d691d-1959-46f1-a0fb-6336dc4bed13 tempest-TestVolumeBootPattern-1304354335 tempest-TestVolumeBootPattern-1304354335-project] [instance: 475179d2-21d7-4ace-90eb-e6525cb14928] Fetching instance by UUID {{(pid=129322) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:53:54.288390 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG dbcounter [-] [129322] Writing DB stats nova_cell0:SELECT=6 {{(pid=129322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:53:54.294186 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-cc4d691d-1959-46f1-a0fb-6336dc4bed13 tempest-TestVolumeBootPattern-1304354335 tempest-TestVolumeBootPattern-1304354335-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:53:54.294630 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-cc4d691d-1959-46f1-a0fb-6336dc4bed13 tempest-TestVolumeBootPattern-1304354335 tempest-TestVolumeBootPattern-1304354335-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:53:54.295376 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-cc4d691d-1959-46f1-a0fb-6336dc4bed13 tempest-TestVolumeBootPattern-1304354335 tempest-TestVolumeBootPattern-1304354335-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:53:54.295829 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-cc4d691d-1959-46f1-a0fb-6336dc4bed13 tempest-TestVolumeBootPattern-1304354335 tempest-TestVolumeBootPattern-1304354335-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:53:54.309257 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: INFO nova.api.openstack.wsgi [None req-cc4d691d-1959-46f1-a0fb-6336dc4bed13 tempest-TestVolumeBootPattern-1304354335 tempest-TestVolumeBootPattern-1304354335-project] HTTP exception thrown: Instance 475179d2-21d7-4ace-90eb-e6525cb14928 could not be found. May 26 12:53:54.310778 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi [None req-cc4d691d-1959-46f1-a0fb-6336dc4bed13 tempest-TestVolumeBootPattern-1304354335 tempest-TestVolumeBootPattern-1304354335-project] Request method failure captured: May 26 12:53:54.310778 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: request: DELETE /compute/v2.1/servers/475179d2-21d7-4ace-90eb-e6525cb14928 HTTP/1.1 May 26 12:53:54.310778 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: Accept: application/json May 26 12:53:54.310778 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: Accept-Encoding: identity May 26 12:53:54.310778 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: Connection: close May 26 12:53:54.310778 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: Content-Length: 0 May 26 12:53:54.310778 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: Content-Type: application/json May 26 12:53:54.310778 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: Host: 10.222.0.75 May 26 12:53:54.310778 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: Openstack-System-Scope: None May 26 12:53:54.310778 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: User-Agent: python-urllib3/1.26.9 May 26 12:53:54.310778 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: X-Auth-Token: gAAAAABij3ZYnnQSOjd0sWax7VYUWN6gzPhz8PA68yBKbpbl44ztpHdpGCRT5OTjH4mK7k5RUbM9n2BHMaQqTaPiaGVVrYiHYtBG0MmM1aMhd-X0oiDBwHF_1in7JqJZE2_08VQXydhfFCXEAAaHZONGGU73Q7O2hxQn12upcSRYehzmIlzQIBo May 26 12:53:54.310778 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: X-Domain-Id: None May 26 12:53:54.310778 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: X-Domain-Name: None May 26 12:53:54.310778 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: X-Identity-Status: Confirmed May 26 12:53:54.310778 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: X-Is-Admin-Project: True May 26 12:53:54.310778 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: X-Project-Domain-Id: default May 26 12:53:54.310778 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: X-Project-Domain-Name: Default May 26 12:53:54.310778 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: X-Project-Id: d6fb41c547884511893b768b833f4e90 May 26 12:53:54.310778 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: X-Project-Name: tempest-TestVolumeBootPattern-1304354335 May 26 12:53:54.310778 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: X-Role: member,reader May 26 12:53:54.310778 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: X-Roles: member,reader May 26 12:53:54.312418 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/d6fb41c547884511893b768b833f4e90"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.75:8080", "publicURL": "http://10.222.0.75:8080/v1/AUTH_d6fb41c547884511893b768b833f4e90"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2/d6fb41c547884511893b768b833f4e90"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/d6fb41c547884511893b768b833f4e90"}]}] May 26 12:53:54.312418 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: X-Tenant: tempest-TestVolumeBootPattern-1304354335 May 26 12:53:54.312418 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: X-Tenant-Id: d6fb41c547884511893b768b833f4e90 May 26 12:53:54.312418 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: X-Tenant-Name: tempest-TestVolumeBootPattern-1304354335 May 26 12:53:54.312418 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: X-User: tempest-TestVolumeBootPattern-1304354335-project May 26 12:53:54.312418 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: X-User-Domain-Id: default May 26 12:53:54.312418 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: X-User-Domain-Name: Default May 26 12:53:54.312418 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: X-User-Id: ab469b18ce0444d9884cdddc34ef7247 May 26 12:53:54.312418 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: X-User-Name: tempest-TestVolumeBootPattern-1304354335-project May 26 12:53:54.312418 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: method: > May 26 12:53:54.312418 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: exception: Instance 475179d2-21d7-4ace-90eb-e6525cb14928 could not be found. May 26 12:53:54.312418 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: action_args: {'id': '475179d2-21d7-4ace-90eb-e6525cb14928'} May 26 12:53:54.313318 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: {{(pid=129322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 12:53:54.313318 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 12:53:54.313318 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 26 12:53:54.313318 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 26 12:53:54.313318 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 26 12:53:54.313318 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 26 12:53:54.313318 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 26 12:53:54.313318 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 26 12:53:54.313318 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 26 12:53:54.313318 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 26 12:53:54.313318 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 475179d2-21d7-4ace-90eb-e6525cb14928 could not be found. May 26 12:53:54.313318 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi May 26 12:53:54.313318 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 12:53:54.313318 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi May 26 12:53:54.313318 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 12:53:54.313318 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 12:53:54.313318 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 12:53:54.313318 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 12:53:54.313318 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 12:53:54.313318 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 12:53:54.314737 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 12:53:54.314737 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 26 12:53:54.314737 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 26 12:53:54.314737 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 26 12:53:54.314737 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 26 12:53:54.314737 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 26 12:53:54.314737 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 26 12:53:54.314737 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 26 12:53:54.314737 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 12:53:54.314737 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 475179d2-21d7-4ace-90eb-e6525cb14928 could not be found. May 26 12:53:54.314737 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi May 26 12:53:54.314737 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 12:53:54.314737 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi May 26 12:53:54.314737 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 12:53:54.314737 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 12:53:54.314737 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 12:53:54.314737 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 12:53:54.314737 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 12:53:54.314737 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 475179d2-21d7-4ace-90eb-e6525cb14928 could not be found. May 26 12:53:54.314737 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi May 26 12:53:54.316260 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi [None req-cc4d691d-1959-46f1-a0fb-6336dc4bed13 tempest-TestVolumeBootPattern-1304354335 tempest-TestVolumeBootPattern-1304354335-project] Returning 404 to user: Instance 475179d2-21d7-4ace-90eb-e6525cb14928 could not be found. {{(pid=129322) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 12:53:54.316260 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: INFO nova.api.openstack.requestlog [None req-cc4d691d-1959-46f1-a0fb-6336dc4bed13 tempest-TestVolumeBootPattern-1304354335 tempest-TestVolumeBootPattern-1304354335-project] 10.222.0.75 "DELETE /compute/v2.1/servers/475179d2-21d7-4ace-90eb-e6525cb14928" status: 404 len: 111 microversion: 2.1 time: 0.031045 May 26 12:53:54.316260 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: [pid: 129322|app: 0|req: 620/1219] 10.222.0.75 () {58 vars in 1238 bytes} [Thu May 26 12:53:54 2022] DELETE /compute/v2.1/servers/475179d2-21d7-4ace-90eb-e6525cb14928 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 26 12:53:54.321388 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi [None req-a97267d0-a09a-40df-8cde-7c80560254eb tempest-TestVolumeBootPattern-1304354335 tempest-TestVolumeBootPattern-1304354335-project] Calling method '>' {{(pid=129321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:53:54.321990 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.compute.api [None req-a97267d0-a09a-40df-8cde-7c80560254eb tempest-TestVolumeBootPattern-1304354335 tempest-TestVolumeBootPattern-1304354335-project] [instance: 475179d2-21d7-4ace-90eb-e6525cb14928] Fetching instance by UUID {{(pid=129321) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:53:54.323989 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG dbcounter [-] [129321] Writing DB stats nova_cell0:SELECT=2 {{(pid=129321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:53:54.324641 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG dbcounter [-] [129321] Writing DB stats nova_cell0:SELECT=6 {{(pid=129321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:53:54.330458 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-a97267d0-a09a-40df-8cde-7c80560254eb tempest-TestVolumeBootPattern-1304354335 tempest-TestVolumeBootPattern-1304354335-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:53:54.330913 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-a97267d0-a09a-40df-8cde-7c80560254eb tempest-TestVolumeBootPattern-1304354335 tempest-TestVolumeBootPattern-1304354335-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:53:54.331697 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-a97267d0-a09a-40df-8cde-7c80560254eb tempest-TestVolumeBootPattern-1304354335 tempest-TestVolumeBootPattern-1304354335-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:53:54.332099 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-a97267d0-a09a-40df-8cde-7c80560254eb tempest-TestVolumeBootPattern-1304354335 tempest-TestVolumeBootPattern-1304354335-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:53:54.345995 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: INFO nova.api.openstack.wsgi [None req-a97267d0-a09a-40df-8cde-7c80560254eb tempest-TestVolumeBootPattern-1304354335 tempest-TestVolumeBootPattern-1304354335-project] HTTP exception thrown: Instance 475179d2-21d7-4ace-90eb-e6525cb14928 could not be found. May 26 12:53:54.347697 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi [None req-a97267d0-a09a-40df-8cde-7c80560254eb tempest-TestVolumeBootPattern-1304354335 tempest-TestVolumeBootPattern-1304354335-project] Request method failure captured: May 26 12:53:54.347697 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: request: GET /compute/v2.1/servers/475179d2-21d7-4ace-90eb-e6525cb14928 HTTP/1.1 May 26 12:53:54.347697 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: Accept: application/json May 26 12:53:54.347697 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: Accept-Encoding: identity May 26 12:53:54.347697 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: Connection: close May 26 12:53:54.347697 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: Content-Length: 0 May 26 12:53:54.347697 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: Content-Type: application/json May 26 12:53:54.347697 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: Host: 10.222.0.75 May 26 12:53:54.347697 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: Openstack-System-Scope: None May 26 12:53:54.347697 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: User-Agent: python-urllib3/1.26.9 May 26 12:53:54.347697 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: X-Auth-Token: gAAAAABij3ZYnnQSOjd0sWax7VYUWN6gzPhz8PA68yBKbpbl44ztpHdpGCRT5OTjH4mK7k5RUbM9n2BHMaQqTaPiaGVVrYiHYtBG0MmM1aMhd-X0oiDBwHF_1in7JqJZE2_08VQXydhfFCXEAAaHZONGGU73Q7O2hxQn12upcSRYehzmIlzQIBo May 26 12:53:54.347697 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: X-Domain-Id: None May 26 12:53:54.347697 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: X-Domain-Name: None May 26 12:53:54.347697 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: X-Identity-Status: Confirmed May 26 12:53:54.347697 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: X-Is-Admin-Project: True May 26 12:53:54.347697 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: X-Project-Domain-Id: default May 26 12:53:54.347697 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: X-Project-Domain-Name: Default May 26 12:53:54.347697 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: X-Project-Id: d6fb41c547884511893b768b833f4e90 May 26 12:53:54.347697 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: X-Project-Name: tempest-TestVolumeBootPattern-1304354335 May 26 12:53:54.347697 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: X-Role: member,reader May 26 12:53:54.347697 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: X-Roles: member,reader May 26 12:53:54.349431 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/d6fb41c547884511893b768b833f4e90"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.75:8080", "publicURL": "http://10.222.0.75:8080/v1/AUTH_d6fb41c547884511893b768b833f4e90"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2/d6fb41c547884511893b768b833f4e90"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/d6fb41c547884511893b768b833f4e90"}]}] May 26 12:53:54.349431 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: X-Tenant: tempest-TestVolumeBootPattern-1304354335 May 26 12:53:54.349431 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: X-Tenant-Id: d6fb41c547884511893b768b833f4e90 May 26 12:53:54.349431 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: X-Tenant-Name: tempest-TestVolumeBootPattern-1304354335 May 26 12:53:54.349431 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: X-User: tempest-TestVolumeBootPattern-1304354335-project May 26 12:53:54.349431 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: X-User-Domain-Id: default May 26 12:53:54.349431 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: X-User-Domain-Name: Default May 26 12:53:54.349431 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: X-User-Id: ab469b18ce0444d9884cdddc34ef7247 May 26 12:53:54.349431 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: X-User-Name: tempest-TestVolumeBootPattern-1304354335-project May 26 12:53:54.349431 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: method: > May 26 12:53:54.349431 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: exception: Instance 475179d2-21d7-4ace-90eb-e6525cb14928 could not be found. May 26 12:53:54.349431 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: action_args: {'id': '475179d2-21d7-4ace-90eb-e6525cb14928'} May 26 12:53:54.351239 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: {{(pid=129321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 12:53:54.351239 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 12:53:54.351239 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 26 12:53:54.351239 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 26 12:53:54.351239 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 26 12:53:54.351239 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 26 12:53:54.351239 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 26 12:53:54.351239 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 26 12:53:54.351239 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 26 12:53:54.351239 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 26 12:53:54.351239 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 475179d2-21d7-4ace-90eb-e6525cb14928 could not be found. May 26 12:53:54.351239 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi May 26 12:53:54.351239 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 12:53:54.351239 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi May 26 12:53:54.351239 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 12:53:54.351239 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 12:53:54.351239 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 12:53:54.351239 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 12:53:54.351239 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 12:53:54.351239 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 12:53:54.352782 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 12:53:54.352782 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 26 12:53:54.352782 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 26 12:53:54.352782 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 26 12:53:54.352782 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 26 12:53:54.352782 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 26 12:53:54.352782 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 12:53:54.352782 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 475179d2-21d7-4ace-90eb-e6525cb14928 could not be found. May 26 12:53:54.352782 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi May 26 12:53:54.352782 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 12:53:54.352782 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi May 26 12:53:54.352782 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 12:53:54.352782 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 12:53:54.352782 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 12:53:54.352782 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 12:53:54.352782 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 12:53:54.352782 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 475179d2-21d7-4ace-90eb-e6525cb14928 could not be found. May 26 12:53:54.352782 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi May 26 12:53:54.354071 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi [None req-a97267d0-a09a-40df-8cde-7c80560254eb tempest-TestVolumeBootPattern-1304354335 tempest-TestVolumeBootPattern-1304354335-project] Returning 404 to user: Instance 475179d2-21d7-4ace-90eb-e6525cb14928 could not be found. {{(pid=129321) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 12:53:54.354071 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: INFO nova.api.openstack.requestlog [None req-a97267d0-a09a-40df-8cde-7c80560254eb tempest-TestVolumeBootPattern-1304354335 tempest-TestVolumeBootPattern-1304354335-project] 10.222.0.75 "GET /compute/v2.1/servers/475179d2-21d7-4ace-90eb-e6525cb14928" status: 404 len: 111 microversion: 2.1 time: 0.032114 May 26 12:53:54.354071 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: [pid: 129321|app: 0|req: 600/1220] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 26 12:53:54 2022] GET /compute/v2.1/servers/475179d2-21d7-4ace-90eb-e6525cb14928 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 26 12:53:54.755640 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi [None req-09e77a98-2b49-4284-aba1-da7c7cbec675 tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] Calling method '>' {{(pid=129322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:53:54.756274 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.compute.api [None req-09e77a98-2b49-4284-aba1-da7c7cbec675 tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] [instance: e9e3e084-4a1a-4d21-b2e9-b51f79287094] Fetching instance by UUID {{(pid=129322) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:53:54.762430 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-09e77a98-2b49-4284-aba1-da7c7cbec675 tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:53:54.762868 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-09e77a98-2b49-4284-aba1-da7c7cbec675 tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:53:54.763652 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-09e77a98-2b49-4284-aba1-da7c7cbec675 tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:53:54.764115 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-09e77a98-2b49-4284-aba1-da7c7cbec675 tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:53:54.903564 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.policy [None req-09e77a98-2b49-4284-aba1-da7c7cbec675 tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eddc5d9ac2a74507bca19e06f0051ae1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93d5b6bba38643bfb76f083e230b3d22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129322) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:53:54.911611 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: INFO nova.api.openstack.requestlog [None req-09e77a98-2b49-4284-aba1-da7c7cbec675 tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] 10.222.0.75 "GET /compute/v2.1/servers/e9e3e084-4a1a-4d21-b2e9-b51f79287094" status: 200 len: 1368 microversion: 2.1 time: 0.159724 May 26 12:53:54.912470 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: [pid: 129322|app: 0|req: 621/1221] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 26 12:53:54 2022] GET /compute/v2.1/servers/e9e3e084-4a1a-4d21-b2e9-b51f79287094 => generated 1368 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:53:54.916594 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi [req-f74d6428-4188-4f5e-a134-cb0bc1956260 req-49c80191-356e-446d-af55-39202ae37755 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e9e3e084-4a1a-4d21-b2e9-b51f79287094", "name": "network-vif-plugged", "status": "completed", "tag": "9e80b77e-f708-4605-b98a-5347a654dd4b"}]} {{(pid=129321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 12:53:54.925990 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [req-f74d6428-4188-4f5e-a134-cb0bc1956260 req-49c80191-356e-446d-af55-39202ae37755 service nova] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:53:54.926459 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [req-f74d6428-4188-4f5e-a134-cb0bc1956260 req-49c80191-356e-446d-af55-39202ae37755 service nova] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:53:54.940156 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: INFO nova.api.openstack.compute.server_external_events [req-f74d6428-4188-4f5e-a134-cb0bc1956260 req-49c80191-356e-446d-af55-39202ae37755 service nova] Creating event network-vif-plugged:9e80b77e-f708-4605-b98a-5347a654dd4b for instance e9e3e084-4a1a-4d21-b2e9-b51f79287094 on hv-cinder-81966 May 26 12:53:54.945294 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: INFO nova.api.openstack.requestlog [req-f74d6428-4188-4f5e-a134-cb0bc1956260 req-49c80191-356e-446d-af55-39202ae37755 service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032425 May 26 12:53:54.945908 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: [pid: 129321|app: 0|req: 601/1222] 10.222.0.75 () {64 vars in 1317 bytes} [Thu May 26 12:53:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 26 12:53:55.669217 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi [None req-4d32042b-42be-4ac5-a853-0967f19b0a74 tempest-TestVolumeBootPattern-1304354335 tempest-TestVolumeBootPattern-1304354335-project] Calling method '.version_select at 0x7f830d235d30>' {{(pid=129322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:53:55.689170 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: INFO nova.api.openstack.requestlog [None req-4d32042b-42be-4ac5-a853-0967f19b0a74 tempest-TestVolumeBootPattern-1304354335 tempest-TestVolumeBootPattern-1304354335-project] 10.222.0.75 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-172235393" status: 202 len: 0 microversion: 2.1 time: 0.023767 May 26 12:53:55.689757 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: [pid: 129322|app: 0|req: 622/1223] 10.222.0.75 () {58 vars in 1259 bytes} [Thu May 26 12:53:55 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-172235393 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 26 12:53:55.930685 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi [None req-110879b5-cbdb-4e6a-b6a7-c1ffc75ce8aa tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] Calling method '>' {{(pid=129321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:53:55.931348 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.compute.api [None req-110879b5-cbdb-4e6a-b6a7-c1ffc75ce8aa tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] [instance: e9e3e084-4a1a-4d21-b2e9-b51f79287094] Fetching instance by UUID {{(pid=129321) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:53:55.934539 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG dbcounter [-] [129321] Writing DB stats nova_api:SELECT=92,nova_api:UPDATE=3,nova_api:DELETE=2,nova_api:INSERT=3 {{(pid=129321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:53:55.938955 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-110879b5-cbdb-4e6a-b6a7-c1ffc75ce8aa tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:53:55.939404 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-110879b5-cbdb-4e6a-b6a7-c1ffc75ce8aa tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:53:55.940202 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-110879b5-cbdb-4e6a-b6a7-c1ffc75ce8aa tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:53:55.940633 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-110879b5-cbdb-4e6a-b6a7-c1ffc75ce8aa tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:53:56.368890 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.policy [None req-110879b5-cbdb-4e6a-b6a7-c1ffc75ce8aa tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eddc5d9ac2a74507bca19e06f0051ae1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93d5b6bba38643bfb76f083e230b3d22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129321) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:53:56.376708 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: INFO nova.api.openstack.requestlog [None req-110879b5-cbdb-4e6a-b6a7-c1ffc75ce8aa tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] 10.222.0.75 "GET /compute/v2.1/servers/e9e3e084-4a1a-4d21-b2e9-b51f79287094" status: 200 len: 1368 microversion: 2.1 time: 0.451178 May 26 12:53:56.377296 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: [pid: 129321|app: 0|req: 602/1224] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 26 12:53:55 2022] GET /compute/v2.1/servers/e9e3e084-4a1a-4d21-b2e9-b51f79287094 => generated 1368 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:53:57.394354 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi [None req-49cd2ffa-e20b-4112-9b03-0f4ff4b86e5a tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] Calling method '>' {{(pid=129322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:53:57.394893 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.compute.api [None req-49cd2ffa-e20b-4112-9b03-0f4ff4b86e5a tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] [instance: e9e3e084-4a1a-4d21-b2e9-b51f79287094] Fetching instance by UUID {{(pid=129322) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:53:57.401513 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-49cd2ffa-e20b-4112-9b03-0f4ff4b86e5a tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:53:57.401931 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-49cd2ffa-e20b-4112-9b03-0f4ff4b86e5a tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:53:57.402706 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-49cd2ffa-e20b-4112-9b03-0f4ff4b86e5a tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:53:57.403139 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-49cd2ffa-e20b-4112-9b03-0f4ff4b86e5a tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:53:57.613933 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.policy [None req-49cd2ffa-e20b-4112-9b03-0f4ff4b86e5a tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eddc5d9ac2a74507bca19e06f0051ae1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93d5b6bba38643bfb76f083e230b3d22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129322) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:53:57.625173 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: INFO nova.api.openstack.requestlog [None req-49cd2ffa-e20b-4112-9b03-0f4ff4b86e5a tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] 10.222.0.75 "GET /compute/v2.1/servers/e9e3e084-4a1a-4d21-b2e9-b51f79287094" status: 200 len: 1558 microversion: 2.1 time: 0.235611 May 26 12:53:57.625836 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: [pid: 129322|app: 0|req: 623/1225] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 26 12:53:57 2022] GET /compute/v2.1/servers/e9e3e084-4a1a-4d21-b2e9-b51f79287094 => generated 1558 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:53:57.643843 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi [None req-6d971b51-3d20-424c-ae2b-b9e8c49005db tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] Calling method '>' {{(pid=129321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:53:57.644419 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.compute.api [None req-6d971b51-3d20-424c-ae2b-b9e8c49005db tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] [instance: e9e3e084-4a1a-4d21-b2e9-b51f79287094] Fetching instance by UUID {{(pid=129321) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:53:57.652326 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-6d971b51-3d20-424c-ae2b-b9e8c49005db tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:53:57.653322 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-6d971b51-3d20-424c-ae2b-b9e8c49005db tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:53:57.654334 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-6d971b51-3d20-424c-ae2b-b9e8c49005db tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:53:57.655216 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-6d971b51-3d20-424c-ae2b-b9e8c49005db tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:53:57.741386 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: INFO nova.api.openstack.requestlog [None req-6d971b51-3d20-424c-ae2b-b9e8c49005db tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] 10.222.0.75 "GET /compute/v2.1/servers/e9e3e084-4a1a-4d21-b2e9-b51f79287094/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.102487 May 26 12:53:57.742028 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: [pid: 129321|app: 0|req: 603/1226] 10.222.0.75 () {58 vars in 1274 bytes} [Thu May 26 12:53:57 2022] GET /compute/v2.1/servers/e9e3e084-4a1a-4d21-b2e9-b51f79287094/os-interface => generated 284 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 12:53:58.788339 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi [req-70a49945-f70f-41d3-abc5-b89742d7891f req-eff38292-4cc0-420e-8b11-8a1eb1fdc009 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e9e3e084-4a1a-4d21-b2e9-b51f79287094", "tag": "9e80b77e-f708-4605-b98a-5347a654dd4b"}]} {{(pid=129322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 12:53:58.803221 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG dbcounter [-] [129322] Writing DB stats nova_api:SELECT=84,nova_api:UPDATE=1,nova_api:INSERT=1,nova_api:DELETE=1 {{(pid=129322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:53:58.808734 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [req-70a49945-f70f-41d3-abc5-b89742d7891f req-eff38292-4cc0-420e-8b11-8a1eb1fdc009 service nova] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:53:58.809400 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [req-70a49945-f70f-41d3-abc5-b89742d7891f req-eff38292-4cc0-420e-8b11-8a1eb1fdc009 service nova] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:53:58.826437 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: INFO nova.api.openstack.compute.server_external_events [req-70a49945-f70f-41d3-abc5-b89742d7891f req-eff38292-4cc0-420e-8b11-8a1eb1fdc009 service nova] Creating event network-changed:9e80b77e-f708-4605-b98a-5347a654dd4b for instance e9e3e084-4a1a-4d21-b2e9-b51f79287094 on hv-cinder-81966 May 26 12:53:58.831688 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: INFO nova.api.openstack.requestlog [req-70a49945-f70f-41d3-abc5-b89742d7891f req-eff38292-4cc0-420e-8b11-8a1eb1fdc009 service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049762 May 26 12:53:58.832292 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: [pid: 129322|app: 0|req: 624/1227] 10.222.0.75 () {64 vars in 1317 bytes} [Thu May 26 12:53:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 12:53:59.890397 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi [None req-63d24214-39fe-40e4-88ec-ad8c74865525 tempest-AttachVolumeTestJSON-1454716698 tempest-AttachVolumeTestJSON-1454716698-project] Calling method '>' {{(pid=129321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:53:59.891453 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.compute.api [None req-63d24214-39fe-40e4-88ec-ad8c74865525 tempest-AttachVolumeTestJSON-1454716698 tempest-AttachVolumeTestJSON-1454716698-project] [instance: 98a9eaba-a08a-4883-9549-883c38590393] Fetching instance by UUID {{(pid=129321) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:53:59.899332 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-63d24214-39fe-40e4-88ec-ad8c74865525 tempest-AttachVolumeTestJSON-1454716698 tempest-AttachVolumeTestJSON-1454716698-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:53:59.900044 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-63d24214-39fe-40e4-88ec-ad8c74865525 tempest-AttachVolumeTestJSON-1454716698 tempest-AttachVolumeTestJSON-1454716698-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:53:59.900824 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-63d24214-39fe-40e4-88ec-ad8c74865525 tempest-AttachVolumeTestJSON-1454716698 tempest-AttachVolumeTestJSON-1454716698-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:53:59.901257 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-63d24214-39fe-40e4-88ec-ad8c74865525 tempest-AttachVolumeTestJSON-1454716698 tempest-AttachVolumeTestJSON-1454716698-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:53:59.933839 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: INFO nova.api.openstack.requestlog [None req-63d24214-39fe-40e4-88ec-ad8c74865525 tempest-AttachVolumeTestJSON-1454716698 tempest-AttachVolumeTestJSON-1454716698-project] 10.222.0.75 "GET /compute/v2.1/servers/98a9eaba-a08a-4883-9549-883c38590393/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.047957 May 26 12:53:59.934423 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: [pid: 129321|app: 0|req: 604/1228] 10.222.0.75 () {58 vars in 1301 bytes} [Thu May 26 12:53:59 2022] GET /compute/v2.1/servers/98a9eaba-a08a-4883-9549-883c38590393/os-volume_attachments => generated 371 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 12:54:00.072383 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi [None req-191a3330-5a15-486a-bca7-43b95db2b859 tempest-AttachVolumeTestJSON-1454716698 tempest-AttachVolumeTestJSON-1454716698-project] Calling method '>' {{(pid=129322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:54:00.072972 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.compute.api [None req-191a3330-5a15-486a-bca7-43b95db2b859 tempest-AttachVolumeTestJSON-1454716698 tempest-AttachVolumeTestJSON-1454716698-project] [instance: 98a9eaba-a08a-4883-9549-883c38590393] Fetching instance by UUID {{(pid=129322) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:54:00.079595 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-191a3330-5a15-486a-bca7-43b95db2b859 tempest-AttachVolumeTestJSON-1454716698 tempest-AttachVolumeTestJSON-1454716698-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:54:00.080064 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-191a3330-5a15-486a-bca7-43b95db2b859 tempest-AttachVolumeTestJSON-1454716698 tempest-AttachVolumeTestJSON-1454716698-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:54:00.080834 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-191a3330-5a15-486a-bca7-43b95db2b859 tempest-AttachVolumeTestJSON-1454716698 tempest-AttachVolumeTestJSON-1454716698-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:54:00.081248 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-191a3330-5a15-486a-bca7-43b95db2b859 tempest-AttachVolumeTestJSON-1454716698 tempest-AttachVolumeTestJSON-1454716698-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:54:00.111739 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: INFO nova.api.openstack.requestlog [None req-191a3330-5a15-486a-bca7-43b95db2b859 tempest-AttachVolumeTestJSON-1454716698 tempest-AttachVolumeTestJSON-1454716698-project] 10.222.0.75 "GET /compute/v2.1/servers/98a9eaba-a08a-4883-9549-883c38590393/os-volume_attachments/ff4dff63-7462-48ff-baf9-ed19b3ff48b4" status: 200 len: 194 microversion: 2.1 time: 0.045566 May 26 12:54:00.112323 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: [pid: 129322|app: 0|req: 625/1229] 10.222.0.75 () {58 vars in 1412 bytes} [Thu May 26 12:54:00 2022] GET /compute/v2.1/servers/98a9eaba-a08a-4883-9549-883c38590393/os-volume_attachments/ff4dff63-7462-48ff-baf9-ed19b3ff48b4 => generated 194 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 12:54:00.122843 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi [None req-5482c454-ba91-4273-afbf-81f09c9ce1a0 tempest-AttachVolumeTestJSON-1454716698 tempest-AttachVolumeTestJSON-1454716698-project] Calling method '>' {{(pid=129321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:54:00.123393 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.compute.api [None req-5482c454-ba91-4273-afbf-81f09c9ce1a0 tempest-AttachVolumeTestJSON-1454716698 tempest-AttachVolumeTestJSON-1454716698-project] [instance: 98a9eaba-a08a-4883-9549-883c38590393] Fetching instance by UUID {{(pid=129321) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:54:00.130005 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-5482c454-ba91-4273-afbf-81f09c9ce1a0 tempest-AttachVolumeTestJSON-1454716698 tempest-AttachVolumeTestJSON-1454716698-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:54:00.130459 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-5482c454-ba91-4273-afbf-81f09c9ce1a0 tempest-AttachVolumeTestJSON-1454716698 tempest-AttachVolumeTestJSON-1454716698-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:54:00.131200 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-5482c454-ba91-4273-afbf-81f09c9ce1a0 tempest-AttachVolumeTestJSON-1454716698 tempest-AttachVolumeTestJSON-1454716698-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:54:00.131682 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-5482c454-ba91-4273-afbf-81f09c9ce1a0 tempest-AttachVolumeTestJSON-1454716698 tempest-AttachVolumeTestJSON-1454716698-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:54:00.218801 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.objects.instance [None req-5482c454-ba91-4273-afbf-81f09c9ce1a0 tempest-AttachVolumeTestJSON-1454716698 tempest-AttachVolumeTestJSON-1454716698-project] Lazy-loading 'services' on Instance uuid 98a9eaba-a08a-4883-9549-883c38590393 {{(pid=129321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 26 12:54:00.222615 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG dbcounter [-] [129321] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:54:00.300399 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: INFO nova.api.openstack.requestlog [None req-5482c454-ba91-4273-afbf-81f09c9ce1a0 tempest-AttachVolumeTestJSON-1454716698 tempest-AttachVolumeTestJSON-1454716698-project] 10.222.0.75 "DELETE /compute/v2.1/servers/98a9eaba-a08a-4883-9549-883c38590393/os-volume_attachments/ff4dff63-7462-48ff-baf9-ed19b3ff48b4" status: 202 len: 0 microversion: 2.1 time: 0.181535 May 26 12:54:00.300994 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: [pid: 129321|app: 0|req: 605/1230] 10.222.0.75 () {58 vars in 1415 bytes} [Thu May 26 12:54:00 2022] DELETE /compute/v2.1/servers/98a9eaba-a08a-4883-9549-883c38590393/os-volume_attachments/ff4dff63-7462-48ff-baf9-ed19b3ff48b4 => generated 0 bytes in 183 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 26 12:54:02.482535 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi [None req-19b19157-96f5-4386-8e88-894b6f57ff63 tempest-AttachVolumeTestJSON-1454716698 tempest-AttachVolumeTestJSON-1454716698-project] Calling method '>' {{(pid=129322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:54:02.483096 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.compute.api [None req-19b19157-96f5-4386-8e88-894b6f57ff63 tempest-AttachVolumeTestJSON-1454716698 tempest-AttachVolumeTestJSON-1454716698-project] [instance: 98a9eaba-a08a-4883-9549-883c38590393] Fetching instance by UUID {{(pid=129322) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:54:02.489861 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-19b19157-96f5-4386-8e88-894b6f57ff63 tempest-AttachVolumeTestJSON-1454716698 tempest-AttachVolumeTestJSON-1454716698-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:54:02.490386 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-19b19157-96f5-4386-8e88-894b6f57ff63 tempest-AttachVolumeTestJSON-1454716698 tempest-AttachVolumeTestJSON-1454716698-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:54:02.491226 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-19b19157-96f5-4386-8e88-894b6f57ff63 tempest-AttachVolumeTestJSON-1454716698 tempest-AttachVolumeTestJSON-1454716698-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:54:02.491757 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-19b19157-96f5-4386-8e88-894b6f57ff63 tempest-AttachVolumeTestJSON-1454716698 tempest-AttachVolumeTestJSON-1454716698-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:54:02.520689 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: INFO nova.api.openstack.requestlog [None req-19b19157-96f5-4386-8e88-894b6f57ff63 tempest-AttachVolumeTestJSON-1454716698 tempest-AttachVolumeTestJSON-1454716698-project] 10.222.0.75 "GET /compute/v2.1/servers/98a9eaba-a08a-4883-9549-883c38590393/os-volume_attachments/14143583-df79-4558-8131-18745fce9ed9" status: 200 len: 194 microversion: 2.1 time: 0.042121 May 26 12:54:02.521332 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: [pid: 129322|app: 0|req: 626/1231] 10.222.0.75 () {58 vars in 1412 bytes} [Thu May 26 12:54:02 2022] GET /compute/v2.1/servers/98a9eaba-a08a-4883-9549-883c38590393/os-volume_attachments/14143583-df79-4558-8131-18745fce9ed9 => generated 194 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 12:54:02.532941 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi [None req-cae919c5-5b17-4727-af37-181b777d387a tempest-AttachVolumeTestJSON-1454716698 tempest-AttachVolumeTestJSON-1454716698-project] Calling method '>' {{(pid=129321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:54:02.533488 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.compute.api [None req-cae919c5-5b17-4727-af37-181b777d387a tempest-AttachVolumeTestJSON-1454716698 tempest-AttachVolumeTestJSON-1454716698-project] [instance: 98a9eaba-a08a-4883-9549-883c38590393] Fetching instance by UUID {{(pid=129321) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:54:02.540015 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-cae919c5-5b17-4727-af37-181b777d387a tempest-AttachVolumeTestJSON-1454716698 tempest-AttachVolumeTestJSON-1454716698-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:54:02.540484 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-cae919c5-5b17-4727-af37-181b777d387a tempest-AttachVolumeTestJSON-1454716698 tempest-AttachVolumeTestJSON-1454716698-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:54:02.541249 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-cae919c5-5b17-4727-af37-181b777d387a tempest-AttachVolumeTestJSON-1454716698 tempest-AttachVolumeTestJSON-1454716698-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:54:02.541682 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-cae919c5-5b17-4727-af37-181b777d387a tempest-AttachVolumeTestJSON-1454716698 tempest-AttachVolumeTestJSON-1454716698-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:54:02.627587 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.objects.instance [None req-cae919c5-5b17-4727-af37-181b777d387a tempest-AttachVolumeTestJSON-1454716698 tempest-AttachVolumeTestJSON-1454716698-project] Lazy-loading 'services' on Instance uuid 98a9eaba-a08a-4883-9549-883c38590393 {{(pid=129321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 26 12:54:02.710742 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: INFO nova.api.openstack.requestlog [None req-cae919c5-5b17-4727-af37-181b777d387a tempest-AttachVolumeTestJSON-1454716698 tempest-AttachVolumeTestJSON-1454716698-project] 10.222.0.75 "DELETE /compute/v2.1/servers/98a9eaba-a08a-4883-9549-883c38590393/os-volume_attachments/14143583-df79-4558-8131-18745fce9ed9" status: 202 len: 0 microversion: 2.1 time: 0.182411 May 26 12:54:02.714748 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: [pid: 129321|app: 0|req: 606/1232] 10.222.0.75 () {58 vars in 1415 bytes} [Thu May 26 12:54:02 2022] DELETE /compute/v2.1/servers/98a9eaba-a08a-4883-9549-883c38590393/os-volume_attachments/14143583-df79-4558-8131-18745fce9ed9 => generated 0 bytes in 184 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 26 12:54:03.877980 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi [None req-b2bc3912-d9f8-4fbc-86b9-4afc3cdae9fa tempest-AttachVolumeTestJSON-1454716698 tempest-AttachVolumeTestJSON-1454716698-project] Calling method '>' {{(pid=129322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:54:03.878899 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.compute.api [None req-b2bc3912-d9f8-4fbc-86b9-4afc3cdae9fa tempest-AttachVolumeTestJSON-1454716698 tempest-AttachVolumeTestJSON-1454716698-project] [instance: 98a9eaba-a08a-4883-9549-883c38590393] Fetching instance by UUID {{(pid=129322) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:54:03.885526 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-b2bc3912-d9f8-4fbc-86b9-4afc3cdae9fa tempest-AttachVolumeTestJSON-1454716698 tempest-AttachVolumeTestJSON-1454716698-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:54:03.885963 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-b2bc3912-d9f8-4fbc-86b9-4afc3cdae9fa tempest-AttachVolumeTestJSON-1454716698 tempest-AttachVolumeTestJSON-1454716698-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:54:03.886718 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-b2bc3912-d9f8-4fbc-86b9-4afc3cdae9fa tempest-AttachVolumeTestJSON-1454716698 tempest-AttachVolumeTestJSON-1454716698-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:54:03.887139 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-b2bc3912-d9f8-4fbc-86b9-4afc3cdae9fa tempest-AttachVolumeTestJSON-1454716698 tempest-AttachVolumeTestJSON-1454716698-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:54:03.916789 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: INFO nova.api.openstack.requestlog [None req-b2bc3912-d9f8-4fbc-86b9-4afc3cdae9fa tempest-AttachVolumeTestJSON-1454716698 tempest-AttachVolumeTestJSON-1454716698-project] 10.222.0.75 "GET /compute/v2.1/servers/98a9eaba-a08a-4883-9549-883c38590393/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.042734 May 26 12:54:03.917368 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: [pid: 129322|app: 0|req: 627/1233] 10.222.0.75 () {58 vars in 1301 bytes} [Thu May 26 12:54:03 2022] GET /compute/v2.1/servers/98a9eaba-a08a-4883-9549-883c38590393/os-volume_attachments => generated 25 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 26 12:54:04.032743 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi [None req-d6d6806e-ff42-4e81-9b32-743c9feac8d7 tempest-AttachVolumeTestJSON-1454716698 tempest-AttachVolumeTestJSON-1454716698-project] Calling method '>' {{(pid=129321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:54:04.033823 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.compute.api [None req-d6d6806e-ff42-4e81-9b32-743c9feac8d7 tempest-AttachVolumeTestJSON-1454716698 tempest-AttachVolumeTestJSON-1454716698-project] [instance: 98a9eaba-a08a-4883-9549-883c38590393] Fetching instance by UUID {{(pid=129321) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:54:04.041046 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-d6d6806e-ff42-4e81-9b32-743c9feac8d7 tempest-AttachVolumeTestJSON-1454716698 tempest-AttachVolumeTestJSON-1454716698-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:54:04.041377 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-d6d6806e-ff42-4e81-9b32-743c9feac8d7 tempest-AttachVolumeTestJSON-1454716698 tempest-AttachVolumeTestJSON-1454716698-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:54:04.042159 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-d6d6806e-ff42-4e81-9b32-743c9feac8d7 tempest-AttachVolumeTestJSON-1454716698 tempest-AttachVolumeTestJSON-1454716698-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:54:04.042588 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-d6d6806e-ff42-4e81-9b32-743c9feac8d7 tempest-AttachVolumeTestJSON-1454716698 tempest-AttachVolumeTestJSON-1454716698-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:54:04.074130 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: INFO nova.api.openstack.requestlog [None req-d6d6806e-ff42-4e81-9b32-743c9feac8d7 tempest-AttachVolumeTestJSON-1454716698 tempest-AttachVolumeTestJSON-1454716698-project] 10.222.0.75 "GET /compute/v2.1/servers/98a9eaba-a08a-4883-9549-883c38590393/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.046303 May 26 12:54:04.074993 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: [pid: 129321|app: 0|req: 607/1234] 10.222.0.75 () {58 vars in 1301 bytes} [Thu May 26 12:54:04 2022] GET /compute/v2.1/servers/98a9eaba-a08a-4883-9549-883c38590393/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 26 12:54:04.137745 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi [None req-0766778f-1aec-4bd7-8108-f1a2ea9b3942 tempest-AttachVolumeTestJSON-1454716698 tempest-AttachVolumeTestJSON-1454716698-project] Calling method '>' {{(pid=129322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:54:04.138249 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.compute.api [None req-0766778f-1aec-4bd7-8108-f1a2ea9b3942 tempest-AttachVolumeTestJSON-1454716698 tempest-AttachVolumeTestJSON-1454716698-project] [instance: 98a9eaba-a08a-4883-9549-883c38590393] Fetching instance by UUID {{(pid=129322) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:54:04.145077 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-0766778f-1aec-4bd7-8108-f1a2ea9b3942 tempest-AttachVolumeTestJSON-1454716698 tempest-AttachVolumeTestJSON-1454716698-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:54:04.145514 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-0766778f-1aec-4bd7-8108-f1a2ea9b3942 tempest-AttachVolumeTestJSON-1454716698 tempest-AttachVolumeTestJSON-1454716698-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:54:04.146316 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-0766778f-1aec-4bd7-8108-f1a2ea9b3942 tempest-AttachVolumeTestJSON-1454716698 tempest-AttachVolumeTestJSON-1454716698-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:54:04.146911 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-0766778f-1aec-4bd7-8108-f1a2ea9b3942 tempest-AttachVolumeTestJSON-1454716698 tempest-AttachVolumeTestJSON-1454716698-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:54:04.174277 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.compute.api [None req-0766778f-1aec-4bd7-8108-f1a2ea9b3942 tempest-AttachVolumeTestJSON-1454716698 tempest-AttachVolumeTestJSON-1454716698-project] [instance: 98a9eaba-a08a-4883-9549-883c38590393] Going to try to terminate instance {{(pid=129322) delete /opt/stack/nova/nova/compute/api.py:2664}} May 26 12:54:04.234012 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG dbcounter [-] [129322] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=129322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:54:04.263268 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: INFO nova.api.openstack.requestlog [None req-0766778f-1aec-4bd7-8108-f1a2ea9b3942 tempest-AttachVolumeTestJSON-1454716698 tempest-AttachVolumeTestJSON-1454716698-project] 10.222.0.75 "DELETE /compute/v2.1/servers/98a9eaba-a08a-4883-9549-883c38590393" status: 204 len: 0 microversion: 2.1 time: 0.128939 May 26 12:54:04.264308 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: [pid: 129322|app: 0|req: 628/1235] 10.222.0.75 () {58 vars in 1238 bytes} [Thu May 26 12:54:04 2022] DELETE /compute/v2.1/servers/98a9eaba-a08a-4883-9549-883c38590393 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 26 12:54:04.272972 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi [None req-7ec7f09f-18f5-4940-9529-ece80490f37a tempest-AttachVolumeTestJSON-1454716698 tempest-AttachVolumeTestJSON-1454716698-project] Calling method '>' {{(pid=129321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:54:04.273745 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.compute.api [None req-7ec7f09f-18f5-4940-9529-ece80490f37a tempest-AttachVolumeTestJSON-1454716698 tempest-AttachVolumeTestJSON-1454716698-project] [instance: 98a9eaba-a08a-4883-9549-883c38590393] Fetching instance by UUID {{(pid=129321) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:54:04.280413 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-7ec7f09f-18f5-4940-9529-ece80490f37a tempest-AttachVolumeTestJSON-1454716698 tempest-AttachVolumeTestJSON-1454716698-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:54:04.280880 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-7ec7f09f-18f5-4940-9529-ece80490f37a tempest-AttachVolumeTestJSON-1454716698 tempest-AttachVolumeTestJSON-1454716698-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:54:04.281642 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-7ec7f09f-18f5-4940-9529-ece80490f37a tempest-AttachVolumeTestJSON-1454716698 tempest-AttachVolumeTestJSON-1454716698-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:54:04.282071 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-7ec7f09f-18f5-4940-9529-ece80490f37a tempest-AttachVolumeTestJSON-1454716698 tempest-AttachVolumeTestJSON-1454716698-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:54:04.419978 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.policy [None req-7ec7f09f-18f5-4940-9529-ece80490f37a tempest-AttachVolumeTestJSON-1454716698 tempest-AttachVolumeTestJSON-1454716698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e987a71a29243dbac6c23e337765508', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9f9a22ad1e74798b9b2f7d85f89a4b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129321) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:54:04.430824 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: INFO nova.api.openstack.requestlog [None req-7ec7f09f-18f5-4940-9529-ece80490f37a tempest-AttachVolumeTestJSON-1454716698 tempest-AttachVolumeTestJSON-1454716698-project] 10.222.0.75 "GET /compute/v2.1/servers/98a9eaba-a08a-4883-9549-883c38590393" status: 200 len: 1674 microversion: 2.1 time: 0.162107 May 26 12:54:04.431497 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: [pid: 129321|app: 0|req: 608/1236] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 26 12:54:04 2022] GET /compute/v2.1/servers/98a9eaba-a08a-4883-9549-883c38590393 => generated 1674 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:54:05.451878 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi [None req-b82f217e-1752-4fc7-8753-02ee0af92139 tempest-AttachVolumeTestJSON-1454716698 tempest-AttachVolumeTestJSON-1454716698-project] Calling method '>' {{(pid=129322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:54:05.452739 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.compute.api [None req-b82f217e-1752-4fc7-8753-02ee0af92139 tempest-AttachVolumeTestJSON-1454716698 tempest-AttachVolumeTestJSON-1454716698-project] [instance: 98a9eaba-a08a-4883-9549-883c38590393] Fetching instance by UUID {{(pid=129322) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:54:05.461404 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-b82f217e-1752-4fc7-8753-02ee0af92139 tempest-AttachVolumeTestJSON-1454716698 tempest-AttachVolumeTestJSON-1454716698-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:54:05.461957 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-b82f217e-1752-4fc7-8753-02ee0af92139 tempest-AttachVolumeTestJSON-1454716698 tempest-AttachVolumeTestJSON-1454716698-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:54:05.462897 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-b82f217e-1752-4fc7-8753-02ee0af92139 tempest-AttachVolumeTestJSON-1454716698 tempest-AttachVolumeTestJSON-1454716698-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:54:05.463433 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-b82f217e-1752-4fc7-8753-02ee0af92139 tempest-AttachVolumeTestJSON-1454716698 tempest-AttachVolumeTestJSON-1454716698-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:54:05.601276 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.policy [None req-b82f217e-1752-4fc7-8753-02ee0af92139 tempest-AttachVolumeTestJSON-1454716698 tempest-AttachVolumeTestJSON-1454716698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e987a71a29243dbac6c23e337765508', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9f9a22ad1e74798b9b2f7d85f89a4b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129322) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:54:05.610067 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: INFO nova.api.openstack.requestlog [None req-b82f217e-1752-4fc7-8753-02ee0af92139 tempest-AttachVolumeTestJSON-1454716698 tempest-AttachVolumeTestJSON-1454716698-project] 10.222.0.75 "GET /compute/v2.1/servers/98a9eaba-a08a-4883-9549-883c38590393" status: 200 len: 1674 microversion: 2.1 time: 0.163919 May 26 12:54:05.610686 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: [pid: 129322|app: 0|req: 629/1237] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 26 12:54:05 2022] GET /compute/v2.1/servers/98a9eaba-a08a-4883-9549-883c38590393 => generated 1674 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:54:06.632231 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi [None req-3960c2ad-7490-4a14-9390-35f0e53bd7f7 tempest-AttachVolumeTestJSON-1454716698 tempest-AttachVolumeTestJSON-1454716698-project] Calling method '>' {{(pid=129321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:54:06.632878 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.compute.api [None req-3960c2ad-7490-4a14-9390-35f0e53bd7f7 tempest-AttachVolumeTestJSON-1454716698 tempest-AttachVolumeTestJSON-1454716698-project] [instance: 98a9eaba-a08a-4883-9549-883c38590393] Fetching instance by UUID {{(pid=129321) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:54:06.639961 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-3960c2ad-7490-4a14-9390-35f0e53bd7f7 tempest-AttachVolumeTestJSON-1454716698 tempest-AttachVolumeTestJSON-1454716698-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:54:06.640406 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-3960c2ad-7490-4a14-9390-35f0e53bd7f7 tempest-AttachVolumeTestJSON-1454716698 tempest-AttachVolumeTestJSON-1454716698-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:54:06.641189 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-3960c2ad-7490-4a14-9390-35f0e53bd7f7 tempest-AttachVolumeTestJSON-1454716698 tempest-AttachVolumeTestJSON-1454716698-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:54:06.641613 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-3960c2ad-7490-4a14-9390-35f0e53bd7f7 tempest-AttachVolumeTestJSON-1454716698 tempest-AttachVolumeTestJSON-1454716698-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:54:06.870796 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.policy [None req-3960c2ad-7490-4a14-9390-35f0e53bd7f7 tempest-AttachVolumeTestJSON-1454716698 tempest-AttachVolumeTestJSON-1454716698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e987a71a29243dbac6c23e337765508', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9f9a22ad1e74798b9b2f7d85f89a4b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129321) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:54:06.879142 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: INFO nova.api.openstack.requestlog [None req-3960c2ad-7490-4a14-9390-35f0e53bd7f7 tempest-AttachVolumeTestJSON-1454716698 tempest-AttachVolumeTestJSON-1454716698-project] 10.222.0.75 "GET /compute/v2.1/servers/98a9eaba-a08a-4883-9549-883c38590393" status: 200 len: 1674 microversion: 2.1 time: 0.251890 May 26 12:54:06.879761 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: [pid: 129321|app: 0|req: 609/1238] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 26 12:54:06 2022] GET /compute/v2.1/servers/98a9eaba-a08a-4883-9549-883c38590393 => generated 1674 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:54:07.427468 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi [req-c24b467e-0311-4f38-b832-9ebeafdb845e req-796f237a-34b8-469d-958a-f276190819df service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "98a9eaba-a08a-4883-9549-883c38590393", "name": "network-vif-deleted", "tag": "9346829c-77c5-4003-9a76-ec6c58463abe"}]} {{(pid=129322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 12:54:07.437794 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [req-c24b467e-0311-4f38-b832-9ebeafdb845e req-796f237a-34b8-469d-958a-f276190819df service nova] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:54:07.438362 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [req-c24b467e-0311-4f38-b832-9ebeafdb845e req-796f237a-34b8-469d-958a-f276190819df service nova] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:54:07.450366 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: INFO nova.api.openstack.compute.server_external_events [req-c24b467e-0311-4f38-b832-9ebeafdb845e req-796f237a-34b8-469d-958a-f276190819df service nova] Creating event network-vif-deleted:9346829c-77c5-4003-9a76-ec6c58463abe for instance 98a9eaba-a08a-4883-9549-883c38590393 on hv-cinder-81966 May 26 12:54:07.455946 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: INFO nova.api.openstack.requestlog [req-c24b467e-0311-4f38-b832-9ebeafdb845e req-796f237a-34b8-469d-958a-f276190819df service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032259 May 26 12:54:07.456768 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: [pid: 129322|app: 0|req: 630/1239] 10.222.0.75 () {64 vars in 1317 bytes} [Thu May 26 12:54:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 12:54:07.897999 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi [None req-274f1171-2cae-4634-a449-3a46a012404b tempest-AttachVolumeTestJSON-1454716698 tempest-AttachVolumeTestJSON-1454716698-project] Calling method '>' {{(pid=129321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:54:07.898721 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.compute.api [None req-274f1171-2cae-4634-a449-3a46a012404b tempest-AttachVolumeTestJSON-1454716698 tempest-AttachVolumeTestJSON-1454716698-project] [instance: 98a9eaba-a08a-4883-9549-883c38590393] Fetching instance by UUID {{(pid=129321) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:54:07.905573 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-274f1171-2cae-4634-a449-3a46a012404b tempest-AttachVolumeTestJSON-1454716698 tempest-AttachVolumeTestJSON-1454716698-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:54:07.906035 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-274f1171-2cae-4634-a449-3a46a012404b tempest-AttachVolumeTestJSON-1454716698 tempest-AttachVolumeTestJSON-1454716698-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:54:07.906822 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-274f1171-2cae-4634-a449-3a46a012404b tempest-AttachVolumeTestJSON-1454716698 tempest-AttachVolumeTestJSON-1454716698-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:54:07.907242 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-274f1171-2cae-4634-a449-3a46a012404b tempest-AttachVolumeTestJSON-1454716698 tempest-AttachVolumeTestJSON-1454716698-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:54:07.940781 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-274f1171-2cae-4634-a449-3a46a012404b tempest-AttachVolumeTestJSON-1454716698 tempest-AttachVolumeTestJSON-1454716698-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:54:07.941267 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-274f1171-2cae-4634-a449-3a46a012404b tempest-AttachVolumeTestJSON-1454716698 tempest-AttachVolumeTestJSON-1454716698-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:54:07.941910 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.objects.instance [None req-274f1171-2cae-4634-a449-3a46a012404b tempest-AttachVolumeTestJSON-1454716698 tempest-AttachVolumeTestJSON-1454716698-project] Lazy-loading 'fault' on Instance uuid 98a9eaba-a08a-4883-9549-883c38590393 {{(pid=129321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 26 12:54:07.989346 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.policy [None req-274f1171-2cae-4634-a449-3a46a012404b tempest-AttachVolumeTestJSON-1454716698 tempest-AttachVolumeTestJSON-1454716698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e987a71a29243dbac6c23e337765508', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9f9a22ad1e74798b9b2f7d85f89a4b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129321) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:54:07.997891 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: INFO nova.api.openstack.requestlog [None req-274f1171-2cae-4634-a449-3a46a012404b tempest-AttachVolumeTestJSON-1454716698 tempest-AttachVolumeTestJSON-1454716698-project] 10.222.0.75 "GET /compute/v2.1/servers/98a9eaba-a08a-4883-9549-883c38590393" status: 200 len: 1327 microversion: 2.1 time: 0.103920 May 26 12:54:07.998567 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: [pid: 129321|app: 0|req: 610/1240] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 26 12:54:07 2022] GET /compute/v2.1/servers/98a9eaba-a08a-4883-9549-883c38590393 => generated 1327 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:54:09.017194 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi [None req-cd37fe26-ff19-4ba9-a116-0b909beae51a tempest-AttachVolumeTestJSON-1454716698 tempest-AttachVolumeTestJSON-1454716698-project] Calling method '>' {{(pid=129322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:54:09.018510 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.compute.api [None req-cd37fe26-ff19-4ba9-a116-0b909beae51a tempest-AttachVolumeTestJSON-1454716698 tempest-AttachVolumeTestJSON-1454716698-project] [instance: 98a9eaba-a08a-4883-9549-883c38590393] Fetching instance by UUID {{(pid=129322) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:54:09.026979 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-cd37fe26-ff19-4ba9-a116-0b909beae51a tempest-AttachVolumeTestJSON-1454716698 tempest-AttachVolumeTestJSON-1454716698-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:54:09.027461 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-cd37fe26-ff19-4ba9-a116-0b909beae51a tempest-AttachVolumeTestJSON-1454716698 tempest-AttachVolumeTestJSON-1454716698-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:54:09.028279 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-cd37fe26-ff19-4ba9-a116-0b909beae51a tempest-AttachVolumeTestJSON-1454716698 tempest-AttachVolumeTestJSON-1454716698-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:54:09.028715 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-cd37fe26-ff19-4ba9-a116-0b909beae51a tempest-AttachVolumeTestJSON-1454716698 tempest-AttachVolumeTestJSON-1454716698-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:54:09.043347 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: INFO nova.api.openstack.wsgi [None req-cd37fe26-ff19-4ba9-a116-0b909beae51a tempest-AttachVolumeTestJSON-1454716698 tempest-AttachVolumeTestJSON-1454716698-project] HTTP exception thrown: Instance 98a9eaba-a08a-4883-9549-883c38590393 could not be found. May 26 12:54:09.044983 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi [None req-cd37fe26-ff19-4ba9-a116-0b909beae51a tempest-AttachVolumeTestJSON-1454716698 tempest-AttachVolumeTestJSON-1454716698-project] Request method failure captured: May 26 12:54:09.044983 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: request: GET /compute/v2.1/servers/98a9eaba-a08a-4883-9549-883c38590393 HTTP/1.1 May 26 12:54:09.044983 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: Accept: application/json May 26 12:54:09.044983 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: Accept-Encoding: identity May 26 12:54:09.044983 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: Connection: close May 26 12:54:09.044983 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: Content-Length: 0 May 26 12:54:09.044983 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: Content-Type: application/json May 26 12:54:09.044983 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: Host: 10.222.0.75 May 26 12:54:09.044983 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: Openstack-System-Scope: None May 26 12:54:09.044983 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: User-Agent: python-urllib3/1.26.9 May 26 12:54:09.044983 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: X-Auth-Token: gAAAAABij3biYRQth7VNOFBPzfZXJB_qWHSqHSG9e6P1UeNb-q3RPpB2aj40Ns6GyVugXTOB-VgpuQ9swDH2_aawBsT7HShFwXMj-lLhfBtfFspOvV4H1TRGH5-5fyaG-z1MHKgWVpH6S9gUyGK6Y8u3KlBpZrkU5rjhH3fCckOY_4x3OGsHu8E May 26 12:54:09.044983 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: X-Domain-Id: None May 26 12:54:09.044983 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: X-Domain-Name: None May 26 12:54:09.044983 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: X-Identity-Status: Confirmed May 26 12:54:09.044983 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: X-Is-Admin-Project: True May 26 12:54:09.044983 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: X-Project-Domain-Id: default May 26 12:54:09.044983 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: X-Project-Domain-Name: Default May 26 12:54:09.044983 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: X-Project-Id: a9f9a22ad1e74798b9b2f7d85f89a4b6 May 26 12:54:09.044983 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: X-Project-Name: tempest-AttachVolumeTestJSON-1454716698 May 26 12:54:09.044983 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: X-Role: member,reader May 26 12:54:09.044983 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: X-Roles: member,reader May 26 12:54:09.046604 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/a9f9a22ad1e74798b9b2f7d85f89a4b6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.75:8080", "publicURL": "http://10.222.0.75:8080/v1/AUTH_a9f9a22ad1e74798b9b2f7d85f89a4b6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2/a9f9a22ad1e74798b9b2f7d85f89a4b6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/a9f9a22ad1e74798b9b2f7d85f89a4b6"}]}] May 26 12:54:09.046604 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: X-Tenant: tempest-AttachVolumeTestJSON-1454716698 May 26 12:54:09.046604 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: X-Tenant-Id: a9f9a22ad1e74798b9b2f7d85f89a4b6 May 26 12:54:09.046604 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1454716698 May 26 12:54:09.046604 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: X-User: tempest-AttachVolumeTestJSON-1454716698-project May 26 12:54:09.046604 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: X-User-Domain-Id: default May 26 12:54:09.046604 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: X-User-Domain-Name: Default May 26 12:54:09.046604 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: X-User-Id: 4e987a71a29243dbac6c23e337765508 May 26 12:54:09.046604 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: X-User-Name: tempest-AttachVolumeTestJSON-1454716698-project May 26 12:54:09.046604 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: method: > May 26 12:54:09.046604 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: exception: Instance 98a9eaba-a08a-4883-9549-883c38590393 could not be found. May 26 12:54:09.046604 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: action_args: {'id': '98a9eaba-a08a-4883-9549-883c38590393'} May 26 12:54:09.047611 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: {{(pid=129322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 12:54:09.047611 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 12:54:09.047611 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 26 12:54:09.047611 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 26 12:54:09.047611 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 26 12:54:09.047611 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 26 12:54:09.047611 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 26 12:54:09.047611 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 26 12:54:09.047611 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 26 12:54:09.047611 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 26 12:54:09.047611 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 98a9eaba-a08a-4883-9549-883c38590393 could not be found. May 26 12:54:09.047611 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi May 26 12:54:09.047611 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 12:54:09.047611 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi May 26 12:54:09.047611 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 12:54:09.047611 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 12:54:09.047611 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 12:54:09.047611 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 12:54:09.047611 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 12:54:09.047611 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 12:54:09.049266 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 12:54:09.049266 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 26 12:54:09.049266 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 26 12:54:09.049266 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 26 12:54:09.049266 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 26 12:54:09.049266 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 26 12:54:09.049266 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 12:54:09.049266 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 98a9eaba-a08a-4883-9549-883c38590393 could not be found. May 26 12:54:09.049266 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi May 26 12:54:09.049266 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 12:54:09.049266 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi May 26 12:54:09.049266 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 12:54:09.049266 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 12:54:09.049266 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 12:54:09.049266 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 12:54:09.049266 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 12:54:09.049266 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 98a9eaba-a08a-4883-9549-883c38590393 could not be found. May 26 12:54:09.049266 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi May 26 12:54:09.050672 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi [None req-cd37fe26-ff19-4ba9-a116-0b909beae51a tempest-AttachVolumeTestJSON-1454716698 tempest-AttachVolumeTestJSON-1454716698-project] Returning 404 to user: Instance 98a9eaba-a08a-4883-9549-883c38590393 could not be found. {{(pid=129322) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 12:54:09.050672 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: INFO nova.api.openstack.requestlog [None req-cd37fe26-ff19-4ba9-a116-0b909beae51a tempest-AttachVolumeTestJSON-1454716698 tempest-AttachVolumeTestJSON-1454716698-project] 10.222.0.75 "GET /compute/v2.1/servers/98a9eaba-a08a-4883-9549-883c38590393" status: 404 len: 111 microversion: 2.1 time: 0.034014 May 26 12:54:09.050672 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: [pid: 129322|app: 0|req: 631/1241] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 26 12:54:09 2022] GET /compute/v2.1/servers/98a9eaba-a08a-4883-9549-883c38590393 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 26 12:54:09.056557 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi [None req-54e71d24-e914-4401-8251-81e603cee2e7 tempest-AttachVolumeTestJSON-1454716698 tempest-AttachVolumeTestJSON-1454716698-project] Calling method '.version_select at 0x7f82fbf3e430>' {{(pid=129321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:54:09.079291 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: INFO nova.api.openstack.requestlog [None req-54e71d24-e914-4401-8251-81e603cee2e7 tempest-AttachVolumeTestJSON-1454716698 tempest-AttachVolumeTestJSON-1454716698-project] 10.222.0.75 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1941309662" status: 202 len: 0 microversion: 2.1 time: 0.027018 May 26 12:54:09.079909 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: [pid: 129321|app: 0|req: 611/1242] 10.222.0.75 () {58 vars in 1220 bytes} [Thu May 26 12:54:09 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1941309662 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 26 12:54:11.977391 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi [None req-c3e3f8ea-27e4-4f1a-a742-2ef9fd583d45 tempest-AttachVolumeTestJSON-1454716698 tempest-AttachVolumeTestJSON-1454716698-project] Calling method '>' {{(pid=129322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:54:11.978147 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.compute.api [None req-c3e3f8ea-27e4-4f1a-a742-2ef9fd583d45 tempest-AttachVolumeTestJSON-1454716698 tempest-AttachVolumeTestJSON-1454716698-project] [instance: 98a9eaba-a08a-4883-9549-883c38590393] Fetching instance by UUID {{(pid=129322) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:54:11.985272 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-c3e3f8ea-27e4-4f1a-a742-2ef9fd583d45 tempest-AttachVolumeTestJSON-1454716698 tempest-AttachVolumeTestJSON-1454716698-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:54:11.985721 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-c3e3f8ea-27e4-4f1a-a742-2ef9fd583d45 tempest-AttachVolumeTestJSON-1454716698 tempest-AttachVolumeTestJSON-1454716698-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:54:11.986485 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-c3e3f8ea-27e4-4f1a-a742-2ef9fd583d45 tempest-AttachVolumeTestJSON-1454716698 tempest-AttachVolumeTestJSON-1454716698-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:54:11.986895 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-c3e3f8ea-27e4-4f1a-a742-2ef9fd583d45 tempest-AttachVolumeTestJSON-1454716698 tempest-AttachVolumeTestJSON-1454716698-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:54:12.001822 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: INFO nova.api.openstack.wsgi [None req-c3e3f8ea-27e4-4f1a-a742-2ef9fd583d45 tempest-AttachVolumeTestJSON-1454716698 tempest-AttachVolumeTestJSON-1454716698-project] HTTP exception thrown: Instance 98a9eaba-a08a-4883-9549-883c38590393 could not be found. May 26 12:54:12.004265 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi [None req-c3e3f8ea-27e4-4f1a-a742-2ef9fd583d45 tempest-AttachVolumeTestJSON-1454716698 tempest-AttachVolumeTestJSON-1454716698-project] Request method failure captured: May 26 12:54:12.004265 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: request: DELETE /compute/v2.1/servers/98a9eaba-a08a-4883-9549-883c38590393 HTTP/1.1 May 26 12:54:12.004265 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: Accept: application/json May 26 12:54:12.004265 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: Accept-Encoding: identity May 26 12:54:12.004265 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: Connection: close May 26 12:54:12.004265 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: Content-Length: 0 May 26 12:54:12.004265 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: Content-Type: application/json May 26 12:54:12.004265 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: Host: 10.222.0.75 May 26 12:54:12.004265 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: Openstack-System-Scope: None May 26 12:54:12.004265 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: User-Agent: python-urllib3/1.26.9 May 26 12:54:12.004265 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: X-Auth-Token: gAAAAABij3biYRQth7VNOFBPzfZXJB_qWHSqHSG9e6P1UeNb-q3RPpB2aj40Ns6GyVugXTOB-VgpuQ9swDH2_aawBsT7HShFwXMj-lLhfBtfFspOvV4H1TRGH5-5fyaG-z1MHKgWVpH6S9gUyGK6Y8u3KlBpZrkU5rjhH3fCckOY_4x3OGsHu8E May 26 12:54:12.004265 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: X-Domain-Id: None May 26 12:54:12.004265 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: X-Domain-Name: None May 26 12:54:12.004265 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: X-Identity-Status: Confirmed May 26 12:54:12.004265 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: X-Is-Admin-Project: True May 26 12:54:12.004265 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: X-Project-Domain-Id: default May 26 12:54:12.004265 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: X-Project-Domain-Name: Default May 26 12:54:12.004265 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: X-Project-Id: a9f9a22ad1e74798b9b2f7d85f89a4b6 May 26 12:54:12.004265 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: X-Project-Name: tempest-AttachVolumeTestJSON-1454716698 May 26 12:54:12.004265 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: X-Role: member,reader May 26 12:54:12.004265 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: X-Roles: member,reader May 26 12:54:12.006476 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/a9f9a22ad1e74798b9b2f7d85f89a4b6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.75:8080", "publicURL": "http://10.222.0.75:8080/v1/AUTH_a9f9a22ad1e74798b9b2f7d85f89a4b6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2/a9f9a22ad1e74798b9b2f7d85f89a4b6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/a9f9a22ad1e74798b9b2f7d85f89a4b6"}]}] May 26 12:54:12.006476 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: X-Tenant: tempest-AttachVolumeTestJSON-1454716698 May 26 12:54:12.006476 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: X-Tenant-Id: a9f9a22ad1e74798b9b2f7d85f89a4b6 May 26 12:54:12.006476 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1454716698 May 26 12:54:12.006476 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: X-User: tempest-AttachVolumeTestJSON-1454716698-project May 26 12:54:12.006476 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: X-User-Domain-Id: default May 26 12:54:12.006476 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: X-User-Domain-Name: Default May 26 12:54:12.006476 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: X-User-Id: 4e987a71a29243dbac6c23e337765508 May 26 12:54:12.006476 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: X-User-Name: tempest-AttachVolumeTestJSON-1454716698-project May 26 12:54:12.006476 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: method: > May 26 12:54:12.006476 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: exception: Instance 98a9eaba-a08a-4883-9549-883c38590393 could not be found. May 26 12:54:12.006476 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: action_args: {'id': '98a9eaba-a08a-4883-9549-883c38590393'} May 26 12:54:12.007395 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: {{(pid=129322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 12:54:12.007395 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 12:54:12.007395 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 26 12:54:12.007395 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 26 12:54:12.007395 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 26 12:54:12.007395 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 26 12:54:12.007395 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 26 12:54:12.007395 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 26 12:54:12.007395 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 26 12:54:12.007395 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 26 12:54:12.007395 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 98a9eaba-a08a-4883-9549-883c38590393 could not be found. May 26 12:54:12.007395 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi May 26 12:54:12.007395 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 12:54:12.007395 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi May 26 12:54:12.007395 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 12:54:12.007395 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 12:54:12.007395 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 12:54:12.007395 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 12:54:12.007395 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 12:54:12.007395 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 12:54:12.009423 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 12:54:12.009423 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 26 12:54:12.009423 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 26 12:54:12.009423 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 26 12:54:12.009423 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 26 12:54:12.009423 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 26 12:54:12.009423 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 26 12:54:12.009423 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 26 12:54:12.009423 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 12:54:12.009423 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 98a9eaba-a08a-4883-9549-883c38590393 could not be found. May 26 12:54:12.009423 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi May 26 12:54:12.009423 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 12:54:12.009423 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi May 26 12:54:12.009423 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 12:54:12.009423 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 12:54:12.009423 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 12:54:12.009423 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 12:54:12.009423 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 12:54:12.009423 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 98a9eaba-a08a-4883-9549-883c38590393 could not be found. May 26 12:54:12.009423 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi May 26 12:54:12.011024 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi [None req-c3e3f8ea-27e4-4f1a-a742-2ef9fd583d45 tempest-AttachVolumeTestJSON-1454716698 tempest-AttachVolumeTestJSON-1454716698-project] Returning 404 to user: Instance 98a9eaba-a08a-4883-9549-883c38590393 could not be found. {{(pid=129322) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 12:54:12.011024 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: INFO nova.api.openstack.requestlog [None req-c3e3f8ea-27e4-4f1a-a742-2ef9fd583d45 tempest-AttachVolumeTestJSON-1454716698 tempest-AttachVolumeTestJSON-1454716698-project] 10.222.0.75 "DELETE /compute/v2.1/servers/98a9eaba-a08a-4883-9549-883c38590393" status: 404 len: 111 microversion: 2.1 time: 0.032550 May 26 12:54:12.011024 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: [pid: 129322|app: 0|req: 632/1243] 10.222.0.75 () {58 vars in 1238 bytes} [Thu May 26 12:54:11 2022] DELETE /compute/v2.1/servers/98a9eaba-a08a-4883-9549-883c38590393 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 26 12:54:12.016769 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi [None req-773661ac-3f82-4e63-9add-34e09d145dcf tempest-AttachVolumeTestJSON-1454716698 tempest-AttachVolumeTestJSON-1454716698-project] Calling method '>' {{(pid=129321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:54:12.017380 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.compute.api [None req-773661ac-3f82-4e63-9add-34e09d145dcf tempest-AttachVolumeTestJSON-1454716698 tempest-AttachVolumeTestJSON-1454716698-project] [instance: 98a9eaba-a08a-4883-9549-883c38590393] Fetching instance by UUID {{(pid=129321) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:54:12.026946 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-773661ac-3f82-4e63-9add-34e09d145dcf tempest-AttachVolumeTestJSON-1454716698 tempest-AttachVolumeTestJSON-1454716698-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:54:12.027401 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-773661ac-3f82-4e63-9add-34e09d145dcf tempest-AttachVolumeTestJSON-1454716698 tempest-AttachVolumeTestJSON-1454716698-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:54:12.028257 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-773661ac-3f82-4e63-9add-34e09d145dcf tempest-AttachVolumeTestJSON-1454716698 tempest-AttachVolumeTestJSON-1454716698-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:54:12.028698 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-773661ac-3f82-4e63-9add-34e09d145dcf tempest-AttachVolumeTestJSON-1454716698 tempest-AttachVolumeTestJSON-1454716698-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:54:12.046544 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: INFO nova.api.openstack.wsgi [None req-773661ac-3f82-4e63-9add-34e09d145dcf tempest-AttachVolumeTestJSON-1454716698 tempest-AttachVolumeTestJSON-1454716698-project] HTTP exception thrown: Instance 98a9eaba-a08a-4883-9549-883c38590393 could not be found. May 26 12:54:12.048561 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi [None req-773661ac-3f82-4e63-9add-34e09d145dcf tempest-AttachVolumeTestJSON-1454716698 tempest-AttachVolumeTestJSON-1454716698-project] Request method failure captured: May 26 12:54:12.048561 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: request: GET /compute/v2.1/servers/98a9eaba-a08a-4883-9549-883c38590393 HTTP/1.1 May 26 12:54:12.048561 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: Accept: application/json May 26 12:54:12.048561 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: Accept-Encoding: identity May 26 12:54:12.048561 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: Connection: close May 26 12:54:12.048561 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: Content-Length: 0 May 26 12:54:12.048561 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: Content-Type: application/json May 26 12:54:12.048561 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: Host: 10.222.0.75 May 26 12:54:12.048561 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: Openstack-System-Scope: None May 26 12:54:12.048561 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: User-Agent: python-urllib3/1.26.9 May 26 12:54:12.048561 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: X-Auth-Token: gAAAAABij3biYRQth7VNOFBPzfZXJB_qWHSqHSG9e6P1UeNb-q3RPpB2aj40Ns6GyVugXTOB-VgpuQ9swDH2_aawBsT7HShFwXMj-lLhfBtfFspOvV4H1TRGH5-5fyaG-z1MHKgWVpH6S9gUyGK6Y8u3KlBpZrkU5rjhH3fCckOY_4x3OGsHu8E May 26 12:54:12.048561 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: X-Domain-Id: None May 26 12:54:12.048561 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: X-Domain-Name: None May 26 12:54:12.048561 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: X-Identity-Status: Confirmed May 26 12:54:12.048561 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: X-Is-Admin-Project: True May 26 12:54:12.048561 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: X-Project-Domain-Id: default May 26 12:54:12.048561 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: X-Project-Domain-Name: Default May 26 12:54:12.048561 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: X-Project-Id: a9f9a22ad1e74798b9b2f7d85f89a4b6 May 26 12:54:12.048561 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: X-Project-Name: tempest-AttachVolumeTestJSON-1454716698 May 26 12:54:12.048561 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: X-Role: member,reader May 26 12:54:12.048561 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: X-Roles: member,reader May 26 12:54:12.050153 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/a9f9a22ad1e74798b9b2f7d85f89a4b6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.75:8080", "publicURL": "http://10.222.0.75:8080/v1/AUTH_a9f9a22ad1e74798b9b2f7d85f89a4b6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2/a9f9a22ad1e74798b9b2f7d85f89a4b6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/a9f9a22ad1e74798b9b2f7d85f89a4b6"}]}] May 26 12:54:12.050153 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: X-Tenant: tempest-AttachVolumeTestJSON-1454716698 May 26 12:54:12.050153 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: X-Tenant-Id: a9f9a22ad1e74798b9b2f7d85f89a4b6 May 26 12:54:12.050153 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1454716698 May 26 12:54:12.050153 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: X-User: tempest-AttachVolumeTestJSON-1454716698-project May 26 12:54:12.050153 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: X-User-Domain-Id: default May 26 12:54:12.050153 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: X-User-Domain-Name: Default May 26 12:54:12.050153 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: X-User-Id: 4e987a71a29243dbac6c23e337765508 May 26 12:54:12.050153 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: X-User-Name: tempest-AttachVolumeTestJSON-1454716698-project May 26 12:54:12.050153 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: method: > May 26 12:54:12.050153 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: exception: Instance 98a9eaba-a08a-4883-9549-883c38590393 could not be found. May 26 12:54:12.050153 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: action_args: {'id': '98a9eaba-a08a-4883-9549-883c38590393'} May 26 12:54:12.051157 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: {{(pid=129321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 12:54:12.051157 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 12:54:12.051157 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 26 12:54:12.051157 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 26 12:54:12.051157 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 26 12:54:12.051157 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 26 12:54:12.051157 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 26 12:54:12.051157 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 26 12:54:12.051157 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 26 12:54:12.051157 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 26 12:54:12.051157 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 98a9eaba-a08a-4883-9549-883c38590393 could not be found. May 26 12:54:12.051157 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi May 26 12:54:12.051157 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 12:54:12.051157 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi May 26 12:54:12.051157 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 12:54:12.051157 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 12:54:12.051157 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 12:54:12.051157 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 12:54:12.051157 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 12:54:12.051157 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 12:54:12.053663 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 12:54:12.053663 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 26 12:54:12.053663 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 26 12:54:12.053663 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 26 12:54:12.053663 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 26 12:54:12.053663 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 26 12:54:12.053663 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 12:54:12.053663 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 98a9eaba-a08a-4883-9549-883c38590393 could not be found. May 26 12:54:12.053663 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi May 26 12:54:12.053663 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 12:54:12.053663 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi May 26 12:54:12.053663 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 12:54:12.053663 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 12:54:12.053663 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 12:54:12.053663 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 12:54:12.053663 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 12:54:12.053663 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 98a9eaba-a08a-4883-9549-883c38590393 could not be found. May 26 12:54:12.053663 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi May 26 12:54:12.055923 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi [None req-773661ac-3f82-4e63-9add-34e09d145dcf tempest-AttachVolumeTestJSON-1454716698 tempest-AttachVolumeTestJSON-1454716698-project] Returning 404 to user: Instance 98a9eaba-a08a-4883-9549-883c38590393 could not be found. {{(pid=129321) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 12:54:12.055923 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: INFO nova.api.openstack.requestlog [None req-773661ac-3f82-4e63-9add-34e09d145dcf tempest-AttachVolumeTestJSON-1454716698 tempest-AttachVolumeTestJSON-1454716698-project] 10.222.0.75 "GET /compute/v2.1/servers/98a9eaba-a08a-4883-9549-883c38590393" status: 404 len: 111 microversion: 2.1 time: 0.038886 May 26 12:54:12.055923 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: [pid: 129321|app: 0|req: 612/1244] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 26 12:54:12 2022] GET /compute/v2.1/servers/98a9eaba-a08a-4883-9549-883c38590393 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 26 12:54:13.222301 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi [None req-f6d30c63-e686-416e-973d-6fd62baf2257 tempest-AttachVolumeTestJSON-1454716698 tempest-AttachVolumeTestJSON-1454716698-project] Calling method '>' {{(pid=129322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:54:13.222854 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.compute.api [None req-f6d30c63-e686-416e-973d-6fd62baf2257 tempest-AttachVolumeTestJSON-1454716698 tempest-AttachVolumeTestJSON-1454716698-project] [instance: 51b4bd5b-19a0-4b50-804d-aff4216e854c] Fetching instance by UUID {{(pid=129322) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:54:13.229541 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-f6d30c63-e686-416e-973d-6fd62baf2257 tempest-AttachVolumeTestJSON-1454716698 tempest-AttachVolumeTestJSON-1454716698-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:54:13.229978 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-f6d30c63-e686-416e-973d-6fd62baf2257 tempest-AttachVolumeTestJSON-1454716698 tempest-AttachVolumeTestJSON-1454716698-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:54:13.230721 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-f6d30c63-e686-416e-973d-6fd62baf2257 tempest-AttachVolumeTestJSON-1454716698 tempest-AttachVolumeTestJSON-1454716698-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:54:13.231143 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-f6d30c63-e686-416e-973d-6fd62baf2257 tempest-AttachVolumeTestJSON-1454716698 tempest-AttachVolumeTestJSON-1454716698-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:54:13.244921 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: INFO nova.api.openstack.wsgi [None req-f6d30c63-e686-416e-973d-6fd62baf2257 tempest-AttachVolumeTestJSON-1454716698 tempest-AttachVolumeTestJSON-1454716698-project] HTTP exception thrown: Instance 51b4bd5b-19a0-4b50-804d-aff4216e854c could not be found. May 26 12:54:13.246471 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi [None req-f6d30c63-e686-416e-973d-6fd62baf2257 tempest-AttachVolumeTestJSON-1454716698 tempest-AttachVolumeTestJSON-1454716698-project] Request method failure captured: May 26 12:54:13.246471 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: request: DELETE /compute/v2.1/servers/51b4bd5b-19a0-4b50-804d-aff4216e854c HTTP/1.1 May 26 12:54:13.246471 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: Accept: application/json May 26 12:54:13.246471 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: Accept-Encoding: identity May 26 12:54:13.246471 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: Connection: close May 26 12:54:13.246471 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: Content-Length: 0 May 26 12:54:13.246471 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: Content-Type: application/json May 26 12:54:13.246471 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: Host: 10.222.0.75 May 26 12:54:13.246471 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: Openstack-System-Scope: None May 26 12:54:13.246471 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: User-Agent: python-urllib3/1.26.9 May 26 12:54:13.246471 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: X-Auth-Token: gAAAAABij3biYRQth7VNOFBPzfZXJB_qWHSqHSG9e6P1UeNb-q3RPpB2aj40Ns6GyVugXTOB-VgpuQ9swDH2_aawBsT7HShFwXMj-lLhfBtfFspOvV4H1TRGH5-5fyaG-z1MHKgWVpH6S9gUyGK6Y8u3KlBpZrkU5rjhH3fCckOY_4x3OGsHu8E May 26 12:54:13.246471 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: X-Domain-Id: None May 26 12:54:13.246471 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: X-Domain-Name: None May 26 12:54:13.246471 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: X-Identity-Status: Confirmed May 26 12:54:13.246471 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: X-Is-Admin-Project: True May 26 12:54:13.246471 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: X-Project-Domain-Id: default May 26 12:54:13.246471 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: X-Project-Domain-Name: Default May 26 12:54:13.246471 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: X-Project-Id: a9f9a22ad1e74798b9b2f7d85f89a4b6 May 26 12:54:13.246471 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: X-Project-Name: tempest-AttachVolumeTestJSON-1454716698 May 26 12:54:13.246471 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: X-Role: member,reader May 26 12:54:13.246471 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: X-Roles: member,reader May 26 12:54:13.248054 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/a9f9a22ad1e74798b9b2f7d85f89a4b6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.75:8080", "publicURL": "http://10.222.0.75:8080/v1/AUTH_a9f9a22ad1e74798b9b2f7d85f89a4b6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2/a9f9a22ad1e74798b9b2f7d85f89a4b6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/a9f9a22ad1e74798b9b2f7d85f89a4b6"}]}] May 26 12:54:13.248054 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: X-Tenant: tempest-AttachVolumeTestJSON-1454716698 May 26 12:54:13.248054 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: X-Tenant-Id: a9f9a22ad1e74798b9b2f7d85f89a4b6 May 26 12:54:13.248054 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1454716698 May 26 12:54:13.248054 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: X-User: tempest-AttachVolumeTestJSON-1454716698-project May 26 12:54:13.248054 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: X-User-Domain-Id: default May 26 12:54:13.248054 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: X-User-Domain-Name: Default May 26 12:54:13.248054 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: X-User-Id: 4e987a71a29243dbac6c23e337765508 May 26 12:54:13.248054 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: X-User-Name: tempest-AttachVolumeTestJSON-1454716698-project May 26 12:54:13.248054 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: method: > May 26 12:54:13.248054 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: exception: Instance 51b4bd5b-19a0-4b50-804d-aff4216e854c could not be found. May 26 12:54:13.248054 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: action_args: {'id': '51b4bd5b-19a0-4b50-804d-aff4216e854c'} May 26 12:54:13.248843 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: {{(pid=129322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 12:54:13.248843 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 12:54:13.248843 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 26 12:54:13.248843 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 26 12:54:13.248843 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 26 12:54:13.248843 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 26 12:54:13.248843 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 26 12:54:13.248843 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 26 12:54:13.248843 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 26 12:54:13.248843 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 26 12:54:13.248843 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 51b4bd5b-19a0-4b50-804d-aff4216e854c could not be found. May 26 12:54:13.248843 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi May 26 12:54:13.248843 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 12:54:13.248843 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi May 26 12:54:13.248843 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 12:54:13.248843 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 12:54:13.248843 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 12:54:13.248843 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 12:54:13.248843 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 12:54:13.248843 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 12:54:13.250820 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 12:54:13.250820 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 26 12:54:13.250820 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 26 12:54:13.250820 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 26 12:54:13.250820 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 26 12:54:13.250820 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 26 12:54:13.250820 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 26 12:54:13.250820 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 26 12:54:13.250820 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 12:54:13.250820 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 51b4bd5b-19a0-4b50-804d-aff4216e854c could not be found. May 26 12:54:13.250820 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi May 26 12:54:13.250820 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 12:54:13.250820 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi May 26 12:54:13.250820 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 12:54:13.250820 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 12:54:13.250820 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 12:54:13.250820 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 12:54:13.250820 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 12:54:13.250820 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 51b4bd5b-19a0-4b50-804d-aff4216e854c could not be found. May 26 12:54:13.250820 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi May 26 12:54:13.252364 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi [None req-f6d30c63-e686-416e-973d-6fd62baf2257 tempest-AttachVolumeTestJSON-1454716698 tempest-AttachVolumeTestJSON-1454716698-project] Returning 404 to user: Instance 51b4bd5b-19a0-4b50-804d-aff4216e854c could not be found. {{(pid=129322) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 12:54:13.252364 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: INFO nova.api.openstack.requestlog [None req-f6d30c63-e686-416e-973d-6fd62baf2257 tempest-AttachVolumeTestJSON-1454716698 tempest-AttachVolumeTestJSON-1454716698-project] 10.222.0.75 "DELETE /compute/v2.1/servers/51b4bd5b-19a0-4b50-804d-aff4216e854c" status: 404 len: 111 microversion: 2.1 time: 0.029574 May 26 12:54:13.252364 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: [pid: 129322|app: 0|req: 633/1245] 10.222.0.75 () {58 vars in 1238 bytes} [Thu May 26 12:54:13 2022] DELETE /compute/v2.1/servers/51b4bd5b-19a0-4b50-804d-aff4216e854c => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 26 12:54:13.258718 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi [None req-367f2843-1fed-4cdd-8115-9355eb0b143b tempest-AttachVolumeTestJSON-1454716698 tempest-AttachVolumeTestJSON-1454716698-project] Calling method '>' {{(pid=129321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:54:13.259847 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.compute.api [None req-367f2843-1fed-4cdd-8115-9355eb0b143b tempest-AttachVolumeTestJSON-1454716698 tempest-AttachVolumeTestJSON-1454716698-project] [instance: 51b4bd5b-19a0-4b50-804d-aff4216e854c] Fetching instance by UUID {{(pid=129321) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:54:13.268384 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-367f2843-1fed-4cdd-8115-9355eb0b143b tempest-AttachVolumeTestJSON-1454716698 tempest-AttachVolumeTestJSON-1454716698-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:54:13.268865 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-367f2843-1fed-4cdd-8115-9355eb0b143b tempest-AttachVolumeTestJSON-1454716698 tempest-AttachVolumeTestJSON-1454716698-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:54:13.270000 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-367f2843-1fed-4cdd-8115-9355eb0b143b tempest-AttachVolumeTestJSON-1454716698 tempest-AttachVolumeTestJSON-1454716698-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:54:13.270624 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-367f2843-1fed-4cdd-8115-9355eb0b143b tempest-AttachVolumeTestJSON-1454716698 tempest-AttachVolumeTestJSON-1454716698-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:54:13.286239 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: INFO nova.api.openstack.wsgi [None req-367f2843-1fed-4cdd-8115-9355eb0b143b tempest-AttachVolumeTestJSON-1454716698 tempest-AttachVolumeTestJSON-1454716698-project] HTTP exception thrown: Instance 51b4bd5b-19a0-4b50-804d-aff4216e854c could not be found. May 26 12:54:13.287818 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi [None req-367f2843-1fed-4cdd-8115-9355eb0b143b tempest-AttachVolumeTestJSON-1454716698 tempest-AttachVolumeTestJSON-1454716698-project] Request method failure captured: May 26 12:54:13.287818 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: request: GET /compute/v2.1/servers/51b4bd5b-19a0-4b50-804d-aff4216e854c HTTP/1.1 May 26 12:54:13.287818 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: Accept: application/json May 26 12:54:13.287818 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: Accept-Encoding: identity May 26 12:54:13.287818 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: Connection: close May 26 12:54:13.287818 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: Content-Length: 0 May 26 12:54:13.287818 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: Content-Type: application/json May 26 12:54:13.287818 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: Host: 10.222.0.75 May 26 12:54:13.287818 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: Openstack-System-Scope: None May 26 12:54:13.287818 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: User-Agent: python-urllib3/1.26.9 May 26 12:54:13.287818 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: X-Auth-Token: gAAAAABij3biYRQth7VNOFBPzfZXJB_qWHSqHSG9e6P1UeNb-q3RPpB2aj40Ns6GyVugXTOB-VgpuQ9swDH2_aawBsT7HShFwXMj-lLhfBtfFspOvV4H1TRGH5-5fyaG-z1MHKgWVpH6S9gUyGK6Y8u3KlBpZrkU5rjhH3fCckOY_4x3OGsHu8E May 26 12:54:13.287818 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: X-Domain-Id: None May 26 12:54:13.287818 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: X-Domain-Name: None May 26 12:54:13.287818 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: X-Identity-Status: Confirmed May 26 12:54:13.287818 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: X-Is-Admin-Project: True May 26 12:54:13.287818 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: X-Project-Domain-Id: default May 26 12:54:13.287818 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: X-Project-Domain-Name: Default May 26 12:54:13.287818 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: X-Project-Id: a9f9a22ad1e74798b9b2f7d85f89a4b6 May 26 12:54:13.287818 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: X-Project-Name: tempest-AttachVolumeTestJSON-1454716698 May 26 12:54:13.287818 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: X-Role: member,reader May 26 12:54:13.287818 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: X-Roles: member,reader May 26 12:54:13.289435 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/a9f9a22ad1e74798b9b2f7d85f89a4b6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.75:8080", "publicURL": "http://10.222.0.75:8080/v1/AUTH_a9f9a22ad1e74798b9b2f7d85f89a4b6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2/a9f9a22ad1e74798b9b2f7d85f89a4b6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/a9f9a22ad1e74798b9b2f7d85f89a4b6"}]}] May 26 12:54:13.289435 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: X-Tenant: tempest-AttachVolumeTestJSON-1454716698 May 26 12:54:13.289435 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: X-Tenant-Id: a9f9a22ad1e74798b9b2f7d85f89a4b6 May 26 12:54:13.289435 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1454716698 May 26 12:54:13.289435 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: X-User: tempest-AttachVolumeTestJSON-1454716698-project May 26 12:54:13.289435 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: X-User-Domain-Id: default May 26 12:54:13.289435 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: X-User-Domain-Name: Default May 26 12:54:13.289435 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: X-User-Id: 4e987a71a29243dbac6c23e337765508 May 26 12:54:13.289435 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: X-User-Name: tempest-AttachVolumeTestJSON-1454716698-project May 26 12:54:13.289435 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: method: > May 26 12:54:13.289435 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: exception: Instance 51b4bd5b-19a0-4b50-804d-aff4216e854c could not be found. May 26 12:54:13.289435 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: action_args: {'id': '51b4bd5b-19a0-4b50-804d-aff4216e854c'} May 26 12:54:13.290337 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: {{(pid=129321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 12:54:13.290337 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 12:54:13.290337 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 26 12:54:13.290337 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 26 12:54:13.290337 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 26 12:54:13.290337 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 26 12:54:13.290337 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 26 12:54:13.290337 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 26 12:54:13.290337 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 26 12:54:13.290337 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 26 12:54:13.290337 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 51b4bd5b-19a0-4b50-804d-aff4216e854c could not be found. May 26 12:54:13.290337 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi May 26 12:54:13.290337 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 12:54:13.290337 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi May 26 12:54:13.290337 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 12:54:13.290337 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 12:54:13.290337 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 12:54:13.290337 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 12:54:13.290337 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 12:54:13.290337 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 12:54:13.291911 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 12:54:13.291911 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 26 12:54:13.291911 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 26 12:54:13.291911 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 26 12:54:13.291911 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 26 12:54:13.291911 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 26 12:54:13.291911 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 12:54:13.291911 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 51b4bd5b-19a0-4b50-804d-aff4216e854c could not be found. May 26 12:54:13.291911 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi May 26 12:54:13.291911 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 12:54:13.291911 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi May 26 12:54:13.291911 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 12:54:13.291911 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 12:54:13.291911 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 12:54:13.291911 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 12:54:13.291911 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 12:54:13.291911 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 51b4bd5b-19a0-4b50-804d-aff4216e854c could not be found. May 26 12:54:13.291911 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi May 26 12:54:13.293241 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi [None req-367f2843-1fed-4cdd-8115-9355eb0b143b tempest-AttachVolumeTestJSON-1454716698 tempest-AttachVolumeTestJSON-1454716698-project] Returning 404 to user: Instance 51b4bd5b-19a0-4b50-804d-aff4216e854c could not be found. {{(pid=129321) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 12:54:13.293241 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: INFO nova.api.openstack.requestlog [None req-367f2843-1fed-4cdd-8115-9355eb0b143b tempest-AttachVolumeTestJSON-1454716698 tempest-AttachVolumeTestJSON-1454716698-project] 10.222.0.75 "GET /compute/v2.1/servers/51b4bd5b-19a0-4b50-804d-aff4216e854c" status: 404 len: 111 microversion: 2.1 time: 0.034588 May 26 12:54:13.293241 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: [pid: 129321|app: 0|req: 613/1246] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 26 12:54:13 2022] GET /compute/v2.1/servers/51b4bd5b-19a0-4b50-804d-aff4216e854c => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 26 12:54:17.930735 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi [None req-ed6a8466-fc9f-4e0e-a261-746bb04f4a5b tempest-VolumesNegativeTest-688774257 tempest-VolumesNegativeTest-688774257-project] Action: 'create', calling method: .version_select at 0x7f82fbf6d280>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-865426406", "metadata": {"Type": "work"}}} {{(pid=129322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 12:54:17.945550 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi [None req-ed6a8466-fc9f-4e0e-a261-746bb04f4a5b tempest-VolumesNegativeTest-688774257 tempest-VolumesNegativeTest-688774257-project] Request method failure captured: May 26 12:54:17.945550 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: request: POST /compute/v2.1/os-volumes HTTP/1.1 May 26 12:54:17.945550 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: Accept: application/json May 26 12:54:17.945550 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: Accept-Encoding: identity May 26 12:54:17.945550 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: Connection: close May 26 12:54:17.945550 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: Content-Length: 121 May 26 12:54:17.945550 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: Content-Type: application/json May 26 12:54:17.945550 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: Host: 10.222.0.75 May 26 12:54:17.945550 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: Openstack-System-Scope: None May 26 12:54:17.945550 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: User-Agent: python-urllib3/1.26.9 May 26 12:54:17.945550 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: X-Auth-Token: gAAAAABij3h5YEee_bNY9oECTkgRkZz6mrs9faU_Ns2N24OH4fpemaskB7PDK2XPX-P64lTuDZRmID7L2dTtQrpF74OOu69z2883gfNjhs6mTAMHcN534Zxj-xXF-cZwgWV0xyV-i3RoXZSL_DSX0sXzUbGh0mjv6aXV5dD-3aR6cXZIOEpvVJQ May 26 12:54:17.945550 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: X-Domain-Id: None May 26 12:54:17.945550 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: X-Domain-Name: None May 26 12:54:17.945550 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: X-Identity-Status: Confirmed May 26 12:54:17.945550 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: X-Is-Admin-Project: True May 26 12:54:17.945550 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: X-Project-Domain-Id: default May 26 12:54:17.945550 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: X-Project-Domain-Name: Default May 26 12:54:17.945550 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: X-Project-Id: c7ca0ebc6b5c474d971d30031890f18c May 26 12:54:17.945550 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: X-Project-Name: tempest-VolumesNegativeTest-688774257 May 26 12:54:17.945550 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: X-Role: member,reader May 26 12:54:17.945550 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: X-Roles: member,reader May 26 12:54:17.947220 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/c7ca0ebc6b5c474d971d30031890f18c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.75:8080", "publicURL": "http://10.222.0.75:8080/v1/AUTH_c7ca0ebc6b5c474d971d30031890f18c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2/c7ca0ebc6b5c474d971d30031890f18c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/c7ca0ebc6b5c474d971d30031890f18c"}]}] May 26 12:54:17.947220 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: X-Tenant: tempest-VolumesNegativeTest-688774257 May 26 12:54:17.947220 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: X-Tenant-Id: c7ca0ebc6b5c474d971d30031890f18c May 26 12:54:17.947220 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: X-Tenant-Name: tempest-VolumesNegativeTest-688774257 May 26 12:54:17.947220 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: X-User: tempest-VolumesNegativeTest-688774257-project May 26 12:54:17.947220 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: X-User-Domain-Id: default May 26 12:54:17.947220 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: X-User-Domain-Name: Default May 26 12:54:17.947220 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: X-User-Id: 08cbe9d6b7ff42069a794e8c0ab445a2 May 26 12:54:17.947220 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: X-User-Name: tempest-VolumesNegativeTest-688774257-project May 26 12:54:17.947220 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: May 26 12:54:17.947220 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-865426406", "metadata": {"Type": "work"}}} May 26 12:54:17.947220 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: method: May 26 12:54:17.947220 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' May 26 12:54:17.948299 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-865426406', 'metadata': {'Type': 'work'}}}} May 26 12:54:17.948299 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: {{(pid=129322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 12:54:17.948299 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 12:54:17.948299 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate May 26 12:54:17.948299 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) May 26 12:54:17.948299 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate May 26 12:54:17.948299 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi raise error May 26 12:54:17.948299 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' May 26 12:54:17.948299 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi May 26 12:54:17.948299 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: May 26 12:54:17.948299 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} May 26 12:54:17.948299 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi May 26 12:54:17.948299 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi On instance['volume']: May 26 12:54:17.948299 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi '#$%' May 26 12:54:17.948299 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi May 26 12:54:17.948299 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 12:54:17.948299 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi May 26 12:54:17.948299 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 12:54:17.948299 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 12:54:17.948299 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 12:54:17.948299 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 12:54:17.948299 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 12:54:17.949956 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 26 12:54:17.949956 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 26 12:54:17.949956 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 12:54:17.949956 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 12:54:17.949956 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper May 26 12:54:17.949956 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], May 26 12:54:17.949956 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper May 26 12:54:17.949956 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) May 26 12:54:17.949956 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate May 26 12:54:17.949956 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) May 26 12:54:17.949956 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' May 26 12:54:17.949956 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi May 26 12:54:17.949956 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 12:54:17.949956 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi May 26 12:54:17.949956 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 12:54:17.949956 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 12:54:17.949956 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 12:54:17.949956 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ May 26 12:54:17.949956 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( May 26 12:54:17.951305 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' May 26 12:54:17.951305 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi May 26 12:54:17.951305 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi [None req-ed6a8466-fc9f-4e0e-a261-746bb04f4a5b tempest-VolumesNegativeTest-688774257 tempest-VolumesNegativeTest-688774257-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=129322) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 12:54:17.951305 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: INFO nova.api.openstack.requestlog [None req-ed6a8466-fc9f-4e0e-a261-746bb04f4a5b tempest-VolumesNegativeTest-688774257 tempest-VolumesNegativeTest-688774257-project] 10.222.0.75 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.143331 May 26 12:54:17.951818 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: [pid: 129322|app: 0|req: 634/1247] 10.222.0.75 () {60 vars in 1155 bytes} [Thu May 26 12:54:17 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 149 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 26 12:54:17.958827 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi [None req-bb3b37f0-59a3-4468-a3b9-9a03a62c0eba tempest-VolumesNegativeTest-688774257 tempest-VolumesNegativeTest-688774257-project] Action: 'create', calling method: .version_select at 0x7f83080941f0>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-2097825149", "metadata": {"Type": "work"}}} {{(pid=129321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 12:54:17.963421 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi [None req-bb3b37f0-59a3-4468-a3b9-9a03a62c0eba tempest-VolumesNegativeTest-688774257 tempest-VolumesNegativeTest-688774257-project] Request method failure captured: May 26 12:54:17.963421 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: request: POST /compute/v2.1/os-volumes HTTP/1.1 May 26 12:54:17.963421 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: Accept: application/json May 26 12:54:17.963421 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: Accept-Encoding: identity May 26 12:54:17.963421 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: Connection: close May 26 12:54:17.963421 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: Content-Length: 120 May 26 12:54:17.963421 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: Content-Type: application/json May 26 12:54:17.963421 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: Host: 10.222.0.75 May 26 12:54:17.963421 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: Openstack-System-Scope: None May 26 12:54:17.963421 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: User-Agent: python-urllib3/1.26.9 May 26 12:54:17.963421 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: X-Auth-Token: gAAAAABij3h5YEee_bNY9oECTkgRkZz6mrs9faU_Ns2N24OH4fpemaskB7PDK2XPX-P64lTuDZRmID7L2dTtQrpF74OOu69z2883gfNjhs6mTAMHcN534Zxj-xXF-cZwgWV0xyV-i3RoXZSL_DSX0sXzUbGh0mjv6aXV5dD-3aR6cXZIOEpvVJQ May 26 12:54:17.963421 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: X-Domain-Id: None May 26 12:54:17.963421 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: X-Domain-Name: None May 26 12:54:17.963421 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: X-Identity-Status: Confirmed May 26 12:54:17.963421 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: X-Is-Admin-Project: True May 26 12:54:17.963421 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: X-Project-Domain-Id: default May 26 12:54:17.963421 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: X-Project-Domain-Name: Default May 26 12:54:17.963421 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: X-Project-Id: c7ca0ebc6b5c474d971d30031890f18c May 26 12:54:17.963421 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: X-Project-Name: tempest-VolumesNegativeTest-688774257 May 26 12:54:17.963421 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: X-Role: member,reader May 26 12:54:17.963421 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: X-Roles: member,reader May 26 12:54:17.965082 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/c7ca0ebc6b5c474d971d30031890f18c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.75:8080", "publicURL": "http://10.222.0.75:8080/v1/AUTH_c7ca0ebc6b5c474d971d30031890f18c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2/c7ca0ebc6b5c474d971d30031890f18c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/c7ca0ebc6b5c474d971d30031890f18c"}]}] May 26 12:54:17.965082 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: X-Tenant: tempest-VolumesNegativeTest-688774257 May 26 12:54:17.965082 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: X-Tenant-Id: c7ca0ebc6b5c474d971d30031890f18c May 26 12:54:17.965082 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: X-Tenant-Name: tempest-VolumesNegativeTest-688774257 May 26 12:54:17.965082 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: X-User: tempest-VolumesNegativeTest-688774257-project May 26 12:54:17.965082 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: X-User-Domain-Id: default May 26 12:54:17.965082 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: X-User-Domain-Name: Default May 26 12:54:17.965082 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: X-User-Id: 08cbe9d6b7ff42069a794e8c0ab445a2 May 26 12:54:17.965082 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: X-User-Name: tempest-VolumesNegativeTest-688774257-project May 26 12:54:17.965082 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: May 26 12:54:17.965082 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-2097825149", "metadata": {"Type": "work"}}} May 26 12:54:17.965082 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: method: May 26 12:54:17.965082 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 May 26 12:54:17.966075 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-2097825149', 'metadata': {'Type': 'work'}}}} May 26 12:54:17.966075 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: {{(pid=129321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 12:54:17.966075 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 12:54:17.966075 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate May 26 12:54:17.966075 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) May 26 12:54:17.966075 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate May 26 12:54:17.966075 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi raise error May 26 12:54:17.966075 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 May 26 12:54:17.966075 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi May 26 12:54:17.966075 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: May 26 12:54:17.966075 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} May 26 12:54:17.966075 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi May 26 12:54:17.966075 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi On instance['volume']: May 26 12:54:17.966075 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi '0' May 26 12:54:17.966075 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi May 26 12:54:17.966075 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 12:54:17.966075 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi May 26 12:54:17.966075 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 12:54:17.966075 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 12:54:17.966075 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 12:54:17.966075 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 12:54:17.966075 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 12:54:17.967739 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 26 12:54:17.967739 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 26 12:54:17.967739 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 12:54:17.967739 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 12:54:17.967739 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper May 26 12:54:17.967739 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], May 26 12:54:17.967739 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper May 26 12:54:17.967739 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) May 26 12:54:17.967739 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate May 26 12:54:17.967739 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) May 26 12:54:17.967739 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 May 26 12:54:17.967739 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi May 26 12:54:17.967739 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 12:54:17.967739 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi May 26 12:54:17.967739 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 12:54:17.967739 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 12:54:17.967739 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 12:54:17.967739 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ May 26 12:54:17.967739 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( May 26 12:54:17.968974 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 May 26 12:54:17.968974 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi May 26 12:54:17.968974 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi [None req-bb3b37f0-59a3-4468-a3b9-9a03a62c0eba tempest-VolumesNegativeTest-688774257 tempest-VolumesNegativeTest-688774257-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=129321) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 12:54:17.968974 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: INFO nova.api.openstack.requestlog [None req-bb3b37f0-59a3-4468-a3b9-9a03a62c0eba tempest-VolumesNegativeTest-688774257 tempest-VolumesNegativeTest-688774257-project] 10.222.0.75 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.011675 May 26 12:54:17.968974 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: [pid: 129321|app: 0|req: 614/1248] 10.222.0.75 () {60 vars in 1155 bytes} [Thu May 26 12:54:17 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 13 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 26 12:54:17.974435 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi [None req-614c883f-e2f3-4f34-a3bc-151ab33b42b5 tempest-VolumesNegativeTest-688774257 tempest-VolumesNegativeTest-688774257-project] Action: 'create', calling method: .version_select at 0x7f82fbf97430>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1550599660", "metadata": {"Type": "work"}}} {{(pid=129322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 12:54:17.977746 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi [None req-614c883f-e2f3-4f34-a3bc-151ab33b42b5 tempest-VolumesNegativeTest-688774257 tempest-VolumesNegativeTest-688774257-project] Request method failure captured: May 26 12:54:17.977746 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: request: POST /compute/v2.1/os-volumes HTTP/1.1 May 26 12:54:17.977746 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: Accept: application/json May 26 12:54:17.977746 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: Accept-Encoding: identity May 26 12:54:17.977746 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: Connection: close May 26 12:54:17.977746 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: Content-Length: 119 May 26 12:54:17.977746 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: Content-Type: application/json May 26 12:54:17.977746 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: Host: 10.222.0.75 May 26 12:54:17.977746 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: Openstack-System-Scope: None May 26 12:54:17.977746 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: User-Agent: python-urllib3/1.26.9 May 26 12:54:17.977746 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: X-Auth-Token: gAAAAABij3h5YEee_bNY9oECTkgRkZz6mrs9faU_Ns2N24OH4fpemaskB7PDK2XPX-P64lTuDZRmID7L2dTtQrpF74OOu69z2883gfNjhs6mTAMHcN534Zxj-xXF-cZwgWV0xyV-i3RoXZSL_DSX0sXzUbGh0mjv6aXV5dD-3aR6cXZIOEpvVJQ May 26 12:54:17.977746 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: X-Domain-Id: None May 26 12:54:17.977746 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: X-Domain-Name: None May 26 12:54:17.977746 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: X-Identity-Status: Confirmed May 26 12:54:17.977746 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: X-Is-Admin-Project: True May 26 12:54:17.977746 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: X-Project-Domain-Id: default May 26 12:54:17.977746 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: X-Project-Domain-Name: Default May 26 12:54:17.977746 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: X-Project-Id: c7ca0ebc6b5c474d971d30031890f18c May 26 12:54:17.977746 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: X-Project-Name: tempest-VolumesNegativeTest-688774257 May 26 12:54:17.977746 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: X-Role: member,reader May 26 12:54:17.977746 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: X-Roles: member,reader May 26 12:54:17.979322 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/c7ca0ebc6b5c474d971d30031890f18c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.75:8080", "publicURL": "http://10.222.0.75:8080/v1/AUTH_c7ca0ebc6b5c474d971d30031890f18c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2/c7ca0ebc6b5c474d971d30031890f18c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/c7ca0ebc6b5c474d971d30031890f18c"}]}] May 26 12:54:17.979322 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: X-Tenant: tempest-VolumesNegativeTest-688774257 May 26 12:54:17.979322 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: X-Tenant-Id: c7ca0ebc6b5c474d971d30031890f18c May 26 12:54:17.979322 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: X-Tenant-Name: tempest-VolumesNegativeTest-688774257 May 26 12:54:17.979322 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: X-User: tempest-VolumesNegativeTest-688774257-project May 26 12:54:17.979322 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: X-User-Domain-Id: default May 26 12:54:17.979322 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: X-User-Domain-Name: Default May 26 12:54:17.979322 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: X-User-Id: 08cbe9d6b7ff42069a794e8c0ab445a2 May 26 12:54:17.979322 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: X-User-Name: tempest-VolumesNegativeTest-688774257-project May 26 12:54:17.979322 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: May 26 12:54:17.979322 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1550599660", "metadata": {"Type": "work"}}} May 26 12:54:17.979322 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: method: May 26 12:54:17.979322 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' May 26 12:54:17.980306 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-1550599660', 'metadata': {'Type': 'work'}}}} May 26 12:54:17.980306 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: {{(pid=129322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 12:54:17.980306 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 12:54:17.980306 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate May 26 12:54:17.980306 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) May 26 12:54:17.980306 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate May 26 12:54:17.980306 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi raise error May 26 12:54:17.980306 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' May 26 12:54:17.980306 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi May 26 12:54:17.980306 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: May 26 12:54:17.980306 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} May 26 12:54:17.980306 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi May 26 12:54:17.980306 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi On instance['volume']: May 26 12:54:17.980306 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi '' May 26 12:54:17.980306 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi May 26 12:54:17.980306 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 12:54:17.980306 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi May 26 12:54:17.980306 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 12:54:17.980306 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 12:54:17.980306 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 12:54:17.980306 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 12:54:17.980306 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 12:54:17.981874 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 26 12:54:17.981874 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 26 12:54:17.981874 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 12:54:17.981874 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 12:54:17.981874 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper May 26 12:54:17.981874 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], May 26 12:54:17.981874 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper May 26 12:54:17.981874 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) May 26 12:54:17.981874 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate May 26 12:54:17.981874 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) May 26 12:54:17.981874 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' May 26 12:54:17.981874 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi May 26 12:54:17.981874 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 12:54:17.981874 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi May 26 12:54:17.981874 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 12:54:17.981874 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 12:54:17.981874 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 12:54:17.981874 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ May 26 12:54:17.981874 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( May 26 12:54:17.983162 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' May 26 12:54:17.983162 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi May 26 12:54:17.983162 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi [None req-614c883f-e2f3-4f34-a3bc-151ab33b42b5 tempest-VolumesNegativeTest-688774257 tempest-VolumesNegativeTest-688774257-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=129322) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 12:54:17.983162 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: INFO nova.api.openstack.requestlog [None req-614c883f-e2f3-4f34-a3bc-151ab33b42b5 tempest-VolumesNegativeTest-688774257 tempest-VolumesNegativeTest-688774257-project] 10.222.0.75 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.008735 May 26 12:54:17.983162 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: [pid: 129322|app: 0|req: 635/1249] 10.222.0.75 () {60 vars in 1155 bytes} [Thu May 26 12:54:17 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 10 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 26 12:54:17.989548 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi [None req-bfd5de7f-92ef-4848-91f6-a6cd025e3c16 tempest-VolumesNegativeTest-688774257 tempest-VolumesNegativeTest-688774257-project] Calling method '.version_select at 0x7f82fbf3c550>' {{(pid=129321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:54:18.020036 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: INFO nova.api.openstack.wsgi [None req-bfd5de7f-92ef-4848-91f6-a6cd025e3c16 tempest-VolumesNegativeTest-688774257 tempest-VolumesNegativeTest-688774257-project] HTTP exception thrown: Volume tempest-invalid-1631027091 could not be found. May 26 12:54:18.022167 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi [None req-bfd5de7f-92ef-4848-91f6-a6cd025e3c16 tempest-VolumesNegativeTest-688774257 tempest-VolumesNegativeTest-688774257-project] Request method failure captured: May 26 12:54:18.022167 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-1631027091 HTTP/1.1 May 26 12:54:18.022167 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: Accept: application/json May 26 12:54:18.022167 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: Accept-Encoding: identity May 26 12:54:18.022167 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: Connection: close May 26 12:54:18.022167 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: Content-Length: 0 May 26 12:54:18.022167 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: Content-Type: application/json May 26 12:54:18.022167 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: Host: 10.222.0.75 May 26 12:54:18.022167 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: Openstack-System-Scope: None May 26 12:54:18.022167 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: User-Agent: python-urllib3/1.26.9 May 26 12:54:18.022167 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: X-Auth-Token: gAAAAABij3h5YEee_bNY9oECTkgRkZz6mrs9faU_Ns2N24OH4fpemaskB7PDK2XPX-P64lTuDZRmID7L2dTtQrpF74OOu69z2883gfNjhs6mTAMHcN534Zxj-xXF-cZwgWV0xyV-i3RoXZSL_DSX0sXzUbGh0mjv6aXV5dD-3aR6cXZIOEpvVJQ May 26 12:54:18.022167 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: X-Domain-Id: None May 26 12:54:18.022167 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: X-Domain-Name: None May 26 12:54:18.022167 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: X-Identity-Status: Confirmed May 26 12:54:18.022167 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: X-Is-Admin-Project: True May 26 12:54:18.022167 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: X-Project-Domain-Id: default May 26 12:54:18.022167 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: X-Project-Domain-Name: Default May 26 12:54:18.022167 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: X-Project-Id: c7ca0ebc6b5c474d971d30031890f18c May 26 12:54:18.022167 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: X-Project-Name: tempest-VolumesNegativeTest-688774257 May 26 12:54:18.022167 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: X-Role: member,reader May 26 12:54:18.022167 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: X-Roles: member,reader May 26 12:54:18.023831 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/c7ca0ebc6b5c474d971d30031890f18c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.75:8080", "publicURL": "http://10.222.0.75:8080/v1/AUTH_c7ca0ebc6b5c474d971d30031890f18c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2/c7ca0ebc6b5c474d971d30031890f18c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/c7ca0ebc6b5c474d971d30031890f18c"}]}] May 26 12:54:18.023831 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: X-Tenant: tempest-VolumesNegativeTest-688774257 May 26 12:54:18.023831 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: X-Tenant-Id: c7ca0ebc6b5c474d971d30031890f18c May 26 12:54:18.023831 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: X-Tenant-Name: tempest-VolumesNegativeTest-688774257 May 26 12:54:18.023831 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: X-User: tempest-VolumesNegativeTest-688774257-project May 26 12:54:18.023831 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: X-User-Domain-Id: default May 26 12:54:18.023831 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: X-User-Domain-Name: Default May 26 12:54:18.023831 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: X-User-Id: 08cbe9d6b7ff42069a794e8c0ab445a2 May 26 12:54:18.023831 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: X-User-Name: tempest-VolumesNegativeTest-688774257-project May 26 12:54:18.023831 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: method: May 26 12:54:18.023831 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: exception: Volume tempest-invalid-1631027091 could not be found. May 26 12:54:18.023831 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: action_args: {'id': 'tempest-invalid-1631027091'} May 26 12:54:18.023831 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: {{(pid=129321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 12:54:18.024776 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 12:54:18.024776 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 26 12:54:18.024776 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 26 12:54:18.024776 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete May 26 12:54:18.024776 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) May 26 12:54:18.024776 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete May 26 12:54:18.024776 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi return self._delete(loc) May 26 12:54:18.024776 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete May 26 12:54:18.024776 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) May 26 12:54:18.024776 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete May 26 12:54:18.024776 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) May 26 12:54:18.024776 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 26 12:54:18.024776 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 26 12:54:18.024776 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 26 12:54:18.024776 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 26 12:54:18.024776 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-1631027091 could not be found. (HTTP 404) (Request-ID: req-dbe4a17d-a408-4e70-9ff5-14443a9a57a5) May 26 12:54:18.024776 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi May 26 12:54:18.024776 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 12:54:18.024776 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi May 26 12:54:18.026609 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 12:54:18.026609 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete May 26 12:54:18.026609 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) May 26 12:54:18.026609 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 26 12:54:18.026609 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 26 12:54:18.026609 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 26 12:54:18.026609 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 26 12:54:18.026609 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 26 12:54:18.026609 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 26 12:54:18.026609 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 26 12:54:18.026609 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 26 12:54:18.026609 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete May 26 12:54:18.026609 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) May 26 12:54:18.026609 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete May 26 12:54:18.026609 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi return self._delete(loc) May 26 12:54:18.026609 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete May 26 12:54:18.026609 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) May 26 12:54:18.026609 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete May 26 12:54:18.026609 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) May 26 12:54:18.027833 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 26 12:54:18.027833 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 26 12:54:18.027833 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 26 12:54:18.027833 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 26 12:54:18.027833 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-1631027091 could not be found. May 26 12:54:18.027833 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi May 26 12:54:18.027833 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 12:54:18.027833 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi May 26 12:54:18.027833 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 12:54:18.027833 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 12:54:18.027833 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 12:54:18.027833 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 12:54:18.027833 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 12:54:18.027833 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 26 12:54:18.027833 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 26 12:54:18.027833 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 12:54:18.027833 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 12:54:18.027833 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete May 26 12:54:18.027833 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 12:54:18.027833 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-1631027091 could not be found. May 26 12:54:18.029180 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi May 26 12:54:18.029180 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 12:54:18.029180 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi May 26 12:54:18.029180 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 12:54:18.029180 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 12:54:18.029180 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 12:54:18.029180 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 12:54:18.029180 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 12:54:18.029180 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-1631027091 could not be found. May 26 12:54:18.029180 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi May 26 12:54:18.029180 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi [None req-bfd5de7f-92ef-4848-91f6-a6cd025e3c16 tempest-VolumesNegativeTest-688774257 tempest-VolumesNegativeTest-688774257-project] Returning 404 to user: Volume tempest-invalid-1631027091 could not be found. {{(pid=129321) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 12:54:18.029180 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: INFO nova.api.openstack.requestlog [None req-bfd5de7f-92ef-4848-91f6-a6cd025e3c16 tempest-VolumesNegativeTest-688774257 tempest-VolumesNegativeTest-688774257-project] 10.222.0.75 "DELETE /compute/v2.1/os-volumes/tempest-invalid-1631027091" status: 404 len: 99 microversion: 2.1 time: 0.038597 May 26 12:54:18.029180 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: [pid: 129321|app: 0|req: 615/1250] 10.222.0.75 () {58 vars in 1217 bytes} [Thu May 26 12:54:17 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-1631027091 => generated 99 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) May 26 12:54:18.033509 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: INFO nova.api.openstack.requestlog [None req-8f733e9f-5ca5-4da7-a396-047e1dc111e4 tempest-VolumesNegativeTest-688774257 tempest-VolumesNegativeTest-688774257-project] 10.222.0.75 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.003919 May 26 12:54:18.034002 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: [pid: 129322|app: 0|req: 636/1251] 10.222.0.75 () {58 vars in 1139 bytes} [Thu May 26 12:54:18 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 5 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) May 26 12:54:18.043463 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: INFO nova.api.openstack.requestlog [None req-fc16a372-70c5-4f11-bf88-80adce2c2155 tempest-VolumesNegativeTest-688774257 tempest-VolumesNegativeTest-688774257-project] 10.222.0.75 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.004326 May 26 12:54:18.044763 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: [pid: 129321|app: 0|req: 616/1252] 10.222.0.75 () {58 vars in 1136 bytes} [Thu May 26 12:54:18 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 6 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) May 26 12:54:18.052845 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi [None req-2f6cda78-4a82-43c3-87e3-45a6a8b48d73 tempest-VolumesNegativeTest-688774257 tempest-VolumesNegativeTest-688774257-project] Calling method '.version_select at 0x7f83084bc3a0>' {{(pid=129322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:54:18.081651 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: INFO nova.api.openstack.wsgi [None req-2f6cda78-4a82-43c3-87e3-45a6a8b48d73 tempest-VolumesNegativeTest-688774257 tempest-VolumesNegativeTest-688774257-project] HTTP exception thrown: Volume e131a877-34cb-4048-830c-ea648d157235 could not be found. May 26 12:54:18.083669 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi [None req-2f6cda78-4a82-43c3-87e3-45a6a8b48d73 tempest-VolumesNegativeTest-688774257 tempest-VolumesNegativeTest-688774257-project] Request method failure captured: May 26 12:54:18.083669 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: request: DELETE /compute/v2.1/os-volumes/e131a877-34cb-4048-830c-ea648d157235 HTTP/1.1 May 26 12:54:18.083669 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: Accept: application/json May 26 12:54:18.083669 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: Accept-Encoding: identity May 26 12:54:18.083669 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: Connection: close May 26 12:54:18.083669 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: Content-Length: 0 May 26 12:54:18.083669 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: Content-Type: application/json May 26 12:54:18.083669 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: Host: 10.222.0.75 May 26 12:54:18.083669 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: Openstack-System-Scope: None May 26 12:54:18.083669 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: User-Agent: python-urllib3/1.26.9 May 26 12:54:18.083669 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: X-Auth-Token: gAAAAABij3h5YEee_bNY9oECTkgRkZz6mrs9faU_Ns2N24OH4fpemaskB7PDK2XPX-P64lTuDZRmID7L2dTtQrpF74OOu69z2883gfNjhs6mTAMHcN534Zxj-xXF-cZwgWV0xyV-i3RoXZSL_DSX0sXzUbGh0mjv6aXV5dD-3aR6cXZIOEpvVJQ May 26 12:54:18.083669 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: X-Domain-Id: None May 26 12:54:18.083669 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: X-Domain-Name: None May 26 12:54:18.083669 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: X-Identity-Status: Confirmed May 26 12:54:18.083669 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: X-Is-Admin-Project: True May 26 12:54:18.083669 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: X-Project-Domain-Id: default May 26 12:54:18.083669 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: X-Project-Domain-Name: Default May 26 12:54:18.083669 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: X-Project-Id: c7ca0ebc6b5c474d971d30031890f18c May 26 12:54:18.083669 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: X-Project-Name: tempest-VolumesNegativeTest-688774257 May 26 12:54:18.083669 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: X-Role: member,reader May 26 12:54:18.083669 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: X-Roles: member,reader May 26 12:54:18.085239 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/c7ca0ebc6b5c474d971d30031890f18c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.75:8080", "publicURL": "http://10.222.0.75:8080/v1/AUTH_c7ca0ebc6b5c474d971d30031890f18c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2/c7ca0ebc6b5c474d971d30031890f18c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/c7ca0ebc6b5c474d971d30031890f18c"}]}] May 26 12:54:18.085239 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: X-Tenant: tempest-VolumesNegativeTest-688774257 May 26 12:54:18.085239 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: X-Tenant-Id: c7ca0ebc6b5c474d971d30031890f18c May 26 12:54:18.085239 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: X-Tenant-Name: tempest-VolumesNegativeTest-688774257 May 26 12:54:18.085239 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: X-User: tempest-VolumesNegativeTest-688774257-project May 26 12:54:18.085239 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: X-User-Domain-Id: default May 26 12:54:18.085239 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: X-User-Domain-Name: Default May 26 12:54:18.085239 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: X-User-Id: 08cbe9d6b7ff42069a794e8c0ab445a2 May 26 12:54:18.085239 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: X-User-Name: tempest-VolumesNegativeTest-688774257-project May 26 12:54:18.085239 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: method: May 26 12:54:18.085239 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: exception: Volume e131a877-34cb-4048-830c-ea648d157235 could not be found. May 26 12:54:18.085239 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: action_args: {'id': 'e131a877-34cb-4048-830c-ea648d157235'} May 26 12:54:18.085239 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: {{(pid=129322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 12:54:18.086221 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 12:54:18.086221 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 26 12:54:18.086221 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 26 12:54:18.086221 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete May 26 12:54:18.086221 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) May 26 12:54:18.086221 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete May 26 12:54:18.086221 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi return self._delete(loc) May 26 12:54:18.086221 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete May 26 12:54:18.086221 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) May 26 12:54:18.086221 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete May 26 12:54:18.086221 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) May 26 12:54:18.086221 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 26 12:54:18.086221 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 26 12:54:18.086221 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 26 12:54:18.086221 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 26 12:54:18.086221 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume e131a877-34cb-4048-830c-ea648d157235 could not be found. (HTTP 404) (Request-ID: req-6ccffd87-6f19-4b56-b179-288d0792d8fc) May 26 12:54:18.086221 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi May 26 12:54:18.086221 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 12:54:18.086221 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi May 26 12:54:18.087629 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 12:54:18.087629 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete May 26 12:54:18.087629 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) May 26 12:54:18.087629 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 26 12:54:18.087629 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 26 12:54:18.087629 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 26 12:54:18.087629 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 26 12:54:18.087629 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 26 12:54:18.087629 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 26 12:54:18.087629 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 26 12:54:18.087629 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 26 12:54:18.087629 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete May 26 12:54:18.087629 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) May 26 12:54:18.087629 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete May 26 12:54:18.087629 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi return self._delete(loc) May 26 12:54:18.087629 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete May 26 12:54:18.087629 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) May 26 12:54:18.087629 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete May 26 12:54:18.087629 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) May 26 12:54:18.089072 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 26 12:54:18.089072 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 26 12:54:18.089072 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 26 12:54:18.089072 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 26 12:54:18.089072 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume e131a877-34cb-4048-830c-ea648d157235 could not be found. May 26 12:54:18.089072 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi May 26 12:54:18.089072 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 12:54:18.089072 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi May 26 12:54:18.089072 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 12:54:18.089072 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 12:54:18.089072 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 12:54:18.089072 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 12:54:18.089072 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 12:54:18.089072 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 26 12:54:18.089072 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 26 12:54:18.089072 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 12:54:18.089072 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 12:54:18.089072 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete May 26 12:54:18.089072 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 12:54:18.090489 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume e131a877-34cb-4048-830c-ea648d157235 could not be found. May 26 12:54:18.090489 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi May 26 12:54:18.090489 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 12:54:18.090489 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi May 26 12:54:18.090489 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 12:54:18.090489 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 12:54:18.090489 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 12:54:18.090489 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 12:54:18.090489 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 12:54:18.090489 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume e131a877-34cb-4048-830c-ea648d157235 could not be found. May 26 12:54:18.090489 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi May 26 12:54:18.090489 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi [None req-2f6cda78-4a82-43c3-87e3-45a6a8b48d73 tempest-VolumesNegativeTest-688774257 tempest-VolumesNegativeTest-688774257-project] Returning 404 to user: Volume e131a877-34cb-4048-830c-ea648d157235 could not be found. {{(pid=129322) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 12:54:18.090489 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: INFO nova.api.openstack.requestlog [None req-2f6cda78-4a82-43c3-87e3-45a6a8b48d73 tempest-VolumesNegativeTest-688774257 tempest-VolumesNegativeTest-688774257-project] 10.222.0.75 "DELETE /compute/v2.1/os-volumes/e131a877-34cb-4048-830c-ea648d157235" status: 404 len: 109 microversion: 2.1 time: 0.036101 May 26 12:54:18.090489 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: [pid: 129322|app: 0|req: 637/1253] 10.222.0.75 () {58 vars in 1247 bytes} [Thu May 26 12:54:18 2022] DELETE /compute/v2.1/os-volumes/e131a877-34cb-4048-830c-ea648d157235 => generated 109 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 26 12:54:18.095407 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi [None req-8a71775d-6038-4da6-881d-ca9c83a13a4f tempest-VolumesNegativeTest-688774257 tempest-VolumesNegativeTest-688774257-project] Calling method '.version_select at 0x7f8308a0f1f0>' {{(pid=129321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:54:18.125391 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: INFO nova.api.openstack.wsgi [None req-8a71775d-6038-4da6-881d-ca9c83a13a4f tempest-VolumesNegativeTest-688774257 tempest-VolumesNegativeTest-688774257-project] HTTP exception thrown: Volume 7cceb561-4937-478b-af1f-5207a1e317f3 could not be found. May 26 12:54:18.127569 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi [None req-8a71775d-6038-4da6-881d-ca9c83a13a4f tempest-VolumesNegativeTest-688774257 tempest-VolumesNegativeTest-688774257-project] Request method failure captured: May 26 12:54:18.127569 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: request: GET /compute/v2.1/os-volumes/7cceb561-4937-478b-af1f-5207a1e317f3 HTTP/1.1 May 26 12:54:18.127569 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: Accept: application/json May 26 12:54:18.127569 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: Accept-Encoding: identity May 26 12:54:18.127569 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: Connection: close May 26 12:54:18.127569 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: Content-Length: 0 May 26 12:54:18.127569 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: Content-Type: application/json May 26 12:54:18.127569 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: Host: 10.222.0.75 May 26 12:54:18.127569 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: Openstack-System-Scope: None May 26 12:54:18.127569 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: User-Agent: python-urllib3/1.26.9 May 26 12:54:18.127569 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: X-Auth-Token: gAAAAABij3h5YEee_bNY9oECTkgRkZz6mrs9faU_Ns2N24OH4fpemaskB7PDK2XPX-P64lTuDZRmID7L2dTtQrpF74OOu69z2883gfNjhs6mTAMHcN534Zxj-xXF-cZwgWV0xyV-i3RoXZSL_DSX0sXzUbGh0mjv6aXV5dD-3aR6cXZIOEpvVJQ May 26 12:54:18.127569 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: X-Domain-Id: None May 26 12:54:18.127569 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: X-Domain-Name: None May 26 12:54:18.127569 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: X-Identity-Status: Confirmed May 26 12:54:18.127569 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: X-Is-Admin-Project: True May 26 12:54:18.127569 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: X-Project-Domain-Id: default May 26 12:54:18.127569 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: X-Project-Domain-Name: Default May 26 12:54:18.127569 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: X-Project-Id: c7ca0ebc6b5c474d971d30031890f18c May 26 12:54:18.127569 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: X-Project-Name: tempest-VolumesNegativeTest-688774257 May 26 12:54:18.127569 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: X-Role: member,reader May 26 12:54:18.127569 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: X-Roles: member,reader May 26 12:54:18.129168 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/c7ca0ebc6b5c474d971d30031890f18c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.75:8080", "publicURL": "http://10.222.0.75:8080/v1/AUTH_c7ca0ebc6b5c474d971d30031890f18c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2/c7ca0ebc6b5c474d971d30031890f18c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/c7ca0ebc6b5c474d971d30031890f18c"}]}] May 26 12:54:18.129168 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: X-Tenant: tempest-VolumesNegativeTest-688774257 May 26 12:54:18.129168 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: X-Tenant-Id: c7ca0ebc6b5c474d971d30031890f18c May 26 12:54:18.129168 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: X-Tenant-Name: tempest-VolumesNegativeTest-688774257 May 26 12:54:18.129168 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: X-User: tempest-VolumesNegativeTest-688774257-project May 26 12:54:18.129168 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: X-User-Domain-Id: default May 26 12:54:18.129168 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: X-User-Domain-Name: Default May 26 12:54:18.129168 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: X-User-Id: 08cbe9d6b7ff42069a794e8c0ab445a2 May 26 12:54:18.129168 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: X-User-Name: tempest-VolumesNegativeTest-688774257-project May 26 12:54:18.129168 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: method: May 26 12:54:18.129168 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: exception: Volume 7cceb561-4937-478b-af1f-5207a1e317f3 could not be found. May 26 12:54:18.129168 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: action_args: {'id': '7cceb561-4937-478b-af1f-5207a1e317f3'} May 26 12:54:18.129168 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: {{(pid=129321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 12:54:18.130396 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 12:54:18.130396 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 26 12:54:18.130396 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 26 12:54:18.130396 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 26 12:54:18.130396 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi item = cinderclient( May 26 12:54:18.130396 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 26 12:54:18.130396 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 26 12:54:18.130396 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 26 12:54:18.130396 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 26 12:54:18.130396 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 26 12:54:18.130396 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 26 12:54:18.130396 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 26 12:54:18.130396 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 26 12:54:18.130396 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 26 12:54:18.130396 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 26 12:54:18.130396 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 7cceb561-4937-478b-af1f-5207a1e317f3 could not be found. (HTTP 404) (Request-ID: req-0c5593d8-4471-4d3b-83e9-48dc2835c812) May 26 12:54:18.130396 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi May 26 12:54:18.130396 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 12:54:18.130396 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi May 26 12:54:18.131956 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 12:54:18.131956 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show May 26 12:54:18.131956 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) May 26 12:54:18.131956 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 26 12:54:18.131956 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 26 12:54:18.131956 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 26 12:54:18.131956 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 26 12:54:18.131956 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 26 12:54:18.131956 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 26 12:54:18.131956 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 26 12:54:18.131956 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 26 12:54:18.131956 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 26 12:54:18.131956 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi item = cinderclient( May 26 12:54:18.131956 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 26 12:54:18.131956 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 26 12:54:18.131956 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 26 12:54:18.131956 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 26 12:54:18.131956 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 26 12:54:18.131956 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 26 12:54:18.133322 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 26 12:54:18.133322 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 26 12:54:18.133322 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 26 12:54:18.133322 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 26 12:54:18.133322 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 7cceb561-4937-478b-af1f-5207a1e317f3 could not be found. May 26 12:54:18.133322 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi May 26 12:54:18.133322 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 12:54:18.133322 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi May 26 12:54:18.133322 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 12:54:18.133322 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 12:54:18.133322 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 12:54:18.133322 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 12:54:18.133322 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 12:54:18.133322 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 26 12:54:18.133322 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 26 12:54:18.133322 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 12:54:18.133322 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 12:54:18.133322 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show May 26 12:54:18.133322 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 12:54:18.134841 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 7cceb561-4937-478b-af1f-5207a1e317f3 could not be found. May 26 12:54:18.134841 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi May 26 12:54:18.134841 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 12:54:18.134841 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi May 26 12:54:18.134841 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 12:54:18.134841 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 12:54:18.134841 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 12:54:18.134841 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 12:54:18.134841 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 12:54:18.134841 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 7cceb561-4937-478b-af1f-5207a1e317f3 could not be found. May 26 12:54:18.134841 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi May 26 12:54:18.134841 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi [None req-8a71775d-6038-4da6-881d-ca9c83a13a4f tempest-VolumesNegativeTest-688774257 tempest-VolumesNegativeTest-688774257-project] Returning 404 to user: Volume 7cceb561-4937-478b-af1f-5207a1e317f3 could not be found. {{(pid=129321) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 12:54:18.134841 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: INFO nova.api.openstack.requestlog [None req-8a71775d-6038-4da6-881d-ca9c83a13a4f tempest-VolumesNegativeTest-688774257 tempest-VolumesNegativeTest-688774257-project] 10.222.0.75 "GET /compute/v2.1/os-volumes/7cceb561-4937-478b-af1f-5207a1e317f3" status: 404 len: 109 microversion: 2.1 time: 0.037598 May 26 12:54:18.134841 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: [pid: 129321|app: 0|req: 617/1254] 10.222.0.75 () {58 vars in 1244 bytes} [Thu May 26 12:54:18 2022] GET /compute/v2.1/os-volumes/7cceb561-4937-478b-af1f-5207a1e317f3 => generated 109 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 26 12:54:47.311274 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 26 12:54:47.311839 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: Thu May 26 12:54:47 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 26 12:55:00.330167 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG dbcounter [-] [129322] Writing DB stats nova_api:SELECT=24,nova_api:UPDATE=1 {{(pid=129322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:55:00.330924 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG dbcounter [-] [129322] Writing DB stats nova_cell1:SELECT=14 {{(pid=129322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:55:00.335817 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi [None req-c7f86b2c-6baf-477f-a897-3add0eef8dce tempest-VolumesNegativeTest-1619659463 tempest-VolumesNegativeTest-1619659463-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-525028565", "imageRef": "1e3c323d-d797-4e6d-bd9a-482d90084b0c", "flavorRef": "452"}} {{(pid=129322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 12:55:00.395753 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.network.neutron [None req-c7f86b2c-6baf-477f-a897-3add0eef8dce tempest-VolumesNegativeTest-1619659463 tempest-VolumesNegativeTest-1619659463-project] validate_networks() for None {{(pid=129322) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 26 12:55:00.907861 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.virt.hardware [None req-c7f86b2c-6baf-477f-a897-3add0eef8dce tempest-VolumesNegativeTest-1619659463 tempest-VolumesNegativeTest-1619659463-project] Flavor limits 0:0:0 {{(pid=129322) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 26 12:55:00.908171 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.virt.hardware [None req-c7f86b2c-6baf-477f-a897-3add0eef8dce tempest-VolumesNegativeTest-1619659463 tempest-VolumesNegativeTest-1619659463-project] Image limits 0:0:0 {{(pid=129322) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 26 12:55:00.908645 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.virt.hardware [None req-c7f86b2c-6baf-477f-a897-3add0eef8dce tempest-VolumesNegativeTest-1619659463 tempest-VolumesNegativeTest-1619659463-project] Flavor pref 0:0:0 {{(pid=129322) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 26 12:55:00.909049 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.virt.hardware [None req-c7f86b2c-6baf-477f-a897-3add0eef8dce tempest-VolumesNegativeTest-1619659463 tempest-VolumesNegativeTest-1619659463-project] Image pref 0:0:0 {{(pid=129322) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 26 12:55:00.909467 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.virt.hardware [None req-c7f86b2c-6baf-477f-a897-3add0eef8dce tempest-VolumesNegativeTest-1619659463 tempest-VolumesNegativeTest-1619659463-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129322) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 26 12:55:00.919805 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-c7f86b2c-6baf-477f-a897-3add0eef8dce tempest-VolumesNegativeTest-1619659463 tempest-VolumesNegativeTest-1619659463-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:55:00.920321 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-c7f86b2c-6baf-477f-a897-3add0eef8dce tempest-VolumesNegativeTest-1619659463 tempest-VolumesNegativeTest-1619659463-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:55:00.921118 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-c7f86b2c-6baf-477f-a897-3add0eef8dce tempest-VolumesNegativeTest-1619659463 tempest-VolumesNegativeTest-1619659463-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:55:00.921552 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-c7f86b2c-6baf-477f-a897-3add0eef8dce tempest-VolumesNegativeTest-1619659463 tempest-VolumesNegativeTest-1619659463-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:55:00.940306 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.quota [None req-c7f86b2c-6baf-477f-a897-3add0eef8dce tempest-VolumesNegativeTest-1619659463 tempest-VolumesNegativeTest-1619659463-project] Getting quotas for project 33b0c6f982c3403a89906977ffb05bc3. Resources: {'instances', 'cores', 'ram'} {{(pid=129322) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 26 12:55:00.944537 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.quota [None req-c7f86b2c-6baf-477f-a897-3add0eef8dce tempest-VolumesNegativeTest-1619659463 tempest-VolumesNegativeTest-1619659463-project] Getting quotas for user e9ae772c030c4944a5e7aabb745f0ea7 and project 33b0c6f982c3403a89906977ffb05bc3. Resources: {'instances', 'cores', 'ram'} {{(pid=129322) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 26 12:55:00.956367 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.compute.api [None req-c7f86b2c-6baf-477f-a897-3add0eef8dce tempest-VolumesNegativeTest-1619659463 tempest-VolumesNegativeTest-1619659463-project] Going to run 1 instances... {{(pid=129322) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 26 12:55:00.958646 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.compute.api [None req-c7f86b2c-6baf-477f-a897-3add0eef8dce tempest-VolumesNegativeTest-1619659463 tempest-VolumesNegativeTest-1619659463-project] [instance: 293dc634-5657-4796-b6cd-7c7fcd95a326] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1e3c323d-d797-4e6d-bd9a-482d90084b0c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129322) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 26 12:55:01.004830 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: INFO nova.api.openstack.requestlog [None req-c7f86b2c-6baf-477f-a897-3add0eef8dce tempest-VolumesNegativeTest-1619659463 tempest-VolumesNegativeTest-1619659463-project] 10.222.0.75 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.676848 May 26 12:55:01.005769 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: [pid: 129322|app: 0|req: 638/1255] 10.222.0.75 () {60 vars in 1146 bytes} [Thu May 26 12:55:00 2022] POST /compute/v2.1/servers => generated 380 bytes in 678 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 26 12:55:01.014222 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG dbcounter [-] [129321] Writing DB stats nova_api:SELECT=25,nova_api:DELETE=1 {{(pid=129321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:55:01.015051 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG dbcounter [-] [129321] Writing DB stats nova_cell1:SELECT=40,nova_cell1:INSERT=2 {{(pid=129321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:55:01.019482 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi [None req-4f9ea0cf-5a86-4eca-8de3-ef7877bec61d tempest-VolumesNegativeTest-1619659463 tempest-VolumesNegativeTest-1619659463-project] Calling method '>' {{(pid=129321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:55:01.020331 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.compute.api [None req-4f9ea0cf-5a86-4eca-8de3-ef7877bec61d tempest-VolumesNegativeTest-1619659463 tempest-VolumesNegativeTest-1619659463-project] [instance: 293dc634-5657-4796-b6cd-7c7fcd95a326] Fetching instance by UUID {{(pid=129321) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:55:01.078362 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.policy [None req-4f9ea0cf-5a86-4eca-8de3-ef7877bec61d tempest-VolumesNegativeTest-1619659463 tempest-VolumesNegativeTest-1619659463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9ae772c030c4944a5e7aabb745f0ea7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33b0c6f982c3403a89906977ffb05bc3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129321) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:55:01.085284 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: INFO nova.api.openstack.requestlog [None req-4f9ea0cf-5a86-4eca-8de3-ef7877bec61d tempest-VolumesNegativeTest-1619659463 tempest-VolumesNegativeTest-1619659463-project] 10.222.0.75 "GET /compute/v2.1/servers/293dc634-5657-4796-b6cd-7c7fcd95a326" status: 200 len: 1214 microversion: 2.1 time: 0.073570 May 26 12:55:01.085839 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: [pid: 129321|app: 0|req: 618/1256] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 26 12:55:01 2022] GET /compute/v2.1/servers/293dc634-5657-4796-b6cd-7c7fcd95a326 => generated 1214 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:55:02.103907 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi [None req-f2e134b1-cc96-428e-b3f1-569d25bc8baa tempest-VolumesNegativeTest-1619659463 tempest-VolumesNegativeTest-1619659463-project] Calling method '>' {{(pid=129322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:55:02.104548 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.compute.api [None req-f2e134b1-cc96-428e-b3f1-569d25bc8baa tempest-VolumesNegativeTest-1619659463 tempest-VolumesNegativeTest-1619659463-project] [instance: 293dc634-5657-4796-b6cd-7c7fcd95a326] Fetching instance by UUID {{(pid=129322) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:55:02.111483 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-f2e134b1-cc96-428e-b3f1-569d25bc8baa tempest-VolumesNegativeTest-1619659463 tempest-VolumesNegativeTest-1619659463-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:55:02.111955 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-f2e134b1-cc96-428e-b3f1-569d25bc8baa tempest-VolumesNegativeTest-1619659463 tempest-VolumesNegativeTest-1619659463-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:55:02.112912 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-f2e134b1-cc96-428e-b3f1-569d25bc8baa tempest-VolumesNegativeTest-1619659463 tempest-VolumesNegativeTest-1619659463-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:55:02.113346 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-f2e134b1-cc96-428e-b3f1-569d25bc8baa tempest-VolumesNegativeTest-1619659463 tempest-VolumesNegativeTest-1619659463-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:55:02.178597 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.policy [None req-f2e134b1-cc96-428e-b3f1-569d25bc8baa tempest-VolumesNegativeTest-1619659463 tempest-VolumesNegativeTest-1619659463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9ae772c030c4944a5e7aabb745f0ea7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33b0c6f982c3403a89906977ffb05bc3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129322) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:55:02.188792 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: INFO nova.api.openstack.requestlog [None req-f2e134b1-cc96-428e-b3f1-569d25bc8baa tempest-VolumesNegativeTest-1619659463 tempest-VolumesNegativeTest-1619659463-project] 10.222.0.75 "GET /compute/v2.1/servers/293dc634-5657-4796-b6cd-7c7fcd95a326" status: 200 len: 1284 microversion: 2.1 time: 0.089901 May 26 12:55:02.189356 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: [pid: 129322|app: 0|req: 639/1257] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 26 12:55:02 2022] GET /compute/v2.1/servers/293dc634-5657-4796-b6cd-7c7fcd95a326 => generated 1284 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:55:03.206315 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi [None req-d03a629b-d7e0-41d8-a2ec-3f9d815e5f9f tempest-VolumesNegativeTest-1619659463 tempest-VolumesNegativeTest-1619659463-project] Calling method '>' {{(pid=129321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:55:03.206992 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.compute.api [None req-d03a629b-d7e0-41d8-a2ec-3f9d815e5f9f tempest-VolumesNegativeTest-1619659463 tempest-VolumesNegativeTest-1619659463-project] [instance: 293dc634-5657-4796-b6cd-7c7fcd95a326] Fetching instance by UUID {{(pid=129321) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:55:03.216980 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-d03a629b-d7e0-41d8-a2ec-3f9d815e5f9f tempest-VolumesNegativeTest-1619659463 tempest-VolumesNegativeTest-1619659463-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:55:03.217337 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-d03a629b-d7e0-41d8-a2ec-3f9d815e5f9f tempest-VolumesNegativeTest-1619659463 tempest-VolumesNegativeTest-1619659463-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:55:03.218118 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-d03a629b-d7e0-41d8-a2ec-3f9d815e5f9f tempest-VolumesNegativeTest-1619659463 tempest-VolumesNegativeTest-1619659463-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:55:03.218553 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-d03a629b-d7e0-41d8-a2ec-3f9d815e5f9f tempest-VolumesNegativeTest-1619659463 tempest-VolumesNegativeTest-1619659463-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:55:03.429009 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.policy [None req-d03a629b-d7e0-41d8-a2ec-3f9d815e5f9f tempest-VolumesNegativeTest-1619659463 tempest-VolumesNegativeTest-1619659463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9ae772c030c4944a5e7aabb745f0ea7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33b0c6f982c3403a89906977ffb05bc3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129321) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:55:03.441006 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: INFO nova.api.openstack.requestlog [None req-d03a629b-d7e0-41d8-a2ec-3f9d815e5f9f tempest-VolumesNegativeTest-1619659463 tempest-VolumesNegativeTest-1619659463-project] 10.222.0.75 "GET /compute/v2.1/servers/293dc634-5657-4796-b6cd-7c7fcd95a326" status: 200 len: 1314 microversion: 2.1 time: 0.238234 May 26 12:55:03.441836 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: [pid: 129321|app: 0|req: 619/1258] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 26 12:55:03 2022] GET /compute/v2.1/servers/293dc634-5657-4796-b6cd-7c7fcd95a326 => generated 1314 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:55:03.791884 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi [req-70290795-62c2-467c-8d4d-e35e40af8366 req-c817ede3-971f-46c8-87a1-692946d8b770 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "293dc634-5657-4796-b6cd-7c7fcd95a326", "tag": "c124a2fe-cc76-4947-aec9-27ac94533953"}]} {{(pid=129322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 12:55:03.811894 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [req-70290795-62c2-467c-8d4d-e35e40af8366 req-c817ede3-971f-46c8-87a1-692946d8b770 service nova] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:55:03.812473 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [req-70290795-62c2-467c-8d4d-e35e40af8366 req-c817ede3-971f-46c8-87a1-692946d8b770 service nova] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:55:03.827778 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: INFO nova.api.openstack.compute.server_external_events [req-70290795-62c2-467c-8d4d-e35e40af8366 req-c817ede3-971f-46c8-87a1-692946d8b770 service nova] Creating event network-changed:c124a2fe-cc76-4947-aec9-27ac94533953 for instance 293dc634-5657-4796-b6cd-7c7fcd95a326 on hv-cinder-81966 May 26 12:55:03.834003 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: INFO nova.api.openstack.requestlog [req-70290795-62c2-467c-8d4d-e35e40af8366 req-c817ede3-971f-46c8-87a1-692946d8b770 service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.060112 May 26 12:55:03.835646 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: [pid: 129322|app: 0|req: 640/1259] 10.222.0.75 () {64 vars in 1317 bytes} [Thu May 26 12:55:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 12:55:04.462562 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi [None req-80f2487c-8925-446f-85eb-1516f5404fa1 tempest-VolumesNegativeTest-1619659463 tempest-VolumesNegativeTest-1619659463-project] Calling method '>' {{(pid=129321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:55:04.463263 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.compute.api [None req-80f2487c-8925-446f-85eb-1516f5404fa1 tempest-VolumesNegativeTest-1619659463 tempest-VolumesNegativeTest-1619659463-project] [instance: 293dc634-5657-4796-b6cd-7c7fcd95a326] Fetching instance by UUID {{(pid=129321) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:55:04.470521 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-80f2487c-8925-446f-85eb-1516f5404fa1 tempest-VolumesNegativeTest-1619659463 tempest-VolumesNegativeTest-1619659463-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:55:04.470974 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-80f2487c-8925-446f-85eb-1516f5404fa1 tempest-VolumesNegativeTest-1619659463 tempest-VolumesNegativeTest-1619659463-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:55:04.471786 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-80f2487c-8925-446f-85eb-1516f5404fa1 tempest-VolumesNegativeTest-1619659463 tempest-VolumesNegativeTest-1619659463-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:55:04.472221 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-80f2487c-8925-446f-85eb-1516f5404fa1 tempest-VolumesNegativeTest-1619659463 tempest-VolumesNegativeTest-1619659463-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:55:04.616464 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.policy [None req-80f2487c-8925-446f-85eb-1516f5404fa1 tempest-VolumesNegativeTest-1619659463 tempest-VolumesNegativeTest-1619659463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9ae772c030c4944a5e7aabb745f0ea7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33b0c6f982c3403a89906977ffb05bc3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129321) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:55:04.627546 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: INFO nova.api.openstack.requestlog [None req-80f2487c-8925-446f-85eb-1516f5404fa1 tempest-VolumesNegativeTest-1619659463 tempest-VolumesNegativeTest-1619659463-project] 10.222.0.75 "GET /compute/v2.1/servers/293dc634-5657-4796-b6cd-7c7fcd95a326" status: 200 len: 1314 microversion: 2.1 time: 0.168986 May 26 12:55:04.628156 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: [pid: 129321|app: 0|req: 620/1260] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 26 12:55:04 2022] GET /compute/v2.1/servers/293dc634-5657-4796-b6cd-7c7fcd95a326 => generated 1314 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:55:05.646710 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi [None req-63c57d92-237c-45ae-8340-b19f55a09fa7 tempest-VolumesNegativeTest-1619659463 tempest-VolumesNegativeTest-1619659463-project] Calling method '>' {{(pid=129322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:55:05.647302 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.compute.api [None req-63c57d92-237c-45ae-8340-b19f55a09fa7 tempest-VolumesNegativeTest-1619659463 tempest-VolumesNegativeTest-1619659463-project] [instance: 293dc634-5657-4796-b6cd-7c7fcd95a326] Fetching instance by UUID {{(pid=129322) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:55:05.655703 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-63c57d92-237c-45ae-8340-b19f55a09fa7 tempest-VolumesNegativeTest-1619659463 tempest-VolumesNegativeTest-1619659463-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:55:05.656157 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-63c57d92-237c-45ae-8340-b19f55a09fa7 tempest-VolumesNegativeTest-1619659463 tempest-VolumesNegativeTest-1619659463-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:55:05.656913 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-63c57d92-237c-45ae-8340-b19f55a09fa7 tempest-VolumesNegativeTest-1619659463 tempest-VolumesNegativeTest-1619659463-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:55:05.657341 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-63c57d92-237c-45ae-8340-b19f55a09fa7 tempest-VolumesNegativeTest-1619659463 tempest-VolumesNegativeTest-1619659463-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:55:05.792879 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.policy [None req-63c57d92-237c-45ae-8340-b19f55a09fa7 tempest-VolumesNegativeTest-1619659463 tempest-VolumesNegativeTest-1619659463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9ae772c030c4944a5e7aabb745f0ea7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33b0c6f982c3403a89906977ffb05bc3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129322) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:55:05.800666 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: INFO nova.api.openstack.requestlog [None req-63c57d92-237c-45ae-8340-b19f55a09fa7 tempest-VolumesNegativeTest-1619659463 tempest-VolumesNegativeTest-1619659463-project] 10.222.0.75 "GET /compute/v2.1/servers/293dc634-5657-4796-b6cd-7c7fcd95a326" status: 200 len: 1314 microversion: 2.1 time: 0.159479 May 26 12:55:05.801271 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: [pid: 129322|app: 0|req: 641/1261] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 26 12:55:05 2022] GET /compute/v2.1/servers/293dc634-5657-4796-b6cd-7c7fcd95a326 => generated 1314 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:55:06.818541 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi [None req-5accb39b-7920-4e7b-bc2c-06d168a8aa23 tempest-VolumesNegativeTest-1619659463 tempest-VolumesNegativeTest-1619659463-project] Calling method '>' {{(pid=129321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:55:06.819161 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.compute.api [None req-5accb39b-7920-4e7b-bc2c-06d168a8aa23 tempest-VolumesNegativeTest-1619659463 tempest-VolumesNegativeTest-1619659463-project] [instance: 293dc634-5657-4796-b6cd-7c7fcd95a326] Fetching instance by UUID {{(pid=129321) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:55:06.826235 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-5accb39b-7920-4e7b-bc2c-06d168a8aa23 tempest-VolumesNegativeTest-1619659463 tempest-VolumesNegativeTest-1619659463-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:55:06.826686 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-5accb39b-7920-4e7b-bc2c-06d168a8aa23 tempest-VolumesNegativeTest-1619659463 tempest-VolumesNegativeTest-1619659463-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:55:06.827448 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-5accb39b-7920-4e7b-bc2c-06d168a8aa23 tempest-VolumesNegativeTest-1619659463 tempest-VolumesNegativeTest-1619659463-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:55:06.827914 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-5accb39b-7920-4e7b-bc2c-06d168a8aa23 tempest-VolumesNegativeTest-1619659463 tempest-VolumesNegativeTest-1619659463-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:55:07.049574 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.policy [None req-5accb39b-7920-4e7b-bc2c-06d168a8aa23 tempest-VolumesNegativeTest-1619659463 tempest-VolumesNegativeTest-1619659463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9ae772c030c4944a5e7aabb745f0ea7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33b0c6f982c3403a89906977ffb05bc3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129321) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:55:07.057443 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: INFO nova.api.openstack.requestlog [None req-5accb39b-7920-4e7b-bc2c-06d168a8aa23 tempest-VolumesNegativeTest-1619659463 tempest-VolumesNegativeTest-1619659463-project] 10.222.0.75 "GET /compute/v2.1/servers/293dc634-5657-4796-b6cd-7c7fcd95a326" status: 200 len: 1314 microversion: 2.1 time: 0.243340 May 26 12:55:07.057998 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: [pid: 129321|app: 0|req: 621/1262] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 26 12:55:06 2022] GET /compute/v2.1/servers/293dc634-5657-4796-b6cd-7c7fcd95a326 => generated 1314 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:55:08.074667 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi [None req-550bc854-18ee-456b-ba99-1507c8e5c292 tempest-VolumesNegativeTest-1619659463 tempest-VolumesNegativeTest-1619659463-project] Calling method '>' {{(pid=129322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:55:08.075263 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.compute.api [None req-550bc854-18ee-456b-ba99-1507c8e5c292 tempest-VolumesNegativeTest-1619659463 tempest-VolumesNegativeTest-1619659463-project] [instance: 293dc634-5657-4796-b6cd-7c7fcd95a326] Fetching instance by UUID {{(pid=129322) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:55:08.082277 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-550bc854-18ee-456b-ba99-1507c8e5c292 tempest-VolumesNegativeTest-1619659463 tempest-VolumesNegativeTest-1619659463-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:55:08.082764 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-550bc854-18ee-456b-ba99-1507c8e5c292 tempest-VolumesNegativeTest-1619659463 tempest-VolumesNegativeTest-1619659463-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:55:08.083762 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-550bc854-18ee-456b-ba99-1507c8e5c292 tempest-VolumesNegativeTest-1619659463 tempest-VolumesNegativeTest-1619659463-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:55:08.084191 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-550bc854-18ee-456b-ba99-1507c8e5c292 tempest-VolumesNegativeTest-1619659463 tempest-VolumesNegativeTest-1619659463-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:55:08.236356 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.policy [None req-550bc854-18ee-456b-ba99-1507c8e5c292 tempest-VolumesNegativeTest-1619659463 tempest-VolumesNegativeTest-1619659463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9ae772c030c4944a5e7aabb745f0ea7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33b0c6f982c3403a89906977ffb05bc3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129322) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:55:08.246904 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: INFO nova.api.openstack.requestlog [None req-550bc854-18ee-456b-ba99-1507c8e5c292 tempest-VolumesNegativeTest-1619659463 tempest-VolumesNegativeTest-1619659463-project] 10.222.0.75 "GET /compute/v2.1/servers/293dc634-5657-4796-b6cd-7c7fcd95a326" status: 200 len: 1314 microversion: 2.1 time: 0.176000 May 26 12:55:08.247803 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: [pid: 129322|app: 0|req: 642/1263] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 26 12:55:08 2022] GET /compute/v2.1/servers/293dc634-5657-4796-b6cd-7c7fcd95a326 => generated 1314 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:55:09.264948 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi [None req-a30e8cf5-17bb-495a-811f-59ff2d4e75b6 tempest-VolumesNegativeTest-1619659463 tempest-VolumesNegativeTest-1619659463-project] Calling method '>' {{(pid=129322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:55:09.265558 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.compute.api [None req-a30e8cf5-17bb-495a-811f-59ff2d4e75b6 tempest-VolumesNegativeTest-1619659463 tempest-VolumesNegativeTest-1619659463-project] [instance: 293dc634-5657-4796-b6cd-7c7fcd95a326] Fetching instance by UUID {{(pid=129322) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:55:09.281505 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-a30e8cf5-17bb-495a-811f-59ff2d4e75b6 tempest-VolumesNegativeTest-1619659463 tempest-VolumesNegativeTest-1619659463-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:55:09.282306 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-a30e8cf5-17bb-495a-811f-59ff2d4e75b6 tempest-VolumesNegativeTest-1619659463 tempest-VolumesNegativeTest-1619659463-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:55:09.285020 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-a30e8cf5-17bb-495a-811f-59ff2d4e75b6 tempest-VolumesNegativeTest-1619659463 tempest-VolumesNegativeTest-1619659463-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:55:09.285467 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-a30e8cf5-17bb-495a-811f-59ff2d4e75b6 tempest-VolumesNegativeTest-1619659463 tempest-VolumesNegativeTest-1619659463-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:55:09.393827 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi [req-6d5fa869-bfbc-42d3-a7fb-fb3781d7a0ba req-351f537f-88f7-404e-95e9-2f892574b850 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "293dc634-5657-4796-b6cd-7c7fcd95a326", "name": "network-vif-plugged", "status": "completed", "tag": "c124a2fe-cc76-4947-aec9-27ac94533953"}]} {{(pid=129321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 12:55:09.402004 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [req-6d5fa869-bfbc-42d3-a7fb-fb3781d7a0ba req-351f537f-88f7-404e-95e9-2f892574b850 service nova] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:55:09.402436 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [req-6d5fa869-bfbc-42d3-a7fb-fb3781d7a0ba req-351f537f-88f7-404e-95e9-2f892574b850 service nova] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:55:09.413612 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: INFO nova.api.openstack.compute.server_external_events [req-6d5fa869-bfbc-42d3-a7fb-fb3781d7a0ba req-351f537f-88f7-404e-95e9-2f892574b850 service nova] Creating event network-vif-plugged:c124a2fe-cc76-4947-aec9-27ac94533953 for instance 293dc634-5657-4796-b6cd-7c7fcd95a326 on hv-cinder-81966 May 26 12:55:09.418981 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: INFO nova.api.openstack.requestlog [req-6d5fa869-bfbc-42d3-a7fb-fb3781d7a0ba req-351f537f-88f7-404e-95e9-2f892574b850 service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.161893 May 26 12:55:09.419746 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: [pid: 129321|app: 0|req: 622/1264] 10.222.0.75 () {64 vars in 1317 bytes} [Thu May 26 12:55:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 12:55:09.425905 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.policy [None req-a30e8cf5-17bb-495a-811f-59ff2d4e75b6 tempest-VolumesNegativeTest-1619659463 tempest-VolumesNegativeTest-1619659463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9ae772c030c4944a5e7aabb745f0ea7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33b0c6f982c3403a89906977ffb05bc3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129322) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:55:09.433517 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: INFO nova.api.openstack.requestlog [None req-a30e8cf5-17bb-495a-811f-59ff2d4e75b6 tempest-VolumesNegativeTest-1619659463 tempest-VolumesNegativeTest-1619659463-project] 10.222.0.75 "GET /compute/v2.1/servers/293dc634-5657-4796-b6cd-7c7fcd95a326" status: 200 len: 1314 microversion: 2.1 time: 0.172828 May 26 12:55:09.434075 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: [pid: 129322|app: 0|req: 643/1265] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 26 12:55:09 2022] GET /compute/v2.1/servers/293dc634-5657-4796-b6cd-7c7fcd95a326 => generated 1314 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:55:10.455237 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi [None req-62b0e16a-974e-4dfe-a210-c8d71da9a2fd tempest-VolumesNegativeTest-1619659463 tempest-VolumesNegativeTest-1619659463-project] Calling method '>' {{(pid=129321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:55:10.456797 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.compute.api [None req-62b0e16a-974e-4dfe-a210-c8d71da9a2fd tempest-VolumesNegativeTest-1619659463 tempest-VolumesNegativeTest-1619659463-project] [instance: 293dc634-5657-4796-b6cd-7c7fcd95a326] Fetching instance by UUID {{(pid=129321) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:55:10.467507 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-62b0e16a-974e-4dfe-a210-c8d71da9a2fd tempest-VolumesNegativeTest-1619659463 tempest-VolumesNegativeTest-1619659463-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:55:10.468161 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-62b0e16a-974e-4dfe-a210-c8d71da9a2fd tempest-VolumesNegativeTest-1619659463 tempest-VolumesNegativeTest-1619659463-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:55:10.469298 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-62b0e16a-974e-4dfe-a210-c8d71da9a2fd tempest-VolumesNegativeTest-1619659463 tempest-VolumesNegativeTest-1619659463-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:55:10.469848 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-62b0e16a-974e-4dfe-a210-c8d71da9a2fd tempest-VolumesNegativeTest-1619659463 tempest-VolumesNegativeTest-1619659463-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:55:10.622317 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.policy [None req-62b0e16a-974e-4dfe-a210-c8d71da9a2fd tempest-VolumesNegativeTest-1619659463 tempest-VolumesNegativeTest-1619659463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9ae772c030c4944a5e7aabb745f0ea7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33b0c6f982c3403a89906977ffb05bc3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129321) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:55:10.631843 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: INFO nova.api.openstack.requestlog [None req-62b0e16a-974e-4dfe-a210-c8d71da9a2fd tempest-VolumesNegativeTest-1619659463 tempest-VolumesNegativeTest-1619659463-project] 10.222.0.75 "GET /compute/v2.1/servers/293dc634-5657-4796-b6cd-7c7fcd95a326" status: 200 len: 1314 microversion: 2.1 time: 0.183789 May 26 12:55:10.632445 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: [pid: 129321|app: 0|req: 623/1266] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 26 12:55:10 2022] GET /compute/v2.1/servers/293dc634-5657-4796-b6cd-7c7fcd95a326 => generated 1314 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:55:11.656781 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi [None req-0fe57f34-5ed1-49ec-b5c2-0d77d49d0b83 tempest-VolumesNegativeTest-1619659463 tempest-VolumesNegativeTest-1619659463-project] Calling method '>' {{(pid=129322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:55:11.657659 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.compute.api [None req-0fe57f34-5ed1-49ec-b5c2-0d77d49d0b83 tempest-VolumesNegativeTest-1619659463 tempest-VolumesNegativeTest-1619659463-project] [instance: 293dc634-5657-4796-b6cd-7c7fcd95a326] Fetching instance by UUID {{(pid=129322) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:55:11.661183 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG dbcounter [-] [129322] Writing DB stats nova_cell0:SELECT=2 {{(pid=129322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:55:11.662058 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG dbcounter [-] [129322] Writing DB stats nova_cell0:SELECT=6 {{(pid=129322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:55:11.671280 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-0fe57f34-5ed1-49ec-b5c2-0d77d49d0b83 tempest-VolumesNegativeTest-1619659463 tempest-VolumesNegativeTest-1619659463-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:55:11.671778 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-0fe57f34-5ed1-49ec-b5c2-0d77d49d0b83 tempest-VolumesNegativeTest-1619659463 tempest-VolumesNegativeTest-1619659463-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:55:11.672702 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-0fe57f34-5ed1-49ec-b5c2-0d77d49d0b83 tempest-VolumesNegativeTest-1619659463 tempest-VolumesNegativeTest-1619659463-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:55:11.673255 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-0fe57f34-5ed1-49ec-b5c2-0d77d49d0b83 tempest-VolumesNegativeTest-1619659463 tempest-VolumesNegativeTest-1619659463-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:55:11.810625 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.policy [None req-0fe57f34-5ed1-49ec-b5c2-0d77d49d0b83 tempest-VolumesNegativeTest-1619659463 tempest-VolumesNegativeTest-1619659463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9ae772c030c4944a5e7aabb745f0ea7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33b0c6f982c3403a89906977ffb05bc3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129322) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:55:11.818702 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: INFO nova.api.openstack.requestlog [None req-0fe57f34-5ed1-49ec-b5c2-0d77d49d0b83 tempest-VolumesNegativeTest-1619659463 tempest-VolumesNegativeTest-1619659463-project] 10.222.0.75 "GET /compute/v2.1/servers/293dc634-5657-4796-b6cd-7c7fcd95a326" status: 200 len: 1463 microversion: 2.1 time: 0.168581 May 26 12:55:11.819282 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: [pid: 129322|app: 0|req: 644/1267] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 26 12:55:11 2022] GET /compute/v2.1/servers/293dc634-5657-4796-b6cd-7c7fcd95a326 => generated 1463 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:55:11.858336 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi [None req-82df19c2-120e-41c6-994e-c5cffb54813e tempest-VolumesNegativeTest-1619659463 tempest-VolumesNegativeTest-1619659463-project] Calling method '>' {{(pid=129321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:55:11.858883 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.compute.api [None req-82df19c2-120e-41c6-994e-c5cffb54813e tempest-VolumesNegativeTest-1619659463 tempest-VolumesNegativeTest-1619659463-project] [instance: 293dc634-5657-4796-b6cd-7c7fcd95a326] Fetching instance by UUID {{(pid=129321) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:55:11.860949 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG dbcounter [-] [129321] Writing DB stats nova_cell0:SELECT=2 {{(pid=129321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:55:11.867905 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-82df19c2-120e-41c6-994e-c5cffb54813e tempest-VolumesNegativeTest-1619659463 tempest-VolumesNegativeTest-1619659463-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:55:11.868347 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-82df19c2-120e-41c6-994e-c5cffb54813e tempest-VolumesNegativeTest-1619659463 tempest-VolumesNegativeTest-1619659463-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:55:11.869112 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-82df19c2-120e-41c6-994e-c5cffb54813e tempest-VolumesNegativeTest-1619659463 tempest-VolumesNegativeTest-1619659463-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:55:11.869545 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-82df19c2-120e-41c6-994e-c5cffb54813e tempest-VolumesNegativeTest-1619659463 tempest-VolumesNegativeTest-1619659463-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:55:11.896047 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.compute.api [None req-82df19c2-120e-41c6-994e-c5cffb54813e tempest-VolumesNegativeTest-1619659463 tempest-VolumesNegativeTest-1619659463-project] [instance: 293dc634-5657-4796-b6cd-7c7fcd95a326] Going to try to terminate instance {{(pid=129321) delete /opt/stack/nova/nova/compute/api.py:2664}} May 26 12:55:11.984216 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: INFO nova.api.openstack.requestlog [None req-82df19c2-120e-41c6-994e-c5cffb54813e tempest-VolumesNegativeTest-1619659463 tempest-VolumesNegativeTest-1619659463-project] 10.222.0.75 "DELETE /compute/v2.1/servers/293dc634-5657-4796-b6cd-7c7fcd95a326" status: 204 len: 0 microversion: 2.1 time: 0.129616 May 26 12:55:11.984996 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: [pid: 129321|app: 0|req: 624/1268] 10.222.0.75 () {58 vars in 1238 bytes} [Thu May 26 12:55:11 2022] DELETE /compute/v2.1/servers/293dc634-5657-4796-b6cd-7c7fcd95a326 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 26 12:55:11.993459 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi [None req-8c32f288-deb5-435f-b223-1d55c2d410a9 tempest-VolumesNegativeTest-1619659463 tempest-VolumesNegativeTest-1619659463-project] Calling method '>' {{(pid=129322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:55:11.994070 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.compute.api [None req-8c32f288-deb5-435f-b223-1d55c2d410a9 tempest-VolumesNegativeTest-1619659463 tempest-VolumesNegativeTest-1619659463-project] [instance: 293dc634-5657-4796-b6cd-7c7fcd95a326] Fetching instance by UUID {{(pid=129322) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:55:12.000572 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-8c32f288-deb5-435f-b223-1d55c2d410a9 tempest-VolumesNegativeTest-1619659463 tempest-VolumesNegativeTest-1619659463-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:55:12.002487 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-8c32f288-deb5-435f-b223-1d55c2d410a9 tempest-VolumesNegativeTest-1619659463 tempest-VolumesNegativeTest-1619659463-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:55:12.002487 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-8c32f288-deb5-435f-b223-1d55c2d410a9 tempest-VolumesNegativeTest-1619659463 tempest-VolumesNegativeTest-1619659463-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:55:12.002487 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-8c32f288-deb5-435f-b223-1d55c2d410a9 tempest-VolumesNegativeTest-1619659463 tempest-VolumesNegativeTest-1619659463-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:55:12.158049 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.policy [None req-8c32f288-deb5-435f-b223-1d55c2d410a9 tempest-VolumesNegativeTest-1619659463 tempest-VolumesNegativeTest-1619659463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9ae772c030c4944a5e7aabb745f0ea7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33b0c6f982c3403a89906977ffb05bc3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129322) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:55:12.167080 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: INFO nova.api.openstack.requestlog [None req-8c32f288-deb5-435f-b223-1d55c2d410a9 tempest-VolumesNegativeTest-1619659463 tempest-VolumesNegativeTest-1619659463-project] 10.222.0.75 "GET /compute/v2.1/servers/293dc634-5657-4796-b6cd-7c7fcd95a326" status: 200 len: 1469 microversion: 2.1 time: 0.177550 May 26 12:55:12.167705 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: [pid: 129322|app: 0|req: 645/1269] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 26 12:55:11 2022] GET /compute/v2.1/servers/293dc634-5657-4796-b6cd-7c7fcd95a326 => generated 1469 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:55:13.189936 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi [None req-233434d3-ab5b-4edb-9efb-ed26b687ea37 tempest-VolumesNegativeTest-1619659463 tempest-VolumesNegativeTest-1619659463-project] Calling method '>' {{(pid=129321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:55:13.190790 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.compute.api [None req-233434d3-ab5b-4edb-9efb-ed26b687ea37 tempest-VolumesNegativeTest-1619659463 tempest-VolumesNegativeTest-1619659463-project] [instance: 293dc634-5657-4796-b6cd-7c7fcd95a326] Fetching instance by UUID {{(pid=129321) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:55:13.201316 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-233434d3-ab5b-4edb-9efb-ed26b687ea37 tempest-VolumesNegativeTest-1619659463 tempest-VolumesNegativeTest-1619659463-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:55:13.201923 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-233434d3-ab5b-4edb-9efb-ed26b687ea37 tempest-VolumesNegativeTest-1619659463 tempest-VolumesNegativeTest-1619659463-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:55:13.203017 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-233434d3-ab5b-4edb-9efb-ed26b687ea37 tempest-VolumesNegativeTest-1619659463 tempest-VolumesNegativeTest-1619659463-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:55:13.203666 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-233434d3-ab5b-4edb-9efb-ed26b687ea37 tempest-VolumesNegativeTest-1619659463 tempest-VolumesNegativeTest-1619659463-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:55:13.343984 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.policy [None req-233434d3-ab5b-4edb-9efb-ed26b687ea37 tempest-VolumesNegativeTest-1619659463 tempest-VolumesNegativeTest-1619659463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9ae772c030c4944a5e7aabb745f0ea7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33b0c6f982c3403a89906977ffb05bc3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129321) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:55:13.352432 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: INFO nova.api.openstack.requestlog [None req-233434d3-ab5b-4edb-9efb-ed26b687ea37 tempest-VolumesNegativeTest-1619659463 tempest-VolumesNegativeTest-1619659463-project] 10.222.0.75 "GET /compute/v2.1/servers/293dc634-5657-4796-b6cd-7c7fcd95a326" status: 200 len: 1469 microversion: 2.1 time: 0.169589 May 26 12:55:13.353011 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: [pid: 129321|app: 0|req: 625/1270] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 26 12:55:13 2022] GET /compute/v2.1/servers/293dc634-5657-4796-b6cd-7c7fcd95a326 => generated 1469 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:55:14.194270 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi [req-6259dd02-3636-453b-9a07-8bf8a5c80bac req-3ac562ad-e1dd-4693-ae9f-aea298e3b794 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "293dc634-5657-4796-b6cd-7c7fcd95a326", "name": "network-vif-deleted", "tag": "c124a2fe-cc76-4947-aec9-27ac94533953"}]} {{(pid=129321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 12:55:14.203885 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [req-6259dd02-3636-453b-9a07-8bf8a5c80bac req-3ac562ad-e1dd-4693-ae9f-aea298e3b794 service nova] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:55:14.204141 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [req-6259dd02-3636-453b-9a07-8bf8a5c80bac req-3ac562ad-e1dd-4693-ae9f-aea298e3b794 service nova] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:55:14.218904 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: INFO nova.api.openstack.compute.server_external_events [req-6259dd02-3636-453b-9a07-8bf8a5c80bac req-3ac562ad-e1dd-4693-ae9f-aea298e3b794 service nova] Creating event network-vif-deleted:c124a2fe-cc76-4947-aec9-27ac94533953 for instance 293dc634-5657-4796-b6cd-7c7fcd95a326 on hv-cinder-81966 May 26 12:55:14.225450 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: INFO nova.api.openstack.requestlog [req-6259dd02-3636-453b-9a07-8bf8a5c80bac req-3ac562ad-e1dd-4693-ae9f-aea298e3b794 service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035342 May 26 12:55:14.230337 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: [pid: 129321|app: 0|req: 626/1271] 10.222.0.75 () {64 vars in 1317 bytes} [Thu May 26 12:55:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 12:55:14.328854 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi [None req-e4b77da3-6f87-4f47-98d8-9bf8a6a7a0f7 tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] Calling method '>' {{(pid=129322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:55:14.330441 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.compute.api [None req-e4b77da3-6f87-4f47-98d8-9bf8a6a7a0f7 tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] [instance: e9e3e084-4a1a-4d21-b2e9-b51f79287094] Fetching instance by UUID {{(pid=129322) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:55:14.338411 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-e4b77da3-6f87-4f47-98d8-9bf8a6a7a0f7 tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:55:14.338772 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-e4b77da3-6f87-4f47-98d8-9bf8a6a7a0f7 tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:55:14.339916 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-e4b77da3-6f87-4f47-98d8-9bf8a6a7a0f7 tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:55:14.340735 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-e4b77da3-6f87-4f47-98d8-9bf8a6a7a0f7 tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:55:14.370640 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi [None req-6af961ed-575a-43f5-8b45-06319efabcfa tempest-VolumesNegativeTest-1619659463 tempest-VolumesNegativeTest-1619659463-project] Calling method '>' {{(pid=129321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:55:14.371347 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.compute.api [None req-6af961ed-575a-43f5-8b45-06319efabcfa tempest-VolumesNegativeTest-1619659463 tempest-VolumesNegativeTest-1619659463-project] [instance: 293dc634-5657-4796-b6cd-7c7fcd95a326] Fetching instance by UUID {{(pid=129321) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:55:14.377810 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: INFO nova.api.openstack.requestlog [None req-e4b77da3-6f87-4f47-98d8-9bf8a6a7a0f7 tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] 10.222.0.75 "GET /compute/v2.1/servers/e9e3e084-4a1a-4d21-b2e9-b51f79287094/ips" status: 200 len: 150 microversion: 2.1 time: 0.205336 May 26 12:55:14.377986 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-6af961ed-575a-43f5-8b45-06319efabcfa tempest-VolumesNegativeTest-1619659463 tempest-VolumesNegativeTest-1619659463-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:55:14.378390 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-6af961ed-575a-43f5-8b45-06319efabcfa tempest-VolumesNegativeTest-1619659463 tempest-VolumesNegativeTest-1619659463-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:55:14.378964 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: [pid: 129322|app: 0|req: 646/1272] 10.222.0.75 () {58 vars in 1247 bytes} [Thu May 26 12:55:14 2022] GET /compute/v2.1/servers/e9e3e084-4a1a-4d21-b2e9-b51f79287094/ips => generated 150 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 12:55:14.379148 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-6af961ed-575a-43f5-8b45-06319efabcfa tempest-VolumesNegativeTest-1619659463 tempest-VolumesNegativeTest-1619659463-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:55:14.379871 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-6af961ed-575a-43f5-8b45-06319efabcfa tempest-VolumesNegativeTest-1619659463 tempest-VolumesNegativeTest-1619659463-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:55:14.416857 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-6af961ed-575a-43f5-8b45-06319efabcfa tempest-VolumesNegativeTest-1619659463 tempest-VolumesNegativeTest-1619659463-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:55:14.417311 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-6af961ed-575a-43f5-8b45-06319efabcfa tempest-VolumesNegativeTest-1619659463 tempest-VolumesNegativeTest-1619659463-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:55:14.417763 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.objects.instance [None req-6af961ed-575a-43f5-8b45-06319efabcfa tempest-VolumesNegativeTest-1619659463 tempest-VolumesNegativeTest-1619659463-project] Lazy-loading 'fault' on Instance uuid 293dc634-5657-4796-b6cd-7c7fcd95a326 {{(pid=129321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 26 12:55:14.462560 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.policy [None req-6af961ed-575a-43f5-8b45-06319efabcfa tempest-VolumesNegativeTest-1619659463 tempest-VolumesNegativeTest-1619659463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9ae772c030c4944a5e7aabb745f0ea7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33b0c6f982c3403a89906977ffb05bc3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129321) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:55:14.470584 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: INFO nova.api.openstack.requestlog [None req-6af961ed-575a-43f5-8b45-06319efabcfa tempest-VolumesNegativeTest-1619659463 tempest-VolumesNegativeTest-1619659463-project] 10.222.0.75 "GET /compute/v2.1/servers/293dc634-5657-4796-b6cd-7c7fcd95a326" status: 200 len: 1304 microversion: 2.1 time: 0.104285 May 26 12:55:14.480429 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: [pid: 129321|app: 0|req: 627/1273] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 26 12:55:14 2022] GET /compute/v2.1/servers/293dc634-5657-4796-b6cd-7c7fcd95a326 => generated 1304 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:55:15.490652 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi [None req-5ba95b41-6bd8-4fdf-bda5-b4ab55c48777 tempest-VolumesNegativeTest-1619659463 tempest-VolumesNegativeTest-1619659463-project] Calling method '>' {{(pid=129322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:55:15.491424 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.compute.api [None req-5ba95b41-6bd8-4fdf-bda5-b4ab55c48777 tempest-VolumesNegativeTest-1619659463 tempest-VolumesNegativeTest-1619659463-project] [instance: 293dc634-5657-4796-b6cd-7c7fcd95a326] Fetching instance by UUID {{(pid=129322) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:55:15.498460 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-5ba95b41-6bd8-4fdf-bda5-b4ab55c48777 tempest-VolumesNegativeTest-1619659463 tempest-VolumesNegativeTest-1619659463-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:55:15.498914 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-5ba95b41-6bd8-4fdf-bda5-b4ab55c48777 tempest-VolumesNegativeTest-1619659463 tempest-VolumesNegativeTest-1619659463-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:55:15.499711 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-5ba95b41-6bd8-4fdf-bda5-b4ab55c48777 tempest-VolumesNegativeTest-1619659463 tempest-VolumesNegativeTest-1619659463-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:55:15.500144 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-5ba95b41-6bd8-4fdf-bda5-b4ab55c48777 tempest-VolumesNegativeTest-1619659463 tempest-VolumesNegativeTest-1619659463-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:55:15.516062 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: INFO nova.api.openstack.wsgi [None req-5ba95b41-6bd8-4fdf-bda5-b4ab55c48777 tempest-VolumesNegativeTest-1619659463 tempest-VolumesNegativeTest-1619659463-project] HTTP exception thrown: Instance 293dc634-5657-4796-b6cd-7c7fcd95a326 could not be found. May 26 12:55:15.517697 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi [None req-5ba95b41-6bd8-4fdf-bda5-b4ab55c48777 tempest-VolumesNegativeTest-1619659463 tempest-VolumesNegativeTest-1619659463-project] Request method failure captured: May 26 12:55:15.517697 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: request: GET /compute/v2.1/servers/293dc634-5657-4796-b6cd-7c7fcd95a326 HTTP/1.1 May 26 12:55:15.517697 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: Accept: application/json May 26 12:55:15.517697 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: Accept-Encoding: identity May 26 12:55:15.517697 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: Connection: close May 26 12:55:15.517697 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: Content-Length: 0 May 26 12:55:15.517697 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: Content-Type: application/json May 26 12:55:15.517697 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: Host: 10.222.0.75 May 26 12:55:15.517697 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: Openstack-System-Scope: None May 26 12:55:15.517697 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: User-Agent: python-urllib3/1.26.9 May 26 12:55:15.517697 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: X-Auth-Token: gAAAAABij3iiXErjEXk4rCGtOAKbvAEQLTonqXdozjMvIMHzK9xfhki0SF65lUcxLmAS2fiQofBGiwQHi5kdjCIHsdx1lilWlIWnWqeJcoP8TSz1MO-Tth2s7MTT0Nq5tVMoLxNcYqMBB-FZ-Tp6EUfwaY0aWL2sF0uyPIxDl0PzZrOkiomR7rE May 26 12:55:15.517697 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: X-Domain-Id: None May 26 12:55:15.517697 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: X-Domain-Name: None May 26 12:55:15.517697 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: X-Identity-Status: Confirmed May 26 12:55:15.517697 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: X-Is-Admin-Project: True May 26 12:55:15.517697 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: X-Project-Domain-Id: default May 26 12:55:15.517697 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: X-Project-Domain-Name: Default May 26 12:55:15.517697 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: X-Project-Id: 33b0c6f982c3403a89906977ffb05bc3 May 26 12:55:15.517697 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: X-Project-Name: tempest-VolumesNegativeTest-1619659463 May 26 12:55:15.517697 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: X-Role: member,reader May 26 12:55:15.517697 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: X-Roles: member,reader May 26 12:55:15.519697 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/33b0c6f982c3403a89906977ffb05bc3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.75:8080", "publicURL": "http://10.222.0.75:8080/v1/AUTH_33b0c6f982c3403a89906977ffb05bc3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2/33b0c6f982c3403a89906977ffb05bc3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/33b0c6f982c3403a89906977ffb05bc3"}]}] May 26 12:55:15.519697 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: X-Tenant: tempest-VolumesNegativeTest-1619659463 May 26 12:55:15.519697 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: X-Tenant-Id: 33b0c6f982c3403a89906977ffb05bc3 May 26 12:55:15.519697 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: X-Tenant-Name: tempest-VolumesNegativeTest-1619659463 May 26 12:55:15.519697 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: X-User: tempest-VolumesNegativeTest-1619659463-project May 26 12:55:15.519697 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: X-User-Domain-Id: default May 26 12:55:15.519697 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: X-User-Domain-Name: Default May 26 12:55:15.519697 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: X-User-Id: e9ae772c030c4944a5e7aabb745f0ea7 May 26 12:55:15.519697 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: X-User-Name: tempest-VolumesNegativeTest-1619659463-project May 26 12:55:15.519697 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: method: > May 26 12:55:15.519697 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: exception: Instance 293dc634-5657-4796-b6cd-7c7fcd95a326 could not be found. May 26 12:55:15.519697 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: action_args: {'id': '293dc634-5657-4796-b6cd-7c7fcd95a326'} May 26 12:55:15.520642 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: {{(pid=129322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 12:55:15.520642 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 12:55:15.520642 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 26 12:55:15.520642 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 26 12:55:15.520642 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 26 12:55:15.520642 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 26 12:55:15.520642 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 26 12:55:15.520642 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 26 12:55:15.520642 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 26 12:55:15.520642 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 26 12:55:15.520642 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 293dc634-5657-4796-b6cd-7c7fcd95a326 could not be found. May 26 12:55:15.520642 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi May 26 12:55:15.520642 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 12:55:15.520642 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi May 26 12:55:15.520642 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 12:55:15.520642 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 12:55:15.520642 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 12:55:15.520642 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 12:55:15.520642 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 12:55:15.520642 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 12:55:15.522373 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 12:55:15.522373 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 26 12:55:15.522373 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 26 12:55:15.522373 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 26 12:55:15.522373 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 26 12:55:15.522373 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 26 12:55:15.522373 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 12:55:15.522373 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 293dc634-5657-4796-b6cd-7c7fcd95a326 could not be found. May 26 12:55:15.522373 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi May 26 12:55:15.522373 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 12:55:15.522373 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi May 26 12:55:15.522373 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 12:55:15.522373 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 12:55:15.522373 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 12:55:15.522373 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 12:55:15.522373 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 12:55:15.522373 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 293dc634-5657-4796-b6cd-7c7fcd95a326 could not be found. May 26 12:55:15.522373 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi May 26 12:55:15.523955 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi [None req-5ba95b41-6bd8-4fdf-bda5-b4ab55c48777 tempest-VolumesNegativeTest-1619659463 tempest-VolumesNegativeTest-1619659463-project] Returning 404 to user: Instance 293dc634-5657-4796-b6cd-7c7fcd95a326 could not be found. {{(pid=129322) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 12:55:15.523955 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: INFO nova.api.openstack.requestlog [None req-5ba95b41-6bd8-4fdf-bda5-b4ab55c48777 tempest-VolumesNegativeTest-1619659463 tempest-VolumesNegativeTest-1619659463-project] 10.222.0.75 "GET /compute/v2.1/servers/293dc634-5657-4796-b6cd-7c7fcd95a326" status: 404 len: 111 microversion: 2.1 time: 0.034455 May 26 12:55:15.523955 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: [pid: 129322|app: 0|req: 647/1274] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 26 12:55:15 2022] GET /compute/v2.1/servers/293dc634-5657-4796-b6cd-7c7fcd95a326 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 26 12:55:15.735576 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi [None req-906ff2d5-bcaf-43e1-954f-98d3bfcedd22 tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "73a74479-cc46-4b13-aea8-b27404c24237"}} {{(pid=129321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 12:55:15.736662 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.compute.api [None req-906ff2d5-bcaf-43e1-954f-98d3bfcedd22 tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] [instance: e9e3e084-4a1a-4d21-b2e9-b51f79287094] Fetching instance by UUID {{(pid=129321) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:55:15.743279 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-906ff2d5-bcaf-43e1-954f-98d3bfcedd22 tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:55:15.743734 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-906ff2d5-bcaf-43e1-954f-98d3bfcedd22 tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:55:15.744490 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-906ff2d5-bcaf-43e1-954f-98d3bfcedd22 tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:55:15.744910 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-906ff2d5-bcaf-43e1-954f-98d3bfcedd22 tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:55:16.018715 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: INFO nova.api.openstack.requestlog [None req-906ff2d5-bcaf-43e1-954f-98d3bfcedd22 tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] 10.222.0.75 "POST /compute/v2.1/servers/e9e3e084-4a1a-4d21-b2e9-b51f79287094/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.286498 May 26 12:55:16.019705 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: [pid: 129321|app: 0|req: 628/1275] 10.222.0.75 () {60 vars in 1322 bytes} [Thu May 26 12:55:15 2022] POST /compute/v2.1/servers/e9e3e084-4a1a-4d21-b2e9-b51f79287094/os-volume_attachments => generated 194 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 12:55:23.576158 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi [None req-ad997e85-7331-4bc0-8f7a-ae59c280cd8e tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "73a74479-cc46-4b13-aea8-b27404c24237"}} {{(pid=129322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 12:55:23.577270 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.compute.api [None req-ad997e85-7331-4bc0-8f7a-ae59c280cd8e tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] [instance: e9e3e084-4a1a-4d21-b2e9-b51f79287094] Fetching instance by UUID {{(pid=129322) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:55:23.584262 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-ad997e85-7331-4bc0-8f7a-ae59c280cd8e tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:55:23.584709 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-ad997e85-7331-4bc0-8f7a-ae59c280cd8e tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:55:23.585455 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-ad997e85-7331-4bc0-8f7a-ae59c280cd8e tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:55:23.585883 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-ad997e85-7331-4bc0-8f7a-ae59c280cd8e tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:55:23.664803 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: INFO nova.api.openstack.wsgi [None req-ad997e85-7331-4bc0-8f7a-ae59c280cd8e tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] HTTP exception thrown: Invalid volume: volume 73a74479-cc46-4b13-aea8-b27404c24237 is already attached to instances: e9e3e084-4a1a-4d21-b2e9-b51f79287094 May 26 12:55:23.666430 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi [None req-ad997e85-7331-4bc0-8f7a-ae59c280cd8e tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] Request method failure captured: May 26 12:55:23.666430 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: request: POST /compute/v2.1/servers/e9e3e084-4a1a-4d21-b2e9-b51f79287094/os-volume_attachments HTTP/1.1 May 26 12:55:23.666430 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: Accept: application/json May 26 12:55:23.666430 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: Accept-Encoding: identity May 26 12:55:23.666430 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: Connection: close May 26 12:55:23.666430 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: Content-Length: 74 May 26 12:55:23.666430 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: Content-Type: application/json May 26 12:55:23.666430 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: Host: 10.222.0.75 May 26 12:55:23.666430 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: Openstack-System-Scope: None May 26 12:55:23.666430 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: User-Agent: python-urllib3/1.26.9 May 26 12:55:23.666430 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: X-Auth-Token: gAAAAABij3dy_ejiT_65wXWPYwZfIN-6WeUbfvEBcCDgX9L01CFqFU-nwaxJgQr_xdeJZky3mnpsSEy0WtYtz-shYs9kb1EXqBcjtE4c5z7FWjh8oWZK7TxUIPSLNV7p0eRBTjtvtICj3UXIwBcd_3erDIcqb3pLxZywjxdf6YmqLjQWXxRzhB0 May 26 12:55:23.666430 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: X-Domain-Id: None May 26 12:55:23.666430 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: X-Domain-Name: None May 26 12:55:23.666430 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: X-Identity-Status: Confirmed May 26 12:55:23.666430 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: X-Is-Admin-Project: True May 26 12:55:23.666430 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: X-Project-Domain-Id: default May 26 12:55:23.666430 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: X-Project-Domain-Name: Default May 26 12:55:23.666430 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: X-Project-Id: 93d5b6bba38643bfb76f083e230b3d22 May 26 12:55:23.666430 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: X-Project-Name: tempest-AttachVolumeNegativeTest-1109191477 May 26 12:55:23.666430 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: X-Role: member,reader May 26 12:55:23.666430 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: X-Roles: member,reader May 26 12:55:23.668151 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/93d5b6bba38643bfb76f083e230b3d22"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.75:8080", "publicURL": "http://10.222.0.75:8080/v1/AUTH_93d5b6bba38643bfb76f083e230b3d22"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2/93d5b6bba38643bfb76f083e230b3d22"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/93d5b6bba38643bfb76f083e230b3d22"}]}] May 26 12:55:23.668151 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: X-Tenant: tempest-AttachVolumeNegativeTest-1109191477 May 26 12:55:23.668151 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: X-Tenant-Id: 93d5b6bba38643bfb76f083e230b3d22 May 26 12:55:23.668151 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1109191477 May 26 12:55:23.668151 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: X-User: tempest-AttachVolumeNegativeTest-1109191477-project May 26 12:55:23.668151 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: X-User-Domain-Id: default May 26 12:55:23.668151 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: X-User-Domain-Name: Default May 26 12:55:23.668151 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: X-User-Id: eddc5d9ac2a74507bca19e06f0051ae1 May 26 12:55:23.668151 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: X-User-Name: tempest-AttachVolumeNegativeTest-1109191477-project May 26 12:55:23.668151 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: May 26 12:55:23.668151 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: {"volumeAttachment": {"volumeId": "73a74479-cc46-4b13-aea8-b27404c24237"}} May 26 12:55:23.668151 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: method: > May 26 12:55:23.668978 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: exception: Invalid volume: volume 73a74479-cc46-4b13-aea8-b27404c24237 is already attached to instances: e9e3e084-4a1a-4d21-b2e9-b51f79287094 May 26 12:55:23.668978 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: action_args: {'server_id': 'e9e3e084-4a1a-4d21-b2e9-b51f79287094', 'body': {'volumeAttachment': {'volumeId': '73a74479-cc46-4b13-aea8-b27404c24237'}}} May 26 12:55:23.668978 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: {{(pid=129322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 12:55:23.668978 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 12:55:23.668978 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create May 26 12:55:23.668978 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( May 26 12:55:23.668978 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner May 26 12:55:23.668978 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 26 12:55:23.668978 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner May 26 12:55:23.668978 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) May 26 12:55:23.668978 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume May 26 12:55:23.668978 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) May 26 12:55:23.668978 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached May 26 12:55:23.668978 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) May 26 12:55:23.668978 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 73a74479-cc46-4b13-aea8-b27404c24237 is already attached to instances: e9e3e084-4a1a-4d21-b2e9-b51f79287094 May 26 12:55:23.668978 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi May 26 12:55:23.668978 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 12:55:23.668978 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi May 26 12:55:23.668978 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 12:55:23.670304 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 12:55:23.670304 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 12:55:23.670304 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 12:55:23.670304 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 12:55:23.670304 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 12:55:23.670304 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 12:55:23.670304 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 26 12:55:23.670304 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 26 12:55:23.670304 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 26 12:55:23.670304 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 26 12:55:23.670304 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 26 12:55:23.670304 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 26 12:55:23.670304 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create May 26 12:55:23.670304 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) May 26 12:55:23.670304 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 73a74479-cc46-4b13-aea8-b27404c24237 is already attached to instances: e9e3e084-4a1a-4d21-b2e9-b51f79287094 May 26 12:55:23.670304 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi May 26 12:55:23.670304 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 12:55:23.670304 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi May 26 12:55:23.670304 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 12:55:23.670304 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 12:55:23.671663 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 12:55:23.671663 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 12:55:23.671663 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 12:55:23.671663 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 73a74479-cc46-4b13-aea8-b27404c24237 is already attached to instances: e9e3e084-4a1a-4d21-b2e9-b51f79287094 May 26 12:55:23.671663 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi May 26 12:55:23.671663 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi [None req-ad997e85-7331-4bc0-8f7a-ae59c280cd8e tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] Returning 400 to user: Invalid volume: volume 73a74479-cc46-4b13-aea8-b27404c24237 is already attached to instances: e9e3e084-4a1a-4d21-b2e9-b51f79287094 {{(pid=129322) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 12:55:23.671663 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: INFO nova.api.openstack.requestlog [None req-ad997e85-7331-4bc0-8f7a-ae59c280cd8e tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] 10.222.0.75 "POST /compute/v2.1/servers/e9e3e084-4a1a-4d21-b2e9-b51f79287094/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.095955 May 26 12:55:23.671663 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: [pid: 129322|app: 0|req: 648/1276] 10.222.0.75 () {60 vars in 1322 bytes} [Thu May 26 12:55:23 2022] POST /compute/v2.1/servers/e9e3e084-4a1a-4d21-b2e9-b51f79287094/os-volume_attachments => generated 174 bytes in 97 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 26 12:55:23.739124 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi [None req-578b662b-d8c2-415d-8a5b-c2e839f9abe8 tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] Calling method '>' {{(pid=129321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:55:23.739704 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.compute.api [None req-578b662b-d8c2-415d-8a5b-c2e839f9abe8 tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] [instance: e9e3e084-4a1a-4d21-b2e9-b51f79287094] Fetching instance by UUID {{(pid=129321) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:55:23.751888 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-578b662b-d8c2-415d-8a5b-c2e839f9abe8 tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:55:23.753053 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-578b662b-d8c2-415d-8a5b-c2e839f9abe8 tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:55:23.754297 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-578b662b-d8c2-415d-8a5b-c2e839f9abe8 tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:55:23.754932 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-578b662b-d8c2-415d-8a5b-c2e839f9abe8 tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:55:23.844571 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.objects.instance [None req-578b662b-d8c2-415d-8a5b-c2e839f9abe8 tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] Lazy-loading 'services' on Instance uuid e9e3e084-4a1a-4d21-b2e9-b51f79287094 {{(pid=129321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 26 12:55:23.921490 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: INFO nova.api.openstack.requestlog [None req-578b662b-d8c2-415d-8a5b-c2e839f9abe8 tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] 10.222.0.75 "DELETE /compute/v2.1/servers/e9e3e084-4a1a-4d21-b2e9-b51f79287094/os-volume_attachments/73a74479-cc46-4b13-aea8-b27404c24237" status: 202 len: 0 microversion: 2.1 time: 0.189479 May 26 12:55:23.922085 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: [pid: 129321|app: 0|req: 629/1277] 10.222.0.75 () {58 vars in 1415 bytes} [Thu May 26 12:55:23 2022] DELETE /compute/v2.1/servers/e9e3e084-4a1a-4d21-b2e9-b51f79287094/os-volume_attachments/73a74479-cc46-4b13-aea8-b27404c24237 => generated 0 bytes in 192 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 26 12:55:23.930719 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi [None req-b336a884-b89a-425b-93d5-593e29407c91 tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] Calling method '>' {{(pid=129322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:55:23.932158 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.compute.api [None req-b336a884-b89a-425b-93d5-593e29407c91 tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] [instance: e9e3e084-4a1a-4d21-b2e9-b51f79287094] Fetching instance by UUID {{(pid=129322) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:55:23.938692 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-b336a884-b89a-425b-93d5-593e29407c91 tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:55:23.939275 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-b336a884-b89a-425b-93d5-593e29407c91 tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:55:23.940096 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-b336a884-b89a-425b-93d5-593e29407c91 tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:55:23.940538 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-b336a884-b89a-425b-93d5-593e29407c91 tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:55:23.972351 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: INFO nova.api.openstack.requestlog [None req-b336a884-b89a-425b-93d5-593e29407c91 tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] 10.222.0.75 "GET /compute/v2.1/servers/e9e3e084-4a1a-4d21-b2e9-b51f79287094/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045718 May 26 12:55:23.972923 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: [pid: 129322|app: 0|req: 649/1278] 10.222.0.75 () {58 vars in 1301 bytes} [Thu May 26 12:55:23 2022] GET /compute/v2.1/servers/e9e3e084-4a1a-4d21-b2e9-b51f79287094/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 12:55:24.986230 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi [None req-e6ca4518-4588-4f64-9f8d-a3f5008e61aa tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] Calling method '>' {{(pid=129321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:55:24.987273 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.compute.api [None req-e6ca4518-4588-4f64-9f8d-a3f5008e61aa tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] [instance: e9e3e084-4a1a-4d21-b2e9-b51f79287094] Fetching instance by UUID {{(pid=129321) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:55:24.993911 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-e6ca4518-4588-4f64-9f8d-a3f5008e61aa tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:55:24.994357 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-e6ca4518-4588-4f64-9f8d-a3f5008e61aa tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:55:24.995407 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-e6ca4518-4588-4f64-9f8d-a3f5008e61aa tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:55:24.995882 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-e6ca4518-4588-4f64-9f8d-a3f5008e61aa tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:55:25.027182 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: INFO nova.api.openstack.requestlog [None req-e6ca4518-4588-4f64-9f8d-a3f5008e61aa tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] 10.222.0.75 "GET /compute/v2.1/servers/e9e3e084-4a1a-4d21-b2e9-b51f79287094/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045879 May 26 12:55:25.027744 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: [pid: 129321|app: 0|req: 630/1279] 10.222.0.75 () {58 vars in 1301 bytes} [Thu May 26 12:55:24 2022] GET /compute/v2.1/servers/e9e3e084-4a1a-4d21-b2e9-b51f79287094/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 26 12:55:25.093195 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi [None req-4cb074db-e6da-4aa1-a269-fad890c386b5 tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] Calling method '>' {{(pid=129322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:55:25.093774 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.compute.api [None req-4cb074db-e6da-4aa1-a269-fad890c386b5 tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] [instance: e9e3e084-4a1a-4d21-b2e9-b51f79287094] Fetching instance by UUID {{(pid=129322) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:55:25.100740 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-4cb074db-e6da-4aa1-a269-fad890c386b5 tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:55:25.101190 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-4cb074db-e6da-4aa1-a269-fad890c386b5 tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:55:25.101979 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-4cb074db-e6da-4aa1-a269-fad890c386b5 tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:55:25.102409 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-4cb074db-e6da-4aa1-a269-fad890c386b5 tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:55:25.132895 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.compute.api [None req-4cb074db-e6da-4aa1-a269-fad890c386b5 tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] [instance: e9e3e084-4a1a-4d21-b2e9-b51f79287094] Going to try to terminate instance {{(pid=129322) delete /opt/stack/nova/nova/compute/api.py:2664}} May 26 12:55:25.237213 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: INFO nova.api.openstack.requestlog [None req-4cb074db-e6da-4aa1-a269-fad890c386b5 tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] 10.222.0.75 "DELETE /compute/v2.1/servers/e9e3e084-4a1a-4d21-b2e9-b51f79287094" status: 204 len: 0 microversion: 2.1 time: 0.147575 May 26 12:55:25.237788 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: [pid: 129322|app: 0|req: 650/1280] 10.222.0.75 () {58 vars in 1238 bytes} [Thu May 26 12:55:25 2022] DELETE /compute/v2.1/servers/e9e3e084-4a1a-4d21-b2e9-b51f79287094 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 26 12:55:25.246390 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi [None req-90871b04-9856-45df-b0e4-42afd30a515a tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] Calling method '>' {{(pid=129321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:55:25.247004 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.compute.api [None req-90871b04-9856-45df-b0e4-42afd30a515a tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] [instance: e9e3e084-4a1a-4d21-b2e9-b51f79287094] Fetching instance by UUID {{(pid=129321) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:55:25.253204 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-90871b04-9856-45df-b0e4-42afd30a515a tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:55:25.253651 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-90871b04-9856-45df-b0e4-42afd30a515a tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:55:25.254414 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-90871b04-9856-45df-b0e4-42afd30a515a tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:55:25.254843 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-90871b04-9856-45df-b0e4-42afd30a515a tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:55:25.393948 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.policy [None req-90871b04-9856-45df-b0e4-42afd30a515a tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eddc5d9ac2a74507bca19e06f0051ae1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93d5b6bba38643bfb76f083e230b3d22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129321) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:55:25.404449 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: INFO nova.api.openstack.requestlog [None req-90871b04-9856-45df-b0e4-42afd30a515a tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] 10.222.0.75 "GET /compute/v2.1/servers/e9e3e084-4a1a-4d21-b2e9-b51f79287094" status: 200 len: 1683 microversion: 2.1 time: 0.162247 May 26 12:55:25.405025 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: [pid: 129321|app: 0|req: 631/1281] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 26 12:55:25 2022] GET /compute/v2.1/servers/e9e3e084-4a1a-4d21-b2e9-b51f79287094 => generated 1683 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:55:26.425112 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi [None req-7b01c9b6-5134-469b-a68d-cdae8a1b0a11 tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] Calling method '>' {{(pid=129322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:55:26.426315 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.compute.api [None req-7b01c9b6-5134-469b-a68d-cdae8a1b0a11 tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] [instance: e9e3e084-4a1a-4d21-b2e9-b51f79287094] Fetching instance by UUID {{(pid=129322) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:55:26.436391 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-7b01c9b6-5134-469b-a68d-cdae8a1b0a11 tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:55:26.437108 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-7b01c9b6-5134-469b-a68d-cdae8a1b0a11 tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:55:26.438556 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-7b01c9b6-5134-469b-a68d-cdae8a1b0a11 tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:55:26.439324 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-7b01c9b6-5134-469b-a68d-cdae8a1b0a11 tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:55:26.577969 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.policy [None req-7b01c9b6-5134-469b-a68d-cdae8a1b0a11 tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eddc5d9ac2a74507bca19e06f0051ae1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93d5b6bba38643bfb76f083e230b3d22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129322) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:55:26.585982 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: INFO nova.api.openstack.requestlog [None req-7b01c9b6-5134-469b-a68d-cdae8a1b0a11 tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] 10.222.0.75 "GET /compute/v2.1/servers/e9e3e084-4a1a-4d21-b2e9-b51f79287094" status: 200 len: 1683 microversion: 2.1 time: 0.167068 May 26 12:55:26.586563 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: [pid: 129322|app: 0|req: 651/1282] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 26 12:55:26 2022] GET /compute/v2.1/servers/e9e3e084-4a1a-4d21-b2e9-b51f79287094 => generated 1683 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:55:27.607912 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi [None req-22453ca2-4410-4cac-8064-bf888fa37b6d tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] Calling method '>' {{(pid=129321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:55:27.608546 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.compute.api [None req-22453ca2-4410-4cac-8064-bf888fa37b6d tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] [instance: e9e3e084-4a1a-4d21-b2e9-b51f79287094] Fetching instance by UUID {{(pid=129321) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:55:27.615627 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-22453ca2-4410-4cac-8064-bf888fa37b6d tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:55:27.616087 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-22453ca2-4410-4cac-8064-bf888fa37b6d tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:55:27.616851 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-22453ca2-4410-4cac-8064-bf888fa37b6d tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:55:27.617283 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-22453ca2-4410-4cac-8064-bf888fa37b6d tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:55:27.692796 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.policy [None req-22453ca2-4410-4cac-8064-bf888fa37b6d tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eddc5d9ac2a74507bca19e06f0051ae1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93d5b6bba38643bfb76f083e230b3d22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129321) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:55:27.697109 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG dbcounter [-] [129321] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=129321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:55:27.703130 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: INFO nova.api.openstack.requestlog [None req-22453ca2-4410-4cac-8064-bf888fa37b6d tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] 10.222.0.75 "GET /compute/v2.1/servers/e9e3e084-4a1a-4d21-b2e9-b51f79287094" status: 200 len: 1615 microversion: 2.1 time: 0.099232 May 26 12:55:27.712873 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: [pid: 129321|app: 0|req: 632/1283] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 26 12:55:27 2022] GET /compute/v2.1/servers/e9e3e084-4a1a-4d21-b2e9-b51f79287094 => generated 1615 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:55:27.928644 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi [req-2a9149c9-a023-459c-9556-9f01c79c28d1 req-d11d9a6f-6169-49aa-8d6a-3fd3866e0811 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e9e3e084-4a1a-4d21-b2e9-b51f79287094", "name": "network-vif-deleted", "tag": "9e80b77e-f708-4605-b98a-5347a654dd4b"}]} {{(pid=129322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 12:55:27.937891 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [req-2a9149c9-a023-459c-9556-9f01c79c28d1 req-d11d9a6f-6169-49aa-8d6a-3fd3866e0811 service nova] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:55:27.938371 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [req-2a9149c9-a023-459c-9556-9f01c79c28d1 req-d11d9a6f-6169-49aa-8d6a-3fd3866e0811 service nova] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:55:27.950126 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: INFO nova.api.openstack.compute.server_external_events [req-2a9149c9-a023-459c-9556-9f01c79c28d1 req-d11d9a6f-6169-49aa-8d6a-3fd3866e0811 service nova] Creating event network-vif-deleted:9e80b77e-f708-4605-b98a-5347a654dd4b for instance e9e3e084-4a1a-4d21-b2e9-b51f79287094 on hv-cinder-81966 May 26 12:55:27.955145 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: INFO nova.api.openstack.requestlog [req-2a9149c9-a023-459c-9556-9f01c79c28d1 req-d11d9a6f-6169-49aa-8d6a-3fd3866e0811 service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030155 May 26 12:55:27.958875 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: [pid: 129322|app: 0|req: 652/1284] 10.222.0.75 () {64 vars in 1317 bytes} [Thu May 26 12:55:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 12:55:28.720996 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi [None req-a0d54771-9639-45b6-97c5-d6ac94f14680 tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] Calling method '>' {{(pid=129321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:55:28.721734 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.compute.api [None req-a0d54771-9639-45b6-97c5-d6ac94f14680 tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] [instance: e9e3e084-4a1a-4d21-b2e9-b51f79287094] Fetching instance by UUID {{(pid=129321) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:55:28.729791 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-a0d54771-9639-45b6-97c5-d6ac94f14680 tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:55:28.730255 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-a0d54771-9639-45b6-97c5-d6ac94f14680 tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:55:28.730997 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-a0d54771-9639-45b6-97c5-d6ac94f14680 tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:55:28.731437 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-a0d54771-9639-45b6-97c5-d6ac94f14680 tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:55:28.748223 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: INFO nova.api.openstack.wsgi [None req-a0d54771-9639-45b6-97c5-d6ac94f14680 tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] HTTP exception thrown: Instance e9e3e084-4a1a-4d21-b2e9-b51f79287094 could not be found. May 26 12:55:28.750642 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi [None req-a0d54771-9639-45b6-97c5-d6ac94f14680 tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] Request method failure captured: May 26 12:55:28.750642 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: request: GET /compute/v2.1/servers/e9e3e084-4a1a-4d21-b2e9-b51f79287094 HTTP/1.1 May 26 12:55:28.750642 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: Accept: application/json May 26 12:55:28.750642 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: Accept-Encoding: identity May 26 12:55:28.750642 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: Connection: close May 26 12:55:28.750642 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: Content-Length: 0 May 26 12:55:28.750642 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: Content-Type: application/json May 26 12:55:28.750642 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: Host: 10.222.0.75 May 26 12:55:28.750642 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: Openstack-System-Scope: None May 26 12:55:28.750642 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: User-Agent: python-urllib3/1.26.9 May 26 12:55:28.750642 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: X-Auth-Token: gAAAAABij3dy_ejiT_65wXWPYwZfIN-6WeUbfvEBcCDgX9L01CFqFU-nwaxJgQr_xdeJZky3mnpsSEy0WtYtz-shYs9kb1EXqBcjtE4c5z7FWjh8oWZK7TxUIPSLNV7p0eRBTjtvtICj3UXIwBcd_3erDIcqb3pLxZywjxdf6YmqLjQWXxRzhB0 May 26 12:55:28.750642 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: X-Domain-Id: None May 26 12:55:28.750642 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: X-Domain-Name: None May 26 12:55:28.750642 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: X-Identity-Status: Confirmed May 26 12:55:28.750642 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: X-Is-Admin-Project: True May 26 12:55:28.750642 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: X-Project-Domain-Id: default May 26 12:55:28.750642 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: X-Project-Domain-Name: Default May 26 12:55:28.750642 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: X-Project-Id: 93d5b6bba38643bfb76f083e230b3d22 May 26 12:55:28.750642 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: X-Project-Name: tempest-AttachVolumeNegativeTest-1109191477 May 26 12:55:28.750642 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: X-Role: member,reader May 26 12:55:28.750642 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: X-Roles: member,reader May 26 12:55:28.752287 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/93d5b6bba38643bfb76f083e230b3d22"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.75:8080", "publicURL": "http://10.222.0.75:8080/v1/AUTH_93d5b6bba38643bfb76f083e230b3d22"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2/93d5b6bba38643bfb76f083e230b3d22"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/93d5b6bba38643bfb76f083e230b3d22"}]}] May 26 12:55:28.752287 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: X-Tenant: tempest-AttachVolumeNegativeTest-1109191477 May 26 12:55:28.752287 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: X-Tenant-Id: 93d5b6bba38643bfb76f083e230b3d22 May 26 12:55:28.752287 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1109191477 May 26 12:55:28.752287 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: X-User: tempest-AttachVolumeNegativeTest-1109191477-project May 26 12:55:28.752287 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: X-User-Domain-Id: default May 26 12:55:28.752287 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: X-User-Domain-Name: Default May 26 12:55:28.752287 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: X-User-Id: eddc5d9ac2a74507bca19e06f0051ae1 May 26 12:55:28.752287 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: X-User-Name: tempest-AttachVolumeNegativeTest-1109191477-project May 26 12:55:28.752287 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: method: > May 26 12:55:28.752287 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: exception: Instance e9e3e084-4a1a-4d21-b2e9-b51f79287094 could not be found. May 26 12:55:28.752287 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: action_args: {'id': 'e9e3e084-4a1a-4d21-b2e9-b51f79287094'} May 26 12:55:28.753100 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: {{(pid=129321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 12:55:28.753100 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 12:55:28.753100 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 26 12:55:28.753100 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 26 12:55:28.753100 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 26 12:55:28.753100 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 26 12:55:28.753100 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 26 12:55:28.753100 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 26 12:55:28.753100 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 26 12:55:28.753100 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 26 12:55:28.753100 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e9e3e084-4a1a-4d21-b2e9-b51f79287094 could not be found. May 26 12:55:28.753100 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi May 26 12:55:28.753100 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 12:55:28.753100 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi May 26 12:55:28.753100 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 12:55:28.753100 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 12:55:28.753100 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 12:55:28.753100 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 12:55:28.753100 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 12:55:28.753100 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 12:55:28.754887 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 12:55:28.754887 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 26 12:55:28.754887 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 26 12:55:28.754887 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 26 12:55:28.754887 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 26 12:55:28.754887 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 26 12:55:28.754887 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 12:55:28.754887 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e9e3e084-4a1a-4d21-b2e9-b51f79287094 could not be found. May 26 12:55:28.754887 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi May 26 12:55:28.754887 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 12:55:28.754887 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi May 26 12:55:28.754887 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 12:55:28.754887 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 12:55:28.754887 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 12:55:28.754887 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 12:55:28.754887 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 12:55:28.754887 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e9e3e084-4a1a-4d21-b2e9-b51f79287094 could not be found. May 26 12:55:28.754887 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi May 26 12:55:28.756814 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi [None req-a0d54771-9639-45b6-97c5-d6ac94f14680 tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] Returning 404 to user: Instance e9e3e084-4a1a-4d21-b2e9-b51f79287094 could not be found. {{(pid=129321) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 12:55:28.756814 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: INFO nova.api.openstack.requestlog [None req-a0d54771-9639-45b6-97c5-d6ac94f14680 tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] 10.222.0.75 "GET /compute/v2.1/servers/e9e3e084-4a1a-4d21-b2e9-b51f79287094" status: 404 len: 111 microversion: 2.1 time: 0.035607 May 26 12:55:28.756814 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: [pid: 129321|app: 0|req: 633/1285] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 26 12:55:28 2022] GET /compute/v2.1/servers/e9e3e084-4a1a-4d21-b2e9-b51f79287094 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 26 12:55:28.763099 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi [None req-a6f75212-0d70-4097-bb49-cba046444a73 tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] Calling method '.version_select at 0x7f830d23b3a0>' {{(pid=129322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:55:28.786388 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: INFO nova.api.openstack.requestlog [None req-a6f75212-0d70-4097-bb49-cba046444a73 tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] 10.222.0.75 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1004492705" status: 202 len: 0 microversion: 2.1 time: 0.028078 May 26 12:55:28.787284 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: [pid: 129322|app: 0|req: 653/1286] 10.222.0.75 () {58 vars in 1220 bytes} [Thu May 26 12:55:28 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1004492705 => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 26 12:55:29.404737 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi [None req-4771ab4f-58b1-4387-be19-baf1a0158f8d tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] Action: 'create', calling method: .version_select at 0x7f82fbf1dca0>, body: {"keypair": {"name": "tempest-keypair-1055227906", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHsdv6OPdVjTQH2m270v3htcllLy/hRRaIqouQRbhm4xh4yBhKiUf0tv9uuaM6ppE3zgX/AvUkTvZ1+FgUhiZx7vg9XgSMhETDiq9Y0sRVjFhe4/Ijs3nJgozDchOiDf8Q=="}} {{(pid=129321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 12:55:29.419358 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.quota [None req-4771ab4f-58b1-4387-be19-baf1a0158f8d tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] Getting quotas for project 93d5b6bba38643bfb76f083e230b3d22. Resources: {'key_pairs'} {{(pid=129321) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 26 12:55:29.423356 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.quota [None req-4771ab4f-58b1-4387-be19-baf1a0158f8d tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] Getting quotas for user eddc5d9ac2a74507bca19e06f0051ae1 and project 93d5b6bba38643bfb76f083e230b3d22. Resources: {'key_pairs'} {{(pid=129321) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 26 12:55:29.449144 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: INFO nova.api.openstack.requestlog [None req-4771ab4f-58b1-4387-be19-baf1a0158f8d tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] 10.222.0.75 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.048181 May 26 12:55:29.449747 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: [pid: 129321|app: 0|req: 634/1287] 10.222.0.75 () {60 vars in 1158 bytes} [Thu May 26 12:55:29 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 12:55:30.803557 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi [None req-d9dc1787-f0c9-4ce9-b4d9-617993b61f5e tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1755644932", "imageRef": "1e3c323d-d797-4e6d-bd9a-482d90084b0c", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "0b8803cb-8e70-473c-b131-a8a5b912880c"}], "security_groups": [{"name": "tempest-securitygroup--1220960322"}], "key_name": "tempest-keypair-1055227906", "user_data": "}} {{(pid=129322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 12:55:30.810153 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG dbcounter [-] [129322] Writing DB stats nova_api:SELECT=50,nova_api:INSERT=3,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=129322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:55:30.920650 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.network.neutron [None req-d9dc1787-f0c9-4ce9-b4d9-617993b61f5e tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] validate_networks() for [('0b8803cb-8e70-473c-b131-a8a5b912880c', None, None, None, None, None)] {{(pid=129322) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 26 12:55:31.425088 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.virt.hardware [None req-d9dc1787-f0c9-4ce9-b4d9-617993b61f5e tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] Flavor limits 0:0:0 {{(pid=129322) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 26 12:55:31.425533 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.virt.hardware [None req-d9dc1787-f0c9-4ce9-b4d9-617993b61f5e tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] Image limits 0:0:0 {{(pid=129322) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 26 12:55:31.426049 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.virt.hardware [None req-d9dc1787-f0c9-4ce9-b4d9-617993b61f5e tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] Flavor pref 0:0:0 {{(pid=129322) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 26 12:55:31.426457 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.virt.hardware [None req-d9dc1787-f0c9-4ce9-b4d9-617993b61f5e tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] Image pref 0:0:0 {{(pid=129322) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 26 12:55:31.426873 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.virt.hardware [None req-d9dc1787-f0c9-4ce9-b4d9-617993b61f5e tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129322) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 26 12:55:31.436877 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-d9dc1787-f0c9-4ce9-b4d9-617993b61f5e tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:55:31.437321 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-d9dc1787-f0c9-4ce9-b4d9-617993b61f5e tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:55:31.438123 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-d9dc1787-f0c9-4ce9-b4d9-617993b61f5e tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:55:31.438559 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-d9dc1787-f0c9-4ce9-b4d9-617993b61f5e tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:55:31.445441 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG dbcounter [-] [129322] Writing DB stats nova_cell1:SELECT=81,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:55:31.458695 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.quota [None req-d9dc1787-f0c9-4ce9-b4d9-617993b61f5e tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] Getting quotas for project 93d5b6bba38643bfb76f083e230b3d22. Resources: {'instances', 'cores', 'ram'} {{(pid=129322) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 26 12:55:31.463236 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.quota [None req-d9dc1787-f0c9-4ce9-b4d9-617993b61f5e tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] Getting quotas for user eddc5d9ac2a74507bca19e06f0051ae1 and project 93d5b6bba38643bfb76f083e230b3d22. Resources: {'instances', 'cores', 'ram'} {{(pid=129322) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 26 12:55:31.474789 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.compute.api [None req-d9dc1787-f0c9-4ce9-b4d9-617993b61f5e tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] Going to run 1 instances... {{(pid=129322) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 26 12:55:31.477228 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.compute.api [None req-d9dc1787-f0c9-4ce9-b4d9-617993b61f5e tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] [instance: c71ec469-93f6-45d5-984f-838a1c27a5a1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1e3c323d-d797-4e6d-bd9a-482d90084b0c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129322) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 26 12:55:31.527468 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: INFO nova.api.openstack.requestlog [None req-d9dc1787-f0c9-4ce9-b4d9-617993b61f5e tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] 10.222.0.75 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.728802 May 26 12:55:31.528365 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: [pid: 129322|app: 0|req: 654/1288] 10.222.0.75 () {60 vars in 1146 bytes} [Thu May 26 12:55:30 2022] POST /compute/v2.1/servers => generated 402 bytes in 730 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 26 12:55:31.539178 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi [None req-84715c90-c20f-4c3a-9bd3-729100ce8482 tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] Calling method '>' {{(pid=129321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:55:31.540067 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.compute.api [None req-84715c90-c20f-4c3a-9bd3-729100ce8482 tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] [instance: c71ec469-93f6-45d5-984f-838a1c27a5a1] Fetching instance by UUID {{(pid=129321) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:55:31.541682 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG dbcounter [-] [129321] Writing DB stats nova_api:SELECT=53,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=129321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:55:31.598054 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.policy [None req-84715c90-c20f-4c3a-9bd3-729100ce8482 tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eddc5d9ac2a74507bca19e06f0051ae1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93d5b6bba38643bfb76f083e230b3d22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129321) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:55:31.605162 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: INFO nova.api.openstack.requestlog [None req-84715c90-c20f-4c3a-9bd3-729100ce8482 tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] 10.222.0.75 "GET /compute/v2.1/servers/c71ec469-93f6-45d5-984f-838a1c27a5a1" status: 200 len: 1242 microversion: 2.1 time: 0.070210 May 26 12:55:31.605731 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: [pid: 129321|app: 0|req: 635/1289] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 26 12:55:31 2022] GET /compute/v2.1/servers/c71ec469-93f6-45d5-984f-838a1c27a5a1 => generated 1242 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 12:55:32.622975 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi [None req-17c5d996-3073-483c-9b41-9bb395d518f9 tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] Calling method '>' {{(pid=129322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:55:32.624308 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.compute.api [None req-17c5d996-3073-483c-9b41-9bb395d518f9 tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] [instance: c71ec469-93f6-45d5-984f-838a1c27a5a1] Fetching instance by UUID {{(pid=129322) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:55:32.633277 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-17c5d996-3073-483c-9b41-9bb395d518f9 tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:55:32.633830 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-17c5d996-3073-483c-9b41-9bb395d518f9 tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:55:32.634631 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-17c5d996-3073-483c-9b41-9bb395d518f9 tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:55:32.635063 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-17c5d996-3073-483c-9b41-9bb395d518f9 tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:55:32.704963 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.policy [None req-17c5d996-3073-483c-9b41-9bb395d518f9 tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eddc5d9ac2a74507bca19e06f0051ae1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93d5b6bba38643bfb76f083e230b3d22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129322) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:55:32.712806 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: INFO nova.api.openstack.requestlog [None req-17c5d996-3073-483c-9b41-9bb395d518f9 tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] 10.222.0.75 "GET /compute/v2.1/servers/c71ec469-93f6-45d5-984f-838a1c27a5a1" status: 200 len: 1312 microversion: 2.1 time: 0.093885 May 26 12:55:32.713555 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: [pid: 129322|app: 0|req: 655/1290] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 26 12:55:32 2022] GET /compute/v2.1/servers/c71ec469-93f6-45d5-984f-838a1c27a5a1 => generated 1312 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:55:33.731928 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi [None req-86d3628c-9930-4aa8-930e-acccfa64f326 tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] Calling method '>' {{(pid=129321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:55:33.732563 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.compute.api [None req-86d3628c-9930-4aa8-930e-acccfa64f326 tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] [instance: c71ec469-93f6-45d5-984f-838a1c27a5a1] Fetching instance by UUID {{(pid=129321) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:55:33.742972 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-86d3628c-9930-4aa8-930e-acccfa64f326 tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:55:33.743724 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-86d3628c-9930-4aa8-930e-acccfa64f326 tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:55:33.744850 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-86d3628c-9930-4aa8-930e-acccfa64f326 tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:55:33.746103 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-86d3628c-9930-4aa8-930e-acccfa64f326 tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:55:33.957506 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.policy [None req-86d3628c-9930-4aa8-930e-acccfa64f326 tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eddc5d9ac2a74507bca19e06f0051ae1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93d5b6bba38643bfb76f083e230b3d22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129321) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:55:33.966802 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: INFO nova.api.openstack.requestlog [None req-86d3628c-9930-4aa8-930e-acccfa64f326 tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] 10.222.0.75 "GET /compute/v2.1/servers/c71ec469-93f6-45d5-984f-838a1c27a5a1" status: 200 len: 1368 microversion: 2.1 time: 0.239990 May 26 12:55:33.967518 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: [pid: 129321|app: 0|req: 636/1291] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 26 12:55:33 2022] GET /compute/v2.1/servers/c71ec469-93f6-45d5-984f-838a1c27a5a1 => generated 1368 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:55:34.171124 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi [req-26122b4b-a67d-4916-9411-269be7cdce1a req-7da688e1-712c-448d-89de-aa7ba55dc6cd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c71ec469-93f6-45d5-984f-838a1c27a5a1", "tag": "8957e038-7ecf-4b02-9f26-e7e6db3f8ab0"}]} {{(pid=129322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 12:55:34.191112 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [req-26122b4b-a67d-4916-9411-269be7cdce1a req-7da688e1-712c-448d-89de-aa7ba55dc6cd service nova] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:55:34.191832 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [req-26122b4b-a67d-4916-9411-269be7cdce1a req-7da688e1-712c-448d-89de-aa7ba55dc6cd service nova] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:55:34.207248 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: INFO nova.api.openstack.compute.server_external_events [req-26122b4b-a67d-4916-9411-269be7cdce1a req-7da688e1-712c-448d-89de-aa7ba55dc6cd service nova] Creating event network-changed:8957e038-7ecf-4b02-9f26-e7e6db3f8ab0 for instance c71ec469-93f6-45d5-984f-838a1c27a5a1 on hv-cinder-81966 May 26 12:55:34.214122 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: INFO nova.api.openstack.requestlog [req-26122b4b-a67d-4916-9411-269be7cdce1a req-7da688e1-712c-448d-89de-aa7ba55dc6cd service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047773 May 26 12:55:34.214930 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: [pid: 129322|app: 0|req: 656/1292] 10.222.0.75 () {64 vars in 1317 bytes} [Thu May 26 12:55:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 12:55:34.988609 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi [None req-ed1b4ad5-3151-4ce3-968b-85abbb6361ab tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] Calling method '>' {{(pid=129321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:55:34.989573 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.compute.api [None req-ed1b4ad5-3151-4ce3-968b-85abbb6361ab tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] [instance: c71ec469-93f6-45d5-984f-838a1c27a5a1] Fetching instance by UUID {{(pid=129321) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:55:34.999882 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-ed1b4ad5-3151-4ce3-968b-85abbb6361ab tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:55:35.000324 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-ed1b4ad5-3151-4ce3-968b-85abbb6361ab tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:55:35.001094 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-ed1b4ad5-3151-4ce3-968b-85abbb6361ab tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:55:35.001520 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-ed1b4ad5-3151-4ce3-968b-85abbb6361ab tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:55:35.152330 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.policy [None req-ed1b4ad5-3151-4ce3-968b-85abbb6361ab tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eddc5d9ac2a74507bca19e06f0051ae1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93d5b6bba38643bfb76f083e230b3d22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129321) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:55:35.161270 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: INFO nova.api.openstack.requestlog [None req-ed1b4ad5-3151-4ce3-968b-85abbb6361ab tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] 10.222.0.75 "GET /compute/v2.1/servers/c71ec469-93f6-45d5-984f-838a1c27a5a1" status: 200 len: 1368 microversion: 2.1 time: 0.179284 May 26 12:55:35.161846 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: [pid: 129321|app: 0|req: 637/1293] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 26 12:55:34 2022] GET /compute/v2.1/servers/c71ec469-93f6-45d5-984f-838a1c27a5a1 => generated 1368 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:55:36.181701 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi [None req-5556b7dc-7088-4bf5-b8a1-9e99aeee2731 tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] Calling method '>' {{(pid=129322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:55:36.182507 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.compute.api [None req-5556b7dc-7088-4bf5-b8a1-9e99aeee2731 tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] [instance: c71ec469-93f6-45d5-984f-838a1c27a5a1] Fetching instance by UUID {{(pid=129322) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:55:36.196461 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-5556b7dc-7088-4bf5-b8a1-9e99aeee2731 tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:55:36.197055 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-5556b7dc-7088-4bf5-b8a1-9e99aeee2731 tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:55:36.198069 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-5556b7dc-7088-4bf5-b8a1-9e99aeee2731 tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:55:36.198647 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-5556b7dc-7088-4bf5-b8a1-9e99aeee2731 tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:55:36.336102 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.policy [None req-5556b7dc-7088-4bf5-b8a1-9e99aeee2731 tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eddc5d9ac2a74507bca19e06f0051ae1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93d5b6bba38643bfb76f083e230b3d22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129322) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:55:36.344213 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: INFO nova.api.openstack.requestlog [None req-5556b7dc-7088-4bf5-b8a1-9e99aeee2731 tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] 10.222.0.75 "GET /compute/v2.1/servers/c71ec469-93f6-45d5-984f-838a1c27a5a1" status: 200 len: 1368 microversion: 2.1 time: 0.168566 May 26 12:55:36.344800 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: [pid: 129322|app: 0|req: 657/1294] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 26 12:55:36 2022] GET /compute/v2.1/servers/c71ec469-93f6-45d5-984f-838a1c27a5a1 => generated 1368 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:55:37.361004 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi [None req-debfa99c-3daa-4a36-a880-0e67f043553c tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] Calling method '>' {{(pid=129321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:55:37.361612 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.compute.api [None req-debfa99c-3daa-4a36-a880-0e67f043553c tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] [instance: c71ec469-93f6-45d5-984f-838a1c27a5a1] Fetching instance by UUID {{(pid=129321) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:55:37.368823 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-debfa99c-3daa-4a36-a880-0e67f043553c tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:55:37.369495 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-debfa99c-3daa-4a36-a880-0e67f043553c tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:55:37.370686 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-debfa99c-3daa-4a36-a880-0e67f043553c tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:55:37.371343 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-debfa99c-3daa-4a36-a880-0e67f043553c tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:55:37.511418 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.policy [None req-debfa99c-3daa-4a36-a880-0e67f043553c tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eddc5d9ac2a74507bca19e06f0051ae1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93d5b6bba38643bfb76f083e230b3d22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129321) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:55:37.520357 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: INFO nova.api.openstack.requestlog [None req-debfa99c-3daa-4a36-a880-0e67f043553c tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] 10.222.0.75 "GET /compute/v2.1/servers/c71ec469-93f6-45d5-984f-838a1c27a5a1" status: 200 len: 1368 microversion: 2.1 time: 0.163494 May 26 12:55:37.521188 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: [pid: 129321|app: 0|req: 638/1295] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 26 12:55:37 2022] GET /compute/v2.1/servers/c71ec469-93f6-45d5-984f-838a1c27a5a1 => generated 1368 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:55:38.542232 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi [None req-4eb40be0-10d6-4907-b9e0-8f59608c878f tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] Calling method '>' {{(pid=129322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:55:38.543442 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.compute.api [None req-4eb40be0-10d6-4907-b9e0-8f59608c878f tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] [instance: c71ec469-93f6-45d5-984f-838a1c27a5a1] Fetching instance by UUID {{(pid=129322) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:55:38.551573 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-4eb40be0-10d6-4907-b9e0-8f59608c878f tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:55:38.552058 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-4eb40be0-10d6-4907-b9e0-8f59608c878f tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:55:38.552851 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-4eb40be0-10d6-4907-b9e0-8f59608c878f tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:55:38.553311 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-4eb40be0-10d6-4907-b9e0-8f59608c878f tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:55:38.701817 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.policy [None req-4eb40be0-10d6-4907-b9e0-8f59608c878f tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eddc5d9ac2a74507bca19e06f0051ae1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93d5b6bba38643bfb76f083e230b3d22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129322) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:55:38.709969 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: INFO nova.api.openstack.requestlog [None req-4eb40be0-10d6-4907-b9e0-8f59608c878f tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] 10.222.0.75 "GET /compute/v2.1/servers/c71ec469-93f6-45d5-984f-838a1c27a5a1" status: 200 len: 1368 microversion: 2.1 time: 0.174363 May 26 12:55:38.710542 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: [pid: 129322|app: 0|req: 658/1296] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 26 12:55:38 2022] GET /compute/v2.1/servers/c71ec469-93f6-45d5-984f-838a1c27a5a1 => generated 1368 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:55:39.497177 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi [req-7ca977a3-d91c-49a0-9fce-74ee11f57859 req-ac8b02f2-55d3-453a-ac5f-5c2958edb15e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c71ec469-93f6-45d5-984f-838a1c27a5a1", "name": "network-vif-plugged", "status": "completed", "tag": "8957e038-7ecf-4b02-9f26-e7e6db3f8ab0"}]} {{(pid=129321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 12:55:39.506531 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [req-7ca977a3-d91c-49a0-9fce-74ee11f57859 req-ac8b02f2-55d3-453a-ac5f-5c2958edb15e service nova] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:55:39.507039 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [req-7ca977a3-d91c-49a0-9fce-74ee11f57859 req-ac8b02f2-55d3-453a-ac5f-5c2958edb15e service nova] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:55:39.519780 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: INFO nova.api.openstack.compute.server_external_events [req-7ca977a3-d91c-49a0-9fce-74ee11f57859 req-ac8b02f2-55d3-453a-ac5f-5c2958edb15e service nova] Creating event network-vif-plugged:8957e038-7ecf-4b02-9f26-e7e6db3f8ab0 for instance c71ec469-93f6-45d5-984f-838a1c27a5a1 on hv-cinder-81966 May 26 12:55:39.524874 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: INFO nova.api.openstack.requestlog [req-7ca977a3-d91c-49a0-9fce-74ee11f57859 req-ac8b02f2-55d3-453a-ac5f-5c2958edb15e service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031804 May 26 12:55:39.525496 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: [pid: 129321|app: 0|req: 639/1297] 10.222.0.75 () {64 vars in 1317 bytes} [Thu May 26 12:55:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 12:55:39.726549 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi [None req-f920520b-08ec-4855-a517-7a7cd0984169 tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] Calling method '>' {{(pid=129322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:55:39.727179 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.compute.api [None req-f920520b-08ec-4855-a517-7a7cd0984169 tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] [instance: c71ec469-93f6-45d5-984f-838a1c27a5a1] Fetching instance by UUID {{(pid=129322) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:55:39.733897 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-f920520b-08ec-4855-a517-7a7cd0984169 tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:55:39.734344 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-f920520b-08ec-4855-a517-7a7cd0984169 tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:55:39.735366 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-f920520b-08ec-4855-a517-7a7cd0984169 tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:55:39.735820 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-f920520b-08ec-4855-a517-7a7cd0984169 tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:55:39.879841 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.policy [None req-f920520b-08ec-4855-a517-7a7cd0984169 tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eddc5d9ac2a74507bca19e06f0051ae1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93d5b6bba38643bfb76f083e230b3d22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129322) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:55:39.891926 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: INFO nova.api.openstack.requestlog [None req-f920520b-08ec-4855-a517-7a7cd0984169 tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] 10.222.0.75 "GET /compute/v2.1/servers/c71ec469-93f6-45d5-984f-838a1c27a5a1" status: 200 len: 1368 microversion: 2.1 time: 0.169279 May 26 12:55:39.892547 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: [pid: 129322|app: 0|req: 659/1298] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 26 12:55:39 2022] GET /compute/v2.1/servers/c71ec469-93f6-45d5-984f-838a1c27a5a1 => generated 1368 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:55:40.912940 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi [None req-4a21dc1b-9f56-4899-84e6-8e8c4668822b tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] Calling method '>' {{(pid=129321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:55:40.913820 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.compute.api [None req-4a21dc1b-9f56-4899-84e6-8e8c4668822b tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] [instance: c71ec469-93f6-45d5-984f-838a1c27a5a1] Fetching instance by UUID {{(pid=129321) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:55:40.920754 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-4a21dc1b-9f56-4899-84e6-8e8c4668822b tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:55:40.921195 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-4a21dc1b-9f56-4899-84e6-8e8c4668822b tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:55:40.921959 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-4a21dc1b-9f56-4899-84e6-8e8c4668822b tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:55:40.922392 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-4a21dc1b-9f56-4899-84e6-8e8c4668822b tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:55:41.061517 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.policy [None req-4a21dc1b-9f56-4899-84e6-8e8c4668822b tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eddc5d9ac2a74507bca19e06f0051ae1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93d5b6bba38643bfb76f083e230b3d22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129321) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:55:41.069604 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: INFO nova.api.openstack.requestlog [None req-4a21dc1b-9f56-4899-84e6-8e8c4668822b tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] 10.222.0.75 "GET /compute/v2.1/servers/c71ec469-93f6-45d5-984f-838a1c27a5a1" status: 200 len: 1368 microversion: 2.1 time: 0.163184 May 26 12:55:41.070171 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: [pid: 129321|app: 0|req: 640/1299] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 26 12:55:40 2022] GET /compute/v2.1/servers/c71ec469-93f6-45d5-984f-838a1c27a5a1 => generated 1368 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:55:42.087314 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi [None req-3d77580c-ecdf-46c7-8989-26258b6352bf tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] Calling method '>' {{(pid=129322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:55:42.087880 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.compute.api [None req-3d77580c-ecdf-46c7-8989-26258b6352bf tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] [instance: c71ec469-93f6-45d5-984f-838a1c27a5a1] Fetching instance by UUID {{(pid=129322) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:55:42.090292 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG dbcounter [-] [129322] Writing DB stats nova_cell0:SELECT=2 {{(pid=129322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:55:42.090935 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG dbcounter [-] [129322] Writing DB stats nova_cell0:SELECT=6 {{(pid=129322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:55:42.097806 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-3d77580c-ecdf-46c7-8989-26258b6352bf tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:55:42.097806 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-3d77580c-ecdf-46c7-8989-26258b6352bf tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:55:42.098462 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-3d77580c-ecdf-46c7-8989-26258b6352bf tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:55:42.098785 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-3d77580c-ecdf-46c7-8989-26258b6352bf tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:55:42.253416 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.policy [None req-3d77580c-ecdf-46c7-8989-26258b6352bf tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eddc5d9ac2a74507bca19e06f0051ae1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93d5b6bba38643bfb76f083e230b3d22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129322) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:55:42.265221 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: INFO nova.api.openstack.requestlog [None req-3d77580c-ecdf-46c7-8989-26258b6352bf tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] 10.222.0.75 "GET /compute/v2.1/servers/c71ec469-93f6-45d5-984f-838a1c27a5a1" status: 200 len: 1559 microversion: 2.1 time: 0.181930 May 26 12:55:42.265799 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: [pid: 129322|app: 0|req: 660/1300] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 26 12:55:42 2022] GET /compute/v2.1/servers/c71ec469-93f6-45d5-984f-838a1c27a5a1 => generated 1559 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:55:42.282968 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi [None req-6f19b220-5f38-4e2b-a861-355b5c0ca7e6 tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] Calling method '>' {{(pid=129321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:55:42.283575 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.compute.api [None req-6f19b220-5f38-4e2b-a861-355b5c0ca7e6 tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] [instance: c71ec469-93f6-45d5-984f-838a1c27a5a1] Fetching instance by UUID {{(pid=129321) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:55:42.285615 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG dbcounter [-] [129321] Writing DB stats nova_cell0:SELECT=6 {{(pid=129321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:55:42.291936 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-6f19b220-5f38-4e2b-a861-355b5c0ca7e6 tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:55:42.292387 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-6f19b220-5f38-4e2b-a861-355b5c0ca7e6 tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:55:42.293148 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-6f19b220-5f38-4e2b-a861-355b5c0ca7e6 tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:55:42.293581 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-6f19b220-5f38-4e2b-a861-355b5c0ca7e6 tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:55:42.377448 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: INFO nova.api.openstack.requestlog [None req-6f19b220-5f38-4e2b-a861-355b5c0ca7e6 tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] 10.222.0.75 "GET /compute/v2.1/servers/c71ec469-93f6-45d5-984f-838a1c27a5a1/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.098331 May 26 12:55:42.378251 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: [pid: 129321|app: 0|req: 641/1301] 10.222.0.75 () {58 vars in 1274 bytes} [Thu May 26 12:55:42 2022] GET /compute/v2.1/servers/c71ec469-93f6-45d5-984f-838a1c27a5a1/os-interface => generated 285 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 12:55:43.360029 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi [req-0a850b4d-e7d4-42a8-ab36-05b1bd0b9c02 req-4bc887d7-a2ca-4a35-baf8-c7eb8611f1b2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c71ec469-93f6-45d5-984f-838a1c27a5a1", "tag": "8957e038-7ecf-4b02-9f26-e7e6db3f8ab0"}]} {{(pid=129322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 12:55:43.369573 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [req-0a850b4d-e7d4-42a8-ab36-05b1bd0b9c02 req-4bc887d7-a2ca-4a35-baf8-c7eb8611f1b2 service nova] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:55:43.369991 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [req-0a850b4d-e7d4-42a8-ab36-05b1bd0b9c02 req-4bc887d7-a2ca-4a35-baf8-c7eb8611f1b2 service nova] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:55:43.381062 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: INFO nova.api.openstack.compute.server_external_events [req-0a850b4d-e7d4-42a8-ab36-05b1bd0b9c02 req-4bc887d7-a2ca-4a35-baf8-c7eb8611f1b2 service nova] Creating event network-changed:8957e038-7ecf-4b02-9f26-e7e6db3f8ab0 for instance c71ec469-93f6-45d5-984f-838a1c27a5a1 on hv-cinder-81966 May 26 12:55:43.386413 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: INFO nova.api.openstack.requestlog [req-0a850b4d-e7d4-42a8-ab36-05b1bd0b9c02 req-4bc887d7-a2ca-4a35-baf8-c7eb8611f1b2 service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030068 May 26 12:55:43.387140 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: [pid: 129322|app: 0|req: 661/1302] 10.222.0.75 () {64 vars in 1317 bytes} [Thu May 26 12:55:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 12:56:36.428888 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 26 12:56:36.429880 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: Thu May 26 12:56:36 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 26 12:56:58.483305 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG dbcounter [-] [129321] Writing DB stats nova_api:SELECT=15 {{(pid=129321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:56:58.484085 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG dbcounter [-] [129321] Writing DB stats nova_cell1:SELECT=32 {{(pid=129321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:56:58.488880 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi [None req-d5f18f9d-dc6b-4bd4-bf7c-142fe65437e9 tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] Calling method '>' {{(pid=129321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:56:58.489395 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.compute.api [None req-d5f18f9d-dc6b-4bd4-bf7c-142fe65437e9 tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] [instance: c71ec469-93f6-45d5-984f-838a1c27a5a1] Fetching instance by UUID {{(pid=129321) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:56:58.496438 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-d5f18f9d-dc6b-4bd4-bf7c-142fe65437e9 tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:56:58.496880 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-d5f18f9d-dc6b-4bd4-bf7c-142fe65437e9 tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:56:58.497638 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-d5f18f9d-dc6b-4bd4-bf7c-142fe65437e9 tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:56:58.498067 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-d5f18f9d-dc6b-4bd4-bf7c-142fe65437e9 tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:56:58.523453 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: INFO nova.api.openstack.requestlog [None req-d5f18f9d-dc6b-4bd4-bf7c-142fe65437e9 tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] 10.222.0.75 "GET /compute/v2.1/servers/c71ec469-93f6-45d5-984f-838a1c27a5a1/ips" status: 200 len: 151 microversion: 2.1 time: 0.042014 May 26 12:56:58.524053 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: [pid: 129321|app: 0|req: 642/1303] 10.222.0.75 () {58 vars in 1247 bytes} [Thu May 26 12:56:58 2022] GET /compute/v2.1/servers/c71ec469-93f6-45d5-984f-838a1c27a5a1/ips => generated 151 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 12:56:59.906987 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG dbcounter [-] [129322] Writing DB stats nova_api:SELECT=28,nova_api:INSERT=3 {{(pid=129322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:56:59.908402 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG dbcounter [-] [129322] Writing DB stats nova_cell1:SELECT=35 {{(pid=129322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:56:59.916624 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi [None req-514b0637-6a36-4ddf-bd63-a62a56663178 tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "778dbc15-d632-4917-9974-01ef15ded3c8"}} {{(pid=129322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 12:56:59.918060 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.compute.api [None req-514b0637-6a36-4ddf-bd63-a62a56663178 tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] [instance: c71ec469-93f6-45d5-984f-838a1c27a5a1] Fetching instance by UUID {{(pid=129322) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:56:59.925677 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-514b0637-6a36-4ddf-bd63-a62a56663178 tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:56:59.926121 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-514b0637-6a36-4ddf-bd63-a62a56663178 tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:56:59.926883 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-514b0637-6a36-4ddf-bd63-a62a56663178 tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:56:59.927312 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-514b0637-6a36-4ddf-bd63-a62a56663178 tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:57:00.203387 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: INFO nova.api.openstack.requestlog [None req-514b0637-6a36-4ddf-bd63-a62a56663178 tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] 10.222.0.75 "POST /compute/v2.1/servers/c71ec469-93f6-45d5-984f-838a1c27a5a1/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.299292 May 26 12:57:00.204187 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: [pid: 129322|app: 0|req: 662/1304] 10.222.0.75 () {60 vars in 1322 bytes} [Thu May 26 12:56:59 2022] POST /compute/v2.1/servers/c71ec469-93f6-45d5-984f-838a1c27a5a1/os-volume_attachments => generated 194 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 12:57:07.885271 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi [None req-776e29d2-626f-4f14-b41a-40d1df1d2bb9 tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] Calling method '>' {{(pid=129321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:57:07.886086 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.compute.api [None req-776e29d2-626f-4f14-b41a-40d1df1d2bb9 tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] [instance: c71ec469-93f6-45d5-984f-838a1c27a5a1] Fetching instance by UUID {{(pid=129321) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:57:07.896216 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-776e29d2-626f-4f14-b41a-40d1df1d2bb9 tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:57:07.896586 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-776e29d2-626f-4f14-b41a-40d1df1d2bb9 tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:57:07.897374 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-776e29d2-626f-4f14-b41a-40d1df1d2bb9 tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:57:07.897801 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-776e29d2-626f-4f14-b41a-40d1df1d2bb9 tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:57:07.993391 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.objects.instance [None req-776e29d2-626f-4f14-b41a-40d1df1d2bb9 tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] Lazy-loading 'services' on Instance uuid c71ec469-93f6-45d5-984f-838a1c27a5a1 {{(pid=129321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 26 12:57:08.089181 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: INFO nova.api.openstack.requestlog [None req-776e29d2-626f-4f14-b41a-40d1df1d2bb9 tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] 10.222.0.75 "DELETE /compute/v2.1/servers/c71ec469-93f6-45d5-984f-838a1c27a5a1/os-volume_attachments/778dbc15-d632-4917-9974-01ef15ded3c8" status: 202 len: 0 microversion: 2.1 time: 0.209891 May 26 12:57:08.089879 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: [pid: 129321|app: 0|req: 643/1305] 10.222.0.75 () {58 vars in 1415 bytes} [Thu May 26 12:57:07 2022] DELETE /compute/v2.1/servers/c71ec469-93f6-45d5-984f-838a1c27a5a1/os-volume_attachments/778dbc15-d632-4917-9974-01ef15ded3c8 => generated 0 bytes in 212 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 26 12:57:08.099414 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi [None req-9def5a88-ba03-479c-96cd-94057a1daaae tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] Calling method '>' {{(pid=129322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:57:08.100764 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.compute.api [None req-9def5a88-ba03-479c-96cd-94057a1daaae tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] [instance: c71ec469-93f6-45d5-984f-838a1c27a5a1] Fetching instance by UUID {{(pid=129322) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:57:08.108194 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-9def5a88-ba03-479c-96cd-94057a1daaae tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:57:08.108663 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-9def5a88-ba03-479c-96cd-94057a1daaae tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:57:08.109424 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-9def5a88-ba03-479c-96cd-94057a1daaae tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:57:08.109885 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-9def5a88-ba03-479c-96cd-94057a1daaae tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:57:08.141843 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: INFO nova.api.openstack.requestlog [None req-9def5a88-ba03-479c-96cd-94057a1daaae tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] 10.222.0.75 "GET /compute/v2.1/servers/c71ec469-93f6-45d5-984f-838a1c27a5a1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046973 May 26 12:57:08.142462 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: [pid: 129322|app: 0|req: 663/1306] 10.222.0.75 () {58 vars in 1301 bytes} [Thu May 26 12:57:08 2022] GET /compute/v2.1/servers/c71ec469-93f6-45d5-984f-838a1c27a5a1/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 26 12:57:09.156436 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi [None req-642a390c-6e0b-4d3f-b63a-00fdb9b2a6af tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] Calling method '>' {{(pid=129321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:57:09.157637 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.compute.api [None req-642a390c-6e0b-4d3f-b63a-00fdb9b2a6af tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] [instance: c71ec469-93f6-45d5-984f-838a1c27a5a1] Fetching instance by UUID {{(pid=129321) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:57:09.164849 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-642a390c-6e0b-4d3f-b63a-00fdb9b2a6af tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:57:09.165373 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-642a390c-6e0b-4d3f-b63a-00fdb9b2a6af tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:57:09.166213 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-642a390c-6e0b-4d3f-b63a-00fdb9b2a6af tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:57:09.166713 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-642a390c-6e0b-4d3f-b63a-00fdb9b2a6af tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:57:09.196868 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: INFO nova.api.openstack.requestlog [None req-642a390c-6e0b-4d3f-b63a-00fdb9b2a6af tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] 10.222.0.75 "GET /compute/v2.1/servers/c71ec469-93f6-45d5-984f-838a1c27a5a1/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045601 May 26 12:57:09.197545 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: [pid: 129321|app: 0|req: 644/1307] 10.222.0.75 () {58 vars in 1301 bytes} [Thu May 26 12:57:09 2022] GET /compute/v2.1/servers/c71ec469-93f6-45d5-984f-838a1c27a5a1/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 26 12:57:09.257356 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi [None req-7a772983-d7b2-4d1b-a40d-ac68b9e78d8e tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] Calling method '>' {{(pid=129322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:57:09.257923 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.compute.api [None req-7a772983-d7b2-4d1b-a40d-ac68b9e78d8e tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] [instance: c71ec469-93f6-45d5-984f-838a1c27a5a1] Fetching instance by UUID {{(pid=129322) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:57:09.264503 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-7a772983-d7b2-4d1b-a40d-ac68b9e78d8e tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:57:09.264916 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-7a772983-d7b2-4d1b-a40d-ac68b9e78d8e tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:57:09.265664 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-7a772983-d7b2-4d1b-a40d-ac68b9e78d8e tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:57:09.266078 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-7a772983-d7b2-4d1b-a40d-ac68b9e78d8e tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:57:09.292099 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.compute.api [None req-7a772983-d7b2-4d1b-a40d-ac68b9e78d8e tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] [instance: c71ec469-93f6-45d5-984f-838a1c27a5a1] Going to try to terminate instance {{(pid=129322) delete /opt/stack/nova/nova/compute/api.py:2664}} May 26 12:57:09.370434 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: INFO nova.api.openstack.requestlog [None req-7a772983-d7b2-4d1b-a40d-ac68b9e78d8e tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] 10.222.0.75 "DELETE /compute/v2.1/servers/c71ec469-93f6-45d5-984f-838a1c27a5a1" status: 204 len: 0 microversion: 2.1 time: 0.117008 May 26 12:57:09.371109 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: [pid: 129322|app: 0|req: 664/1308] 10.222.0.75 () {58 vars in 1238 bytes} [Thu May 26 12:57:09 2022] DELETE /compute/v2.1/servers/c71ec469-93f6-45d5-984f-838a1c27a5a1 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 26 12:57:09.380662 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi [None req-77b62f95-84ca-4729-8d45-d23bac30669f tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] Calling method '>' {{(pid=129321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:57:09.381513 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.compute.api [None req-77b62f95-84ca-4729-8d45-d23bac30669f tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] [instance: c71ec469-93f6-45d5-984f-838a1c27a5a1] Fetching instance by UUID {{(pid=129321) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:57:09.387700 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-77b62f95-84ca-4729-8d45-d23bac30669f tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:57:09.388151 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-77b62f95-84ca-4729-8d45-d23bac30669f tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:57:09.388897 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-77b62f95-84ca-4729-8d45-d23bac30669f tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:57:09.389333 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-77b62f95-84ca-4729-8d45-d23bac30669f tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:57:09.522198 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.policy [None req-77b62f95-84ca-4729-8d45-d23bac30669f tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eddc5d9ac2a74507bca19e06f0051ae1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93d5b6bba38643bfb76f083e230b3d22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129321) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:57:09.530061 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: INFO nova.api.openstack.requestlog [None req-77b62f95-84ca-4729-8d45-d23bac30669f tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] 10.222.0.75 "GET /compute/v2.1/servers/c71ec469-93f6-45d5-984f-838a1c27a5a1" status: 200 len: 1684 microversion: 2.1 time: 0.153699 May 26 12:57:09.530681 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: [pid: 129321|app: 0|req: 645/1309] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 26 12:57:09 2022] GET /compute/v2.1/servers/c71ec469-93f6-45d5-984f-838a1c27a5a1 => generated 1684 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:57:10.548787 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi [None req-69fa0d33-0171-4a10-b6bb-bd589868a602 tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] Calling method '>' {{(pid=129322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:57:10.549429 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.compute.api [None req-69fa0d33-0171-4a10-b6bb-bd589868a602 tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] [instance: c71ec469-93f6-45d5-984f-838a1c27a5a1] Fetching instance by UUID {{(pid=129322) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:57:10.556800 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-69fa0d33-0171-4a10-b6bb-bd589868a602 tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:57:10.557244 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-69fa0d33-0171-4a10-b6bb-bd589868a602 tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:57:10.557994 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-69fa0d33-0171-4a10-b6bb-bd589868a602 tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:57:10.558419 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-69fa0d33-0171-4a10-b6bb-bd589868a602 tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:57:10.694089 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.policy [None req-69fa0d33-0171-4a10-b6bb-bd589868a602 tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eddc5d9ac2a74507bca19e06f0051ae1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93d5b6bba38643bfb76f083e230b3d22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129322) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:57:10.701894 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: INFO nova.api.openstack.requestlog [None req-69fa0d33-0171-4a10-b6bb-bd589868a602 tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] 10.222.0.75 "GET /compute/v2.1/servers/c71ec469-93f6-45d5-984f-838a1c27a5a1" status: 200 len: 1684 microversion: 2.1 time: 0.157384 May 26 12:57:10.702454 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: [pid: 129322|app: 0|req: 665/1310] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 26 12:57:10 2022] GET /compute/v2.1/servers/c71ec469-93f6-45d5-984f-838a1c27a5a1 => generated 1684 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:57:11.722589 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi [None req-638ed949-d971-4cb9-883c-5dba68e45ac8 tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] Calling method '>' {{(pid=129321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:57:11.723660 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.compute.api [None req-638ed949-d971-4cb9-883c-5dba68e45ac8 tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] [instance: c71ec469-93f6-45d5-984f-838a1c27a5a1] Fetching instance by UUID {{(pid=129321) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:57:11.732179 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-638ed949-d971-4cb9-883c-5dba68e45ac8 tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:57:11.732634 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-638ed949-d971-4cb9-883c-5dba68e45ac8 tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:57:11.733404 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-638ed949-d971-4cb9-883c-5dba68e45ac8 tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:57:11.733843 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-638ed949-d971-4cb9-883c-5dba68e45ac8 tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:57:11.847434 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.policy [None req-638ed949-d971-4cb9-883c-5dba68e45ac8 tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eddc5d9ac2a74507bca19e06f0051ae1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93d5b6bba38643bfb76f083e230b3d22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129321) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:57:11.856269 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: INFO nova.api.openstack.requestlog [None req-638ed949-d971-4cb9-883c-5dba68e45ac8 tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] 10.222.0.75 "GET /compute/v2.1/servers/c71ec469-93f6-45d5-984f-838a1c27a5a1" status: 200 len: 1616 microversion: 2.1 time: 0.139851 May 26 12:57:11.856834 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: [pid: 129321|app: 0|req: 646/1311] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 26 12:57:11 2022] GET /compute/v2.1/servers/c71ec469-93f6-45d5-984f-838a1c27a5a1 => generated 1616 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:57:12.123985 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi [req-225c869f-cd1d-4e7d-b26d-7d04c78cd6b5 req-e1fa0128-73bc-4729-b8f1-fd53280c9625 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c71ec469-93f6-45d5-984f-838a1c27a5a1", "name": "network-vif-deleted", "tag": "8957e038-7ecf-4b02-9f26-e7e6db3f8ab0"}]} {{(pid=129322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 12:57:12.134090 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [req-225c869f-cd1d-4e7d-b26d-7d04c78cd6b5 req-e1fa0128-73bc-4729-b8f1-fd53280c9625 service nova] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:57:12.134530 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [req-225c869f-cd1d-4e7d-b26d-7d04c78cd6b5 req-e1fa0128-73bc-4729-b8f1-fd53280c9625 service nova] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:57:12.147629 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: INFO nova.api.openstack.compute.server_external_events [req-225c869f-cd1d-4e7d-b26d-7d04c78cd6b5 req-e1fa0128-73bc-4729-b8f1-fd53280c9625 service nova] Creating event network-vif-deleted:8957e038-7ecf-4b02-9f26-e7e6db3f8ab0 for instance c71ec469-93f6-45d5-984f-838a1c27a5a1 on hv-cinder-81966 May 26 12:57:12.152905 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: INFO nova.api.openstack.requestlog [req-225c869f-cd1d-4e7d-b26d-7d04c78cd6b5 req-e1fa0128-73bc-4729-b8f1-fd53280c9625 service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032961 May 26 12:57:12.153821 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: [pid: 129322|app: 0|req: 666/1312] 10.222.0.75 () {64 vars in 1317 bytes} [Thu May 26 12:57:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 12:57:12.874350 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi [None req-1cd324d6-88d7-460b-afec-f96ac7892ea7 tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] Calling method '>' {{(pid=129321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:57:12.875258 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.compute.api [None req-1cd324d6-88d7-460b-afec-f96ac7892ea7 tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] [instance: c71ec469-93f6-45d5-984f-838a1c27a5a1] Fetching instance by UUID {{(pid=129321) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:57:12.887214 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-1cd324d6-88d7-460b-afec-f96ac7892ea7 tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:57:12.888250 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-1cd324d6-88d7-460b-afec-f96ac7892ea7 tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:57:12.889042 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-1cd324d6-88d7-460b-afec-f96ac7892ea7 tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:57:12.889470 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-1cd324d6-88d7-460b-afec-f96ac7892ea7 tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:57:12.926454 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-1cd324d6-88d7-460b-afec-f96ac7892ea7 tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:57:12.926454 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-1cd324d6-88d7-460b-afec-f96ac7892ea7 tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:57:12.927362 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.objects.instance [None req-1cd324d6-88d7-460b-afec-f96ac7892ea7 tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] Lazy-loading 'fault' on Instance uuid c71ec469-93f6-45d5-984f-838a1c27a5a1 {{(pid=129321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 26 12:57:12.972942 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.policy [None req-1cd324d6-88d7-460b-afec-f96ac7892ea7 tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eddc5d9ac2a74507bca19e06f0051ae1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93d5b6bba38643bfb76f083e230b3d22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129321) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:57:12.980479 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: INFO nova.api.openstack.requestlog [None req-1cd324d6-88d7-460b-afec-f96ac7892ea7 tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] 10.222.0.75 "GET /compute/v2.1/servers/c71ec469-93f6-45d5-984f-838a1c27a5a1" status: 200 len: 1332 microversion: 2.1 time: 0.110080 May 26 12:57:12.981108 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: [pid: 129321|app: 0|req: 647/1313] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 26 12:57:12 2022] GET /compute/v2.1/servers/c71ec469-93f6-45d5-984f-838a1c27a5a1 => generated 1332 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:57:13.999579 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi [None req-1ecbafcc-9883-490b-b7be-59bb63c64a31 tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] Calling method '>' {{(pid=129322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:57:14.000320 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.compute.api [None req-1ecbafcc-9883-490b-b7be-59bb63c64a31 tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] [instance: c71ec469-93f6-45d5-984f-838a1c27a5a1] Fetching instance by UUID {{(pid=129322) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:57:14.007123 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-1ecbafcc-9883-490b-b7be-59bb63c64a31 tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:57:14.007578 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-1ecbafcc-9883-490b-b7be-59bb63c64a31 tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:57:14.008344 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-1ecbafcc-9883-490b-b7be-59bb63c64a31 tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:57:14.008768 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-1ecbafcc-9883-490b-b7be-59bb63c64a31 tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:57:14.022731 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: INFO nova.api.openstack.wsgi [None req-1ecbafcc-9883-490b-b7be-59bb63c64a31 tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] HTTP exception thrown: Instance c71ec469-93f6-45d5-984f-838a1c27a5a1 could not be found. May 26 12:57:14.024342 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi [None req-1ecbafcc-9883-490b-b7be-59bb63c64a31 tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] Request method failure captured: May 26 12:57:14.024342 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: request: GET /compute/v2.1/servers/c71ec469-93f6-45d5-984f-838a1c27a5a1 HTTP/1.1 May 26 12:57:14.024342 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: Accept: application/json May 26 12:57:14.024342 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: Accept-Encoding: identity May 26 12:57:14.024342 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: Connection: close May 26 12:57:14.024342 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: Content-Length: 0 May 26 12:57:14.024342 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: Content-Type: application/json May 26 12:57:14.024342 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: Host: 10.222.0.75 May 26 12:57:14.024342 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: Openstack-System-Scope: None May 26 12:57:14.024342 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: User-Agent: python-urllib3/1.26.9 May 26 12:57:14.024342 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: X-Auth-Token: gAAAAABij3dy_ejiT_65wXWPYwZfIN-6WeUbfvEBcCDgX9L01CFqFU-nwaxJgQr_xdeJZky3mnpsSEy0WtYtz-shYs9kb1EXqBcjtE4c5z7FWjh8oWZK7TxUIPSLNV7p0eRBTjtvtICj3UXIwBcd_3erDIcqb3pLxZywjxdf6YmqLjQWXxRzhB0 May 26 12:57:14.024342 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: X-Domain-Id: None May 26 12:57:14.024342 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: X-Domain-Name: None May 26 12:57:14.024342 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: X-Identity-Status: Confirmed May 26 12:57:14.024342 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: X-Is-Admin-Project: True May 26 12:57:14.024342 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: X-Project-Domain-Id: default May 26 12:57:14.024342 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: X-Project-Domain-Name: Default May 26 12:57:14.024342 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: X-Project-Id: 93d5b6bba38643bfb76f083e230b3d22 May 26 12:57:14.024342 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: X-Project-Name: tempest-AttachVolumeNegativeTest-1109191477 May 26 12:57:14.024342 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: X-Role: member,reader May 26 12:57:14.024342 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: X-Roles: member,reader May 26 12:57:14.026217 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/93d5b6bba38643bfb76f083e230b3d22"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.75:8080", "publicURL": "http://10.222.0.75:8080/v1/AUTH_93d5b6bba38643bfb76f083e230b3d22"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2/93d5b6bba38643bfb76f083e230b3d22"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/93d5b6bba38643bfb76f083e230b3d22"}]}] May 26 12:57:14.026217 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: X-Tenant: tempest-AttachVolumeNegativeTest-1109191477 May 26 12:57:14.026217 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: X-Tenant-Id: 93d5b6bba38643bfb76f083e230b3d22 May 26 12:57:14.026217 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1109191477 May 26 12:57:14.026217 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: X-User: tempest-AttachVolumeNegativeTest-1109191477-project May 26 12:57:14.026217 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: X-User-Domain-Id: default May 26 12:57:14.026217 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: X-User-Domain-Name: Default May 26 12:57:14.026217 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: X-User-Id: eddc5d9ac2a74507bca19e06f0051ae1 May 26 12:57:14.026217 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: X-User-Name: tempest-AttachVolumeNegativeTest-1109191477-project May 26 12:57:14.026217 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: method: > May 26 12:57:14.026217 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: exception: Instance c71ec469-93f6-45d5-984f-838a1c27a5a1 could not be found. May 26 12:57:14.026217 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: action_args: {'id': 'c71ec469-93f6-45d5-984f-838a1c27a5a1'} May 26 12:57:14.027563 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: {{(pid=129322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 12:57:14.027563 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 12:57:14.027563 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 26 12:57:14.027563 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 26 12:57:14.027563 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 26 12:57:14.027563 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 26 12:57:14.027563 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 26 12:57:14.027563 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 26 12:57:14.027563 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 26 12:57:14.027563 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 26 12:57:14.027563 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c71ec469-93f6-45d5-984f-838a1c27a5a1 could not be found. May 26 12:57:14.027563 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi May 26 12:57:14.027563 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 12:57:14.027563 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi May 26 12:57:14.027563 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 12:57:14.027563 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 12:57:14.027563 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 12:57:14.027563 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 12:57:14.027563 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 12:57:14.027563 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 12:57:14.029496 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 12:57:14.029496 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 26 12:57:14.029496 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 26 12:57:14.029496 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 26 12:57:14.029496 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 26 12:57:14.029496 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 26 12:57:14.029496 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 12:57:14.029496 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c71ec469-93f6-45d5-984f-838a1c27a5a1 could not be found. May 26 12:57:14.029496 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi May 26 12:57:14.029496 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 12:57:14.029496 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi May 26 12:57:14.029496 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 12:57:14.029496 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 12:57:14.029496 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 12:57:14.029496 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 12:57:14.029496 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 12:57:14.029496 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c71ec469-93f6-45d5-984f-838a1c27a5a1 could not be found. May 26 12:57:14.029496 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi May 26 12:57:14.031100 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi [None req-1ecbafcc-9883-490b-b7be-59bb63c64a31 tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] Returning 404 to user: Instance c71ec469-93f6-45d5-984f-838a1c27a5a1 could not be found. {{(pid=129322) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 12:57:14.031100 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: INFO nova.api.openstack.requestlog [None req-1ecbafcc-9883-490b-b7be-59bb63c64a31 tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] 10.222.0.75 "GET /compute/v2.1/servers/c71ec469-93f6-45d5-984f-838a1c27a5a1" status: 404 len: 111 microversion: 2.1 time: 0.030989 May 26 12:57:14.031100 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: [pid: 129322|app: 0|req: 667/1314] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 26 12:57:13 2022] GET /compute/v2.1/servers/c71ec469-93f6-45d5-984f-838a1c27a5a1 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 26 12:57:14.036670 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi [None req-d110dd65-c838-4527-90a7-293466ab1d5e tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] Calling method '.version_select at 0x7f82fbf3c790>' {{(pid=129321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:57:14.061463 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: INFO nova.api.openstack.requestlog [None req-d110dd65-c838-4527-90a7-293466ab1d5e tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] 10.222.0.75 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1055227906" status: 202 len: 0 microversion: 2.1 time: 0.030506 May 26 12:57:14.062167 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: [pid: 129321|app: 0|req: 648/1315] 10.222.0.75 () {58 vars in 1220 bytes} [Thu May 26 12:57:14 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1055227906 => generated 0 bytes in 32 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 26 12:57:15.863850 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi [None req-fd45a9e0-3b18-4e55-afa7-dd79e3ced5e9 tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] Calling method '>' {{(pid=129322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:57:15.864542 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.compute.api [None req-fd45a9e0-3b18-4e55-afa7-dd79e3ced5e9 tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] [instance: c71ec469-93f6-45d5-984f-838a1c27a5a1] Fetching instance by UUID {{(pid=129322) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:57:15.874029 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-fd45a9e0-3b18-4e55-afa7-dd79e3ced5e9 tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:57:15.874778 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-fd45a9e0-3b18-4e55-afa7-dd79e3ced5e9 tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:57:15.875589 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-fd45a9e0-3b18-4e55-afa7-dd79e3ced5e9 tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:57:15.876094 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-fd45a9e0-3b18-4e55-afa7-dd79e3ced5e9 tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:57:15.892441 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: INFO nova.api.openstack.wsgi [None req-fd45a9e0-3b18-4e55-afa7-dd79e3ced5e9 tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] HTTP exception thrown: Instance c71ec469-93f6-45d5-984f-838a1c27a5a1 could not be found. May 26 12:57:15.894000 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi [None req-fd45a9e0-3b18-4e55-afa7-dd79e3ced5e9 tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] Request method failure captured: May 26 12:57:15.894000 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: request: DELETE /compute/v2.1/servers/c71ec469-93f6-45d5-984f-838a1c27a5a1 HTTP/1.1 May 26 12:57:15.894000 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: Accept: application/json May 26 12:57:15.894000 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: Accept-Encoding: identity May 26 12:57:15.894000 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: Connection: close May 26 12:57:15.894000 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: Content-Length: 0 May 26 12:57:15.894000 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: Content-Type: application/json May 26 12:57:15.894000 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: Host: 10.222.0.75 May 26 12:57:15.894000 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: Openstack-System-Scope: None May 26 12:57:15.894000 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: User-Agent: python-urllib3/1.26.9 May 26 12:57:15.894000 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: X-Auth-Token: gAAAAABij3dy_ejiT_65wXWPYwZfIN-6WeUbfvEBcCDgX9L01CFqFU-nwaxJgQr_xdeJZky3mnpsSEy0WtYtz-shYs9kb1EXqBcjtE4c5z7FWjh8oWZK7TxUIPSLNV7p0eRBTjtvtICj3UXIwBcd_3erDIcqb3pLxZywjxdf6YmqLjQWXxRzhB0 May 26 12:57:15.894000 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: X-Domain-Id: None May 26 12:57:15.894000 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: X-Domain-Name: None May 26 12:57:15.894000 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: X-Identity-Status: Confirmed May 26 12:57:15.894000 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: X-Is-Admin-Project: True May 26 12:57:15.894000 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: X-Project-Domain-Id: default May 26 12:57:15.894000 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: X-Project-Domain-Name: Default May 26 12:57:15.894000 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: X-Project-Id: 93d5b6bba38643bfb76f083e230b3d22 May 26 12:57:15.894000 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: X-Project-Name: tempest-AttachVolumeNegativeTest-1109191477 May 26 12:57:15.894000 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: X-Role: member,reader May 26 12:57:15.894000 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: X-Roles: member,reader May 26 12:57:15.896078 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/93d5b6bba38643bfb76f083e230b3d22"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.75:8080", "publicURL": "http://10.222.0.75:8080/v1/AUTH_93d5b6bba38643bfb76f083e230b3d22"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2/93d5b6bba38643bfb76f083e230b3d22"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/93d5b6bba38643bfb76f083e230b3d22"}]}] May 26 12:57:15.896078 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: X-Tenant: tempest-AttachVolumeNegativeTest-1109191477 May 26 12:57:15.896078 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: X-Tenant-Id: 93d5b6bba38643bfb76f083e230b3d22 May 26 12:57:15.896078 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1109191477 May 26 12:57:15.896078 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: X-User: tempest-AttachVolumeNegativeTest-1109191477-project May 26 12:57:15.896078 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: X-User-Domain-Id: default May 26 12:57:15.896078 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: X-User-Domain-Name: Default May 26 12:57:15.896078 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: X-User-Id: eddc5d9ac2a74507bca19e06f0051ae1 May 26 12:57:15.896078 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: X-User-Name: tempest-AttachVolumeNegativeTest-1109191477-project May 26 12:57:15.896078 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: method: > May 26 12:57:15.896078 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: exception: Instance c71ec469-93f6-45d5-984f-838a1c27a5a1 could not be found. May 26 12:57:15.896078 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: action_args: {'id': 'c71ec469-93f6-45d5-984f-838a1c27a5a1'} May 26 12:57:15.897099 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: {{(pid=129322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 12:57:15.897099 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 12:57:15.897099 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 26 12:57:15.897099 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 26 12:57:15.897099 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 26 12:57:15.897099 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 26 12:57:15.897099 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 26 12:57:15.897099 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 26 12:57:15.897099 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 26 12:57:15.897099 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 26 12:57:15.897099 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c71ec469-93f6-45d5-984f-838a1c27a5a1 could not be found. May 26 12:57:15.897099 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi May 26 12:57:15.897099 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 12:57:15.897099 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi May 26 12:57:15.897099 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 12:57:15.897099 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 12:57:15.897099 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 12:57:15.897099 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 12:57:15.897099 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 12:57:15.897099 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 12:57:15.898661 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 12:57:15.898661 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 26 12:57:15.898661 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 26 12:57:15.898661 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 26 12:57:15.898661 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 26 12:57:15.898661 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 26 12:57:15.898661 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 26 12:57:15.898661 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 26 12:57:15.898661 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 12:57:15.898661 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c71ec469-93f6-45d5-984f-838a1c27a5a1 could not be found. May 26 12:57:15.898661 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi May 26 12:57:15.898661 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 12:57:15.898661 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi May 26 12:57:15.898661 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 12:57:15.898661 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 12:57:15.898661 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 12:57:15.898661 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 12:57:15.898661 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 12:57:15.898661 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c71ec469-93f6-45d5-984f-838a1c27a5a1 could not be found. May 26 12:57:15.898661 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi May 26 12:57:15.900266 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi [None req-fd45a9e0-3b18-4e55-afa7-dd79e3ced5e9 tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] Returning 404 to user: Instance c71ec469-93f6-45d5-984f-838a1c27a5a1 could not be found. {{(pid=129322) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 12:57:15.900266 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: INFO nova.api.openstack.requestlog [None req-fd45a9e0-3b18-4e55-afa7-dd79e3ced5e9 tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] 10.222.0.75 "DELETE /compute/v2.1/servers/c71ec469-93f6-45d5-984f-838a1c27a5a1" status: 404 len: 111 microversion: 2.1 time: 0.036540 May 26 12:57:15.900266 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: [pid: 129322|app: 0|req: 668/1316] 10.222.0.75 () {58 vars in 1238 bytes} [Thu May 26 12:57:15 2022] DELETE /compute/v2.1/servers/c71ec469-93f6-45d5-984f-838a1c27a5a1 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 26 12:57:15.905595 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi [None req-c83099f5-6edd-4ef8-8dd2-e6e61ed90cb2 tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] Calling method '>' {{(pid=129321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:57:15.906213 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.compute.api [None req-c83099f5-6edd-4ef8-8dd2-e6e61ed90cb2 tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] [instance: c71ec469-93f6-45d5-984f-838a1c27a5a1] Fetching instance by UUID {{(pid=129321) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:57:15.913816 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-c83099f5-6edd-4ef8-8dd2-e6e61ed90cb2 tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:57:15.914661 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-c83099f5-6edd-4ef8-8dd2-e6e61ed90cb2 tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:57:15.915437 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-c83099f5-6edd-4ef8-8dd2-e6e61ed90cb2 tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:57:15.915896 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-c83099f5-6edd-4ef8-8dd2-e6e61ed90cb2 tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:57:15.930052 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: INFO nova.api.openstack.wsgi [None req-c83099f5-6edd-4ef8-8dd2-e6e61ed90cb2 tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] HTTP exception thrown: Instance c71ec469-93f6-45d5-984f-838a1c27a5a1 could not be found. May 26 12:57:15.931767 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi [None req-c83099f5-6edd-4ef8-8dd2-e6e61ed90cb2 tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] Request method failure captured: May 26 12:57:15.931767 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: request: GET /compute/v2.1/servers/c71ec469-93f6-45d5-984f-838a1c27a5a1 HTTP/1.1 May 26 12:57:15.931767 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: Accept: application/json May 26 12:57:15.931767 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: Accept-Encoding: identity May 26 12:57:15.931767 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: Connection: close May 26 12:57:15.931767 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: Content-Length: 0 May 26 12:57:15.931767 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: Content-Type: application/json May 26 12:57:15.931767 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: Host: 10.222.0.75 May 26 12:57:15.931767 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: Openstack-System-Scope: None May 26 12:57:15.931767 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: User-Agent: python-urllib3/1.26.9 May 26 12:57:15.931767 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: X-Auth-Token: gAAAAABij3dy_ejiT_65wXWPYwZfIN-6WeUbfvEBcCDgX9L01CFqFU-nwaxJgQr_xdeJZky3mnpsSEy0WtYtz-shYs9kb1EXqBcjtE4c5z7FWjh8oWZK7TxUIPSLNV7p0eRBTjtvtICj3UXIwBcd_3erDIcqb3pLxZywjxdf6YmqLjQWXxRzhB0 May 26 12:57:15.931767 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: X-Domain-Id: None May 26 12:57:15.931767 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: X-Domain-Name: None May 26 12:57:15.931767 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: X-Identity-Status: Confirmed May 26 12:57:15.931767 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: X-Is-Admin-Project: True May 26 12:57:15.931767 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: X-Project-Domain-Id: default May 26 12:57:15.931767 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: X-Project-Domain-Name: Default May 26 12:57:15.931767 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: X-Project-Id: 93d5b6bba38643bfb76f083e230b3d22 May 26 12:57:15.931767 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: X-Project-Name: tempest-AttachVolumeNegativeTest-1109191477 May 26 12:57:15.931767 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: X-Role: member,reader May 26 12:57:15.931767 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: X-Roles: member,reader May 26 12:57:15.933676 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/93d5b6bba38643bfb76f083e230b3d22"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.75:8080", "publicURL": "http://10.222.0.75:8080/v1/AUTH_93d5b6bba38643bfb76f083e230b3d22"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2/93d5b6bba38643bfb76f083e230b3d22"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/93d5b6bba38643bfb76f083e230b3d22"}]}] May 26 12:57:15.933676 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: X-Tenant: tempest-AttachVolumeNegativeTest-1109191477 May 26 12:57:15.933676 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: X-Tenant-Id: 93d5b6bba38643bfb76f083e230b3d22 May 26 12:57:15.933676 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1109191477 May 26 12:57:15.933676 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: X-User: tempest-AttachVolumeNegativeTest-1109191477-project May 26 12:57:15.933676 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: X-User-Domain-Id: default May 26 12:57:15.933676 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: X-User-Domain-Name: Default May 26 12:57:15.933676 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: X-User-Id: eddc5d9ac2a74507bca19e06f0051ae1 May 26 12:57:15.933676 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: X-User-Name: tempest-AttachVolumeNegativeTest-1109191477-project May 26 12:57:15.933676 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: method: > May 26 12:57:15.933676 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: exception: Instance c71ec469-93f6-45d5-984f-838a1c27a5a1 could not be found. May 26 12:57:15.933676 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: action_args: {'id': 'c71ec469-93f6-45d5-984f-838a1c27a5a1'} May 26 12:57:15.934652 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: {{(pid=129321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 12:57:15.934652 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 12:57:15.934652 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 26 12:57:15.934652 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 26 12:57:15.934652 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 26 12:57:15.934652 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 26 12:57:15.934652 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 26 12:57:15.934652 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 26 12:57:15.934652 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 26 12:57:15.934652 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 26 12:57:15.934652 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c71ec469-93f6-45d5-984f-838a1c27a5a1 could not be found. May 26 12:57:15.934652 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi May 26 12:57:15.934652 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 12:57:15.934652 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi May 26 12:57:15.934652 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 12:57:15.934652 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 12:57:15.934652 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 12:57:15.934652 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 12:57:15.934652 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 12:57:15.934652 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 12:57:15.936255 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 12:57:15.936255 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 26 12:57:15.936255 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 26 12:57:15.936255 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 26 12:57:15.936255 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 26 12:57:15.936255 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 26 12:57:15.936255 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 12:57:15.936255 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c71ec469-93f6-45d5-984f-838a1c27a5a1 could not be found. May 26 12:57:15.936255 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi May 26 12:57:15.936255 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 12:57:15.936255 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi May 26 12:57:15.936255 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 12:57:15.936255 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 12:57:15.936255 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 12:57:15.936255 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 12:57:15.936255 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 12:57:15.936255 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c71ec469-93f6-45d5-984f-838a1c27a5a1 could not be found. May 26 12:57:15.936255 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi May 26 12:57:15.937728 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi [None req-c83099f5-6edd-4ef8-8dd2-e6e61ed90cb2 tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] Returning 404 to user: Instance c71ec469-93f6-45d5-984f-838a1c27a5a1 could not be found. {{(pid=129321) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 12:57:15.937728 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: INFO nova.api.openstack.requestlog [None req-c83099f5-6edd-4ef8-8dd2-e6e61ed90cb2 tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] 10.222.0.75 "GET /compute/v2.1/servers/c71ec469-93f6-45d5-984f-838a1c27a5a1" status: 404 len: 111 microversion: 2.1 time: 0.032043 May 26 12:57:15.937728 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: [pid: 129321|app: 0|req: 649/1317] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 26 12:57:15 2022] GET /compute/v2.1/servers/c71ec469-93f6-45d5-984f-838a1c27a5a1 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 26 12:57:17.075900 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi [None req-f67c615f-0b52-490c-9e44-ff81c3c61666 tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] Calling method '>' {{(pid=129322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:57:17.076423 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.compute.api [None req-f67c615f-0b52-490c-9e44-ff81c3c61666 tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] [instance: e9e3e084-4a1a-4d21-b2e9-b51f79287094] Fetching instance by UUID {{(pid=129322) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:57:17.083392 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-f67c615f-0b52-490c-9e44-ff81c3c61666 tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:57:17.083885 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-f67c615f-0b52-490c-9e44-ff81c3c61666 tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:57:17.084755 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-f67c615f-0b52-490c-9e44-ff81c3c61666 tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:57:17.085184 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-f67c615f-0b52-490c-9e44-ff81c3c61666 tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:57:17.099340 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: INFO nova.api.openstack.wsgi [None req-f67c615f-0b52-490c-9e44-ff81c3c61666 tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] HTTP exception thrown: Instance e9e3e084-4a1a-4d21-b2e9-b51f79287094 could not be found. May 26 12:57:17.100940 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi [None req-f67c615f-0b52-490c-9e44-ff81c3c61666 tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] Request method failure captured: May 26 12:57:17.100940 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: request: DELETE /compute/v2.1/servers/e9e3e084-4a1a-4d21-b2e9-b51f79287094 HTTP/1.1 May 26 12:57:17.100940 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: Accept: application/json May 26 12:57:17.100940 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: Accept-Encoding: identity May 26 12:57:17.100940 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: Connection: close May 26 12:57:17.100940 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: Content-Length: 0 May 26 12:57:17.100940 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: Content-Type: application/json May 26 12:57:17.100940 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: Host: 10.222.0.75 May 26 12:57:17.100940 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: Openstack-System-Scope: None May 26 12:57:17.100940 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: User-Agent: python-urllib3/1.26.9 May 26 12:57:17.100940 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: X-Auth-Token: gAAAAABij3dy_ejiT_65wXWPYwZfIN-6WeUbfvEBcCDgX9L01CFqFU-nwaxJgQr_xdeJZky3mnpsSEy0WtYtz-shYs9kb1EXqBcjtE4c5z7FWjh8oWZK7TxUIPSLNV7p0eRBTjtvtICj3UXIwBcd_3erDIcqb3pLxZywjxdf6YmqLjQWXxRzhB0 May 26 12:57:17.100940 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: X-Domain-Id: None May 26 12:57:17.100940 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: X-Domain-Name: None May 26 12:57:17.100940 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: X-Identity-Status: Confirmed May 26 12:57:17.100940 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: X-Is-Admin-Project: True May 26 12:57:17.100940 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: X-Project-Domain-Id: default May 26 12:57:17.100940 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: X-Project-Domain-Name: Default May 26 12:57:17.100940 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: X-Project-Id: 93d5b6bba38643bfb76f083e230b3d22 May 26 12:57:17.100940 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: X-Project-Name: tempest-AttachVolumeNegativeTest-1109191477 May 26 12:57:17.100940 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: X-Role: member,reader May 26 12:57:17.100940 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: X-Roles: member,reader May 26 12:57:17.102614 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/93d5b6bba38643bfb76f083e230b3d22"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.75:8080", "publicURL": "http://10.222.0.75:8080/v1/AUTH_93d5b6bba38643bfb76f083e230b3d22"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2/93d5b6bba38643bfb76f083e230b3d22"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/93d5b6bba38643bfb76f083e230b3d22"}]}] May 26 12:57:17.102614 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: X-Tenant: tempest-AttachVolumeNegativeTest-1109191477 May 26 12:57:17.102614 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: X-Tenant-Id: 93d5b6bba38643bfb76f083e230b3d22 May 26 12:57:17.102614 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1109191477 May 26 12:57:17.102614 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: X-User: tempest-AttachVolumeNegativeTest-1109191477-project May 26 12:57:17.102614 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: X-User-Domain-Id: default May 26 12:57:17.102614 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: X-User-Domain-Name: Default May 26 12:57:17.102614 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: X-User-Id: eddc5d9ac2a74507bca19e06f0051ae1 May 26 12:57:17.102614 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: X-User-Name: tempest-AttachVolumeNegativeTest-1109191477-project May 26 12:57:17.102614 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: method: > May 26 12:57:17.102614 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: exception: Instance e9e3e084-4a1a-4d21-b2e9-b51f79287094 could not be found. May 26 12:57:17.102614 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: action_args: {'id': 'e9e3e084-4a1a-4d21-b2e9-b51f79287094'} May 26 12:57:17.103595 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: {{(pid=129322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 12:57:17.103595 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 12:57:17.103595 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 26 12:57:17.103595 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 26 12:57:17.103595 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 26 12:57:17.103595 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 26 12:57:17.103595 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 26 12:57:17.103595 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 26 12:57:17.103595 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 26 12:57:17.103595 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 26 12:57:17.103595 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e9e3e084-4a1a-4d21-b2e9-b51f79287094 could not be found. May 26 12:57:17.103595 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi May 26 12:57:17.103595 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 12:57:17.103595 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi May 26 12:57:17.103595 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 12:57:17.103595 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 12:57:17.103595 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 12:57:17.103595 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 12:57:17.103595 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 12:57:17.103595 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 12:57:17.105198 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 12:57:17.105198 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 26 12:57:17.105198 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 26 12:57:17.105198 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 26 12:57:17.105198 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 26 12:57:17.105198 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 26 12:57:17.105198 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 26 12:57:17.105198 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 26 12:57:17.105198 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 12:57:17.105198 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e9e3e084-4a1a-4d21-b2e9-b51f79287094 could not be found. May 26 12:57:17.105198 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi May 26 12:57:17.105198 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 12:57:17.105198 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi May 26 12:57:17.105198 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 12:57:17.105198 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 12:57:17.105198 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 12:57:17.105198 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 12:57:17.105198 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 12:57:17.105198 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e9e3e084-4a1a-4d21-b2e9-b51f79287094 could not be found. May 26 12:57:17.105198 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi May 26 12:57:17.106707 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi [None req-f67c615f-0b52-490c-9e44-ff81c3c61666 tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] Returning 404 to user: Instance e9e3e084-4a1a-4d21-b2e9-b51f79287094 could not be found. {{(pid=129322) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 12:57:17.106707 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: INFO nova.api.openstack.requestlog [None req-f67c615f-0b52-490c-9e44-ff81c3c61666 tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] 10.222.0.75 "DELETE /compute/v2.1/servers/e9e3e084-4a1a-4d21-b2e9-b51f79287094" status: 404 len: 111 microversion: 2.1 time: 0.030510 May 26 12:57:17.106707 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: [pid: 129322|app: 0|req: 669/1318] 10.222.0.75 () {58 vars in 1238 bytes} [Thu May 26 12:57:17 2022] DELETE /compute/v2.1/servers/e9e3e084-4a1a-4d21-b2e9-b51f79287094 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 26 12:57:17.111119 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi [None req-a850cdf5-2b0d-4292-9a3a-1556bc9cc0b4 tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] Calling method '>' {{(pid=129321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:57:17.111771 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.compute.api [None req-a850cdf5-2b0d-4292-9a3a-1556bc9cc0b4 tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] [instance: e9e3e084-4a1a-4d21-b2e9-b51f79287094] Fetching instance by UUID {{(pid=129321) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:57:17.118890 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-a850cdf5-2b0d-4292-9a3a-1556bc9cc0b4 tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:57:17.119342 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-a850cdf5-2b0d-4292-9a3a-1556bc9cc0b4 tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:57:17.120124 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-a850cdf5-2b0d-4292-9a3a-1556bc9cc0b4 tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:57:17.120559 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-a850cdf5-2b0d-4292-9a3a-1556bc9cc0b4 tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:57:17.133972 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: INFO nova.api.openstack.wsgi [None req-a850cdf5-2b0d-4292-9a3a-1556bc9cc0b4 tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] HTTP exception thrown: Instance e9e3e084-4a1a-4d21-b2e9-b51f79287094 could not be found. May 26 12:57:17.135505 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi [None req-a850cdf5-2b0d-4292-9a3a-1556bc9cc0b4 tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] Request method failure captured: May 26 12:57:17.135505 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: request: GET /compute/v2.1/servers/e9e3e084-4a1a-4d21-b2e9-b51f79287094 HTTP/1.1 May 26 12:57:17.135505 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: Accept: application/json May 26 12:57:17.135505 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: Accept-Encoding: identity May 26 12:57:17.135505 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: Connection: close May 26 12:57:17.135505 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: Content-Length: 0 May 26 12:57:17.135505 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: Content-Type: application/json May 26 12:57:17.135505 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: Host: 10.222.0.75 May 26 12:57:17.135505 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: Openstack-System-Scope: None May 26 12:57:17.135505 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: User-Agent: python-urllib3/1.26.9 May 26 12:57:17.135505 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: X-Auth-Token: gAAAAABij3dy_ejiT_65wXWPYwZfIN-6WeUbfvEBcCDgX9L01CFqFU-nwaxJgQr_xdeJZky3mnpsSEy0WtYtz-shYs9kb1EXqBcjtE4c5z7FWjh8oWZK7TxUIPSLNV7p0eRBTjtvtICj3UXIwBcd_3erDIcqb3pLxZywjxdf6YmqLjQWXxRzhB0 May 26 12:57:17.135505 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: X-Domain-Id: None May 26 12:57:17.135505 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: X-Domain-Name: None May 26 12:57:17.135505 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: X-Identity-Status: Confirmed May 26 12:57:17.135505 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: X-Is-Admin-Project: True May 26 12:57:17.135505 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: X-Project-Domain-Id: default May 26 12:57:17.135505 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: X-Project-Domain-Name: Default May 26 12:57:17.135505 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: X-Project-Id: 93d5b6bba38643bfb76f083e230b3d22 May 26 12:57:17.135505 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: X-Project-Name: tempest-AttachVolumeNegativeTest-1109191477 May 26 12:57:17.135505 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: X-Role: member,reader May 26 12:57:17.135505 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: X-Roles: member,reader May 26 12:57:17.137167 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/93d5b6bba38643bfb76f083e230b3d22"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.75:8080", "publicURL": "http://10.222.0.75:8080/v1/AUTH_93d5b6bba38643bfb76f083e230b3d22"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2/93d5b6bba38643bfb76f083e230b3d22"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/93d5b6bba38643bfb76f083e230b3d22"}]}] May 26 12:57:17.137167 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: X-Tenant: tempest-AttachVolumeNegativeTest-1109191477 May 26 12:57:17.137167 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: X-Tenant-Id: 93d5b6bba38643bfb76f083e230b3d22 May 26 12:57:17.137167 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1109191477 May 26 12:57:17.137167 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: X-User: tempest-AttachVolumeNegativeTest-1109191477-project May 26 12:57:17.137167 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: X-User-Domain-Id: default May 26 12:57:17.137167 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: X-User-Domain-Name: Default May 26 12:57:17.137167 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: X-User-Id: eddc5d9ac2a74507bca19e06f0051ae1 May 26 12:57:17.137167 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: X-User-Name: tempest-AttachVolumeNegativeTest-1109191477-project May 26 12:57:17.137167 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: method: > May 26 12:57:17.137167 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: exception: Instance e9e3e084-4a1a-4d21-b2e9-b51f79287094 could not be found. May 26 12:57:17.137167 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: action_args: {'id': 'e9e3e084-4a1a-4d21-b2e9-b51f79287094'} May 26 12:57:17.138053 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: {{(pid=129321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 12:57:17.138053 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 12:57:17.138053 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 26 12:57:17.138053 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 26 12:57:17.138053 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 26 12:57:17.138053 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 26 12:57:17.138053 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 26 12:57:17.138053 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 26 12:57:17.138053 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 26 12:57:17.138053 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 26 12:57:17.138053 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e9e3e084-4a1a-4d21-b2e9-b51f79287094 could not be found. May 26 12:57:17.138053 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi May 26 12:57:17.138053 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 12:57:17.138053 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi May 26 12:57:17.138053 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 12:57:17.138053 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 12:57:17.138053 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 12:57:17.138053 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 12:57:17.138053 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 12:57:17.138053 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 12:57:17.139361 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 12:57:17.139361 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 26 12:57:17.139361 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 26 12:57:17.139361 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 26 12:57:17.139361 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 26 12:57:17.139361 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 26 12:57:17.139361 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 12:57:17.139361 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e9e3e084-4a1a-4d21-b2e9-b51f79287094 could not be found. May 26 12:57:17.139361 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi May 26 12:57:17.139361 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 12:57:17.139361 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi May 26 12:57:17.139361 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 12:57:17.139361 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 12:57:17.139361 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 12:57:17.139361 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 12:57:17.139361 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 12:57:17.139361 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e9e3e084-4a1a-4d21-b2e9-b51f79287094 could not be found. May 26 12:57:17.139361 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi May 26 12:57:17.140570 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi [None req-a850cdf5-2b0d-4292-9a3a-1556bc9cc0b4 tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] Returning 404 to user: Instance e9e3e084-4a1a-4d21-b2e9-b51f79287094 could not be found. {{(pid=129321) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 12:57:17.140570 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: INFO nova.api.openstack.requestlog [None req-a850cdf5-2b0d-4292-9a3a-1556bc9cc0b4 tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] 10.222.0.75 "GET /compute/v2.1/servers/e9e3e084-4a1a-4d21-b2e9-b51f79287094" status: 404 len: 111 microversion: 2.1 time: 0.029880 May 26 12:57:17.140570 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: [pid: 129321|app: 0|req: 650/1319] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 26 12:57:17 2022] GET /compute/v2.1/servers/e9e3e084-4a1a-4d21-b2e9-b51f79287094 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 26 12:57:17.146021 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi [None req-07825eda-806e-4959-836b-7a1b89a7cb20 tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] Calling method '>' {{(pid=129322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:57:17.146521 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.compute.api [None req-07825eda-806e-4959-836b-7a1b89a7cb20 tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] [instance: 12795e31-07da-4c2a-8945-2c4b820f1bbf] Fetching instance by UUID {{(pid=129322) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:57:17.152945 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-07825eda-806e-4959-836b-7a1b89a7cb20 tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:57:17.153387 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-07825eda-806e-4959-836b-7a1b89a7cb20 tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:57:17.154135 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-07825eda-806e-4959-836b-7a1b89a7cb20 tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:57:17.154562 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-07825eda-806e-4959-836b-7a1b89a7cb20 tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:57:17.167919 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: INFO nova.api.openstack.wsgi [None req-07825eda-806e-4959-836b-7a1b89a7cb20 tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] HTTP exception thrown: Instance 12795e31-07da-4c2a-8945-2c4b820f1bbf could not be found. May 26 12:57:17.169434 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi [None req-07825eda-806e-4959-836b-7a1b89a7cb20 tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] Request method failure captured: May 26 12:57:17.169434 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: request: DELETE /compute/v2.1/servers/12795e31-07da-4c2a-8945-2c4b820f1bbf HTTP/1.1 May 26 12:57:17.169434 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: Accept: application/json May 26 12:57:17.169434 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: Accept-Encoding: identity May 26 12:57:17.169434 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: Connection: close May 26 12:57:17.169434 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: Content-Length: 0 May 26 12:57:17.169434 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: Content-Type: application/json May 26 12:57:17.169434 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: Host: 10.222.0.75 May 26 12:57:17.169434 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: Openstack-System-Scope: None May 26 12:57:17.169434 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: User-Agent: python-urllib3/1.26.9 May 26 12:57:17.169434 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: X-Auth-Token: gAAAAABij3dy_ejiT_65wXWPYwZfIN-6WeUbfvEBcCDgX9L01CFqFU-nwaxJgQr_xdeJZky3mnpsSEy0WtYtz-shYs9kb1EXqBcjtE4c5z7FWjh8oWZK7TxUIPSLNV7p0eRBTjtvtICj3UXIwBcd_3erDIcqb3pLxZywjxdf6YmqLjQWXxRzhB0 May 26 12:57:17.169434 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: X-Domain-Id: None May 26 12:57:17.169434 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: X-Domain-Name: None May 26 12:57:17.169434 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: X-Identity-Status: Confirmed May 26 12:57:17.169434 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: X-Is-Admin-Project: True May 26 12:57:17.169434 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: X-Project-Domain-Id: default May 26 12:57:17.169434 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: X-Project-Domain-Name: Default May 26 12:57:17.169434 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: X-Project-Id: 93d5b6bba38643bfb76f083e230b3d22 May 26 12:57:17.169434 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: X-Project-Name: tempest-AttachVolumeNegativeTest-1109191477 May 26 12:57:17.169434 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: X-Role: member,reader May 26 12:57:17.169434 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: X-Roles: member,reader May 26 12:57:17.171063 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/93d5b6bba38643bfb76f083e230b3d22"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.75:8080", "publicURL": "http://10.222.0.75:8080/v1/AUTH_93d5b6bba38643bfb76f083e230b3d22"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2/93d5b6bba38643bfb76f083e230b3d22"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/93d5b6bba38643bfb76f083e230b3d22"}]}] May 26 12:57:17.171063 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: X-Tenant: tempest-AttachVolumeNegativeTest-1109191477 May 26 12:57:17.171063 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: X-Tenant-Id: 93d5b6bba38643bfb76f083e230b3d22 May 26 12:57:17.171063 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1109191477 May 26 12:57:17.171063 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: X-User: tempest-AttachVolumeNegativeTest-1109191477-project May 26 12:57:17.171063 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: X-User-Domain-Id: default May 26 12:57:17.171063 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: X-User-Domain-Name: Default May 26 12:57:17.171063 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: X-User-Id: eddc5d9ac2a74507bca19e06f0051ae1 May 26 12:57:17.171063 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: X-User-Name: tempest-AttachVolumeNegativeTest-1109191477-project May 26 12:57:17.171063 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: method: > May 26 12:57:17.171063 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: exception: Instance 12795e31-07da-4c2a-8945-2c4b820f1bbf could not be found. May 26 12:57:17.171063 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: action_args: {'id': '12795e31-07da-4c2a-8945-2c4b820f1bbf'} May 26 12:57:17.172034 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: {{(pid=129322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 12:57:17.172034 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 12:57:17.172034 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 26 12:57:17.172034 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 26 12:57:17.172034 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 26 12:57:17.172034 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 26 12:57:17.172034 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 26 12:57:17.172034 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 26 12:57:17.172034 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 26 12:57:17.172034 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 26 12:57:17.172034 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 12795e31-07da-4c2a-8945-2c4b820f1bbf could not be found. May 26 12:57:17.172034 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi May 26 12:57:17.172034 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 12:57:17.172034 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi May 26 12:57:17.172034 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 12:57:17.172034 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 12:57:17.172034 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 12:57:17.172034 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 12:57:17.172034 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 12:57:17.172034 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 12:57:17.173583 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 12:57:17.173583 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 26 12:57:17.173583 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 26 12:57:17.173583 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 26 12:57:17.173583 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 26 12:57:17.173583 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 26 12:57:17.173583 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 26 12:57:17.173583 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 26 12:57:17.173583 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 12:57:17.173583 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 12795e31-07da-4c2a-8945-2c4b820f1bbf could not be found. May 26 12:57:17.173583 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi May 26 12:57:17.173583 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 12:57:17.173583 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi May 26 12:57:17.173583 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 12:57:17.173583 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 12:57:17.173583 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 12:57:17.173583 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 12:57:17.173583 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 12:57:17.173583 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 12795e31-07da-4c2a-8945-2c4b820f1bbf could not be found. May 26 12:57:17.173583 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi May 26 12:57:17.175086 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi [None req-07825eda-806e-4959-836b-7a1b89a7cb20 tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] Returning 404 to user: Instance 12795e31-07da-4c2a-8945-2c4b820f1bbf could not be found. {{(pid=129322) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 12:57:17.175086 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: INFO nova.api.openstack.requestlog [None req-07825eda-806e-4959-836b-7a1b89a7cb20 tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] 10.222.0.75 "DELETE /compute/v2.1/servers/12795e31-07da-4c2a-8945-2c4b820f1bbf" status: 404 len: 111 microversion: 2.1 time: 0.029153 May 26 12:57:17.175086 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: [pid: 129322|app: 0|req: 670/1320] 10.222.0.75 () {58 vars in 1238 bytes} [Thu May 26 12:57:17 2022] DELETE /compute/v2.1/servers/12795e31-07da-4c2a-8945-2c4b820f1bbf => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 26 12:57:17.179567 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi [None req-f95e1f36-1299-4779-ab27-b185d318c96a tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] Calling method '>' {{(pid=129321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:57:17.180197 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.compute.api [None req-f95e1f36-1299-4779-ab27-b185d318c96a tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] [instance: 12795e31-07da-4c2a-8945-2c4b820f1bbf] Fetching instance by UUID {{(pid=129321) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:57:17.186402 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-f95e1f36-1299-4779-ab27-b185d318c96a tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:57:17.186854 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-f95e1f36-1299-4779-ab27-b185d318c96a tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:57:17.187682 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-f95e1f36-1299-4779-ab27-b185d318c96a tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:57:17.188107 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-f95e1f36-1299-4779-ab27-b185d318c96a tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:57:17.202145 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: INFO nova.api.openstack.wsgi [None req-f95e1f36-1299-4779-ab27-b185d318c96a tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] HTTP exception thrown: Instance 12795e31-07da-4c2a-8945-2c4b820f1bbf could not be found. May 26 12:57:17.203786 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi [None req-f95e1f36-1299-4779-ab27-b185d318c96a tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] Request method failure captured: May 26 12:57:17.203786 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: request: GET /compute/v2.1/servers/12795e31-07da-4c2a-8945-2c4b820f1bbf HTTP/1.1 May 26 12:57:17.203786 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: Accept: application/json May 26 12:57:17.203786 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: Accept-Encoding: identity May 26 12:57:17.203786 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: Connection: close May 26 12:57:17.203786 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: Content-Length: 0 May 26 12:57:17.203786 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: Content-Type: application/json May 26 12:57:17.203786 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: Host: 10.222.0.75 May 26 12:57:17.203786 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: Openstack-System-Scope: None May 26 12:57:17.203786 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: User-Agent: python-urllib3/1.26.9 May 26 12:57:17.203786 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: X-Auth-Token: gAAAAABij3dy_ejiT_65wXWPYwZfIN-6WeUbfvEBcCDgX9L01CFqFU-nwaxJgQr_xdeJZky3mnpsSEy0WtYtz-shYs9kb1EXqBcjtE4c5z7FWjh8oWZK7TxUIPSLNV7p0eRBTjtvtICj3UXIwBcd_3erDIcqb3pLxZywjxdf6YmqLjQWXxRzhB0 May 26 12:57:17.203786 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: X-Domain-Id: None May 26 12:57:17.203786 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: X-Domain-Name: None May 26 12:57:17.203786 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: X-Identity-Status: Confirmed May 26 12:57:17.203786 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: X-Is-Admin-Project: True May 26 12:57:17.203786 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: X-Project-Domain-Id: default May 26 12:57:17.203786 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: X-Project-Domain-Name: Default May 26 12:57:17.203786 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: X-Project-Id: 93d5b6bba38643bfb76f083e230b3d22 May 26 12:57:17.203786 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: X-Project-Name: tempest-AttachVolumeNegativeTest-1109191477 May 26 12:57:17.203786 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: X-Role: member,reader May 26 12:57:17.203786 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: X-Roles: member,reader May 26 12:57:17.205449 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/93d5b6bba38643bfb76f083e230b3d22"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.75:8080", "publicURL": "http://10.222.0.75:8080/v1/AUTH_93d5b6bba38643bfb76f083e230b3d22"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2/93d5b6bba38643bfb76f083e230b3d22"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/93d5b6bba38643bfb76f083e230b3d22"}]}] May 26 12:57:17.205449 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: X-Tenant: tempest-AttachVolumeNegativeTest-1109191477 May 26 12:57:17.205449 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: X-Tenant-Id: 93d5b6bba38643bfb76f083e230b3d22 May 26 12:57:17.205449 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1109191477 May 26 12:57:17.205449 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: X-User: tempest-AttachVolumeNegativeTest-1109191477-project May 26 12:57:17.205449 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: X-User-Domain-Id: default May 26 12:57:17.205449 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: X-User-Domain-Name: Default May 26 12:57:17.205449 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: X-User-Id: eddc5d9ac2a74507bca19e06f0051ae1 May 26 12:57:17.205449 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: X-User-Name: tempest-AttachVolumeNegativeTest-1109191477-project May 26 12:57:17.205449 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: method: > May 26 12:57:17.205449 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: exception: Instance 12795e31-07da-4c2a-8945-2c4b820f1bbf could not be found. May 26 12:57:17.205449 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: action_args: {'id': '12795e31-07da-4c2a-8945-2c4b820f1bbf'} May 26 12:57:17.206380 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: {{(pid=129321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 12:57:17.206380 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 12:57:17.206380 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 26 12:57:17.206380 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 26 12:57:17.206380 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 26 12:57:17.206380 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 26 12:57:17.206380 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 26 12:57:17.206380 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 26 12:57:17.206380 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 26 12:57:17.206380 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 26 12:57:17.206380 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 12795e31-07da-4c2a-8945-2c4b820f1bbf could not be found. May 26 12:57:17.206380 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi May 26 12:57:17.206380 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 12:57:17.206380 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi May 26 12:57:17.206380 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 12:57:17.206380 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 12:57:17.206380 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 12:57:17.206380 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 12:57:17.206380 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 12:57:17.206380 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 12:57:17.207940 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 12:57:17.207940 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 26 12:57:17.207940 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 26 12:57:17.207940 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 26 12:57:17.207940 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 26 12:57:17.207940 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 26 12:57:17.207940 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 12:57:17.207940 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 12795e31-07da-4c2a-8945-2c4b820f1bbf could not be found. May 26 12:57:17.207940 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi May 26 12:57:17.207940 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 12:57:17.207940 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi May 26 12:57:17.207940 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 12:57:17.207940 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 12:57:17.207940 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 12:57:17.207940 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 12:57:17.207940 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 12:57:17.207940 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 12795e31-07da-4c2a-8945-2c4b820f1bbf could not be found. May 26 12:57:17.207940 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi May 26 12:57:17.209308 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi [None req-f95e1f36-1299-4779-ab27-b185d318c96a tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] Returning 404 to user: Instance 12795e31-07da-4c2a-8945-2c4b820f1bbf could not be found. {{(pid=129321) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 12:57:17.209308 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: INFO nova.api.openstack.requestlog [None req-f95e1f36-1299-4779-ab27-b185d318c96a tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] 10.222.0.75 "GET /compute/v2.1/servers/12795e31-07da-4c2a-8945-2c4b820f1bbf" status: 404 len: 111 microversion: 2.1 time: 0.029775 May 26 12:57:17.209308 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: [pid: 129321|app: 0|req: 651/1321] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 26 12:57:17 2022] GET /compute/v2.1/servers/12795e31-07da-4c2a-8945-2c4b820f1bbf => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 26 12:57:18.355815 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi [None req-4c32125f-8d66-4dec-b0b2-ba1cebac33df tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] Calling method '>' {{(pid=129322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:57:18.356348 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.compute.api [None req-4c32125f-8d66-4dec-b0b2-ba1cebac33df tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] [instance: 88867ead-523a-4d55-9311-bdddd200c270] Fetching instance by UUID {{(pid=129322) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:57:18.363077 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-4c32125f-8d66-4dec-b0b2-ba1cebac33df tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:57:18.363571 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-4c32125f-8d66-4dec-b0b2-ba1cebac33df tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:57:18.364358 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-4c32125f-8d66-4dec-b0b2-ba1cebac33df tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:57:18.364780 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG oslo_concurrency.lockutils [None req-4c32125f-8d66-4dec-b0b2-ba1cebac33df tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:57:18.380156 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: INFO nova.api.openstack.wsgi [None req-4c32125f-8d66-4dec-b0b2-ba1cebac33df tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] HTTP exception thrown: Instance 88867ead-523a-4d55-9311-bdddd200c270 could not be found. May 26 12:57:18.382120 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi [None req-4c32125f-8d66-4dec-b0b2-ba1cebac33df tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] Request method failure captured: May 26 12:57:18.382120 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: request: DELETE /compute/v2.1/servers/88867ead-523a-4d55-9311-bdddd200c270 HTTP/1.1 May 26 12:57:18.382120 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: Accept: application/json May 26 12:57:18.382120 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: Accept-Encoding: identity May 26 12:57:18.382120 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: Connection: close May 26 12:57:18.382120 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: Content-Length: 0 May 26 12:57:18.382120 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: Content-Type: application/json May 26 12:57:18.382120 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: Host: 10.222.0.75 May 26 12:57:18.382120 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: Openstack-System-Scope: None May 26 12:57:18.382120 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: User-Agent: python-urllib3/1.26.9 May 26 12:57:18.382120 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: X-Auth-Token: gAAAAABij3dy_ejiT_65wXWPYwZfIN-6WeUbfvEBcCDgX9L01CFqFU-nwaxJgQr_xdeJZky3mnpsSEy0WtYtz-shYs9kb1EXqBcjtE4c5z7FWjh8oWZK7TxUIPSLNV7p0eRBTjtvtICj3UXIwBcd_3erDIcqb3pLxZywjxdf6YmqLjQWXxRzhB0 May 26 12:57:18.382120 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: X-Domain-Id: None May 26 12:57:18.382120 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: X-Domain-Name: None May 26 12:57:18.382120 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: X-Identity-Status: Confirmed May 26 12:57:18.382120 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: X-Is-Admin-Project: True May 26 12:57:18.382120 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: X-Project-Domain-Id: default May 26 12:57:18.382120 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: X-Project-Domain-Name: Default May 26 12:57:18.382120 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: X-Project-Id: 93d5b6bba38643bfb76f083e230b3d22 May 26 12:57:18.382120 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: X-Project-Name: tempest-AttachVolumeNegativeTest-1109191477 May 26 12:57:18.382120 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: X-Role: member,reader May 26 12:57:18.382120 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: X-Roles: member,reader May 26 12:57:18.383851 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/93d5b6bba38643bfb76f083e230b3d22"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.75:8080", "publicURL": "http://10.222.0.75:8080/v1/AUTH_93d5b6bba38643bfb76f083e230b3d22"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2/93d5b6bba38643bfb76f083e230b3d22"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/93d5b6bba38643bfb76f083e230b3d22"}]}] May 26 12:57:18.383851 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: X-Tenant: tempest-AttachVolumeNegativeTest-1109191477 May 26 12:57:18.383851 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: X-Tenant-Id: 93d5b6bba38643bfb76f083e230b3d22 May 26 12:57:18.383851 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1109191477 May 26 12:57:18.383851 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: X-User: tempest-AttachVolumeNegativeTest-1109191477-project May 26 12:57:18.383851 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: X-User-Domain-Id: default May 26 12:57:18.383851 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: X-User-Domain-Name: Default May 26 12:57:18.383851 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: X-User-Id: eddc5d9ac2a74507bca19e06f0051ae1 May 26 12:57:18.383851 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: X-User-Name: tempest-AttachVolumeNegativeTest-1109191477-project May 26 12:57:18.383851 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: method: > May 26 12:57:18.383851 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: exception: Instance 88867ead-523a-4d55-9311-bdddd200c270 could not be found. May 26 12:57:18.383851 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: action_args: {'id': '88867ead-523a-4d55-9311-bdddd200c270'} May 26 12:57:18.385187 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: {{(pid=129322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 12:57:18.385187 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 12:57:18.385187 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 26 12:57:18.385187 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 26 12:57:18.385187 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 26 12:57:18.385187 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 26 12:57:18.385187 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 26 12:57:18.385187 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 26 12:57:18.385187 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 26 12:57:18.385187 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 26 12:57:18.385187 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 88867ead-523a-4d55-9311-bdddd200c270 could not be found. May 26 12:57:18.385187 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi May 26 12:57:18.385187 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 12:57:18.385187 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi May 26 12:57:18.385187 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 12:57:18.385187 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 12:57:18.385187 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 12:57:18.385187 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 12:57:18.385187 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 12:57:18.385187 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 12:57:18.387946 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 12:57:18.387946 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 26 12:57:18.387946 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 26 12:57:18.387946 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 26 12:57:18.387946 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 26 12:57:18.387946 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 26 12:57:18.387946 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 26 12:57:18.387946 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 26 12:57:18.387946 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 12:57:18.387946 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 88867ead-523a-4d55-9311-bdddd200c270 could not be found. May 26 12:57:18.387946 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi May 26 12:57:18.387946 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 12:57:18.387946 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi May 26 12:57:18.387946 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 12:57:18.387946 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 12:57:18.387946 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 12:57:18.387946 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 12:57:18.387946 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 12:57:18.387946 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 88867ead-523a-4d55-9311-bdddd200c270 could not be found. May 26 12:57:18.387946 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: ERROR nova.api.openstack.wsgi May 26 12:57:18.389976 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: DEBUG nova.api.openstack.wsgi [None req-4c32125f-8d66-4dec-b0b2-ba1cebac33df tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] Returning 404 to user: Instance 88867ead-523a-4d55-9311-bdddd200c270 could not be found. {{(pid=129322) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 12:57:18.389976 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: INFO nova.api.openstack.requestlog [None req-4c32125f-8d66-4dec-b0b2-ba1cebac33df tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] 10.222.0.75 "DELETE /compute/v2.1/servers/88867ead-523a-4d55-9311-bdddd200c270" status: 404 len: 111 microversion: 2.1 time: 0.031604 May 26 12:57:18.389976 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: [pid: 129322|app: 0|req: 671/1322] 10.222.0.75 () {58 vars in 1238 bytes} [Thu May 26 12:57:18 2022] DELETE /compute/v2.1/servers/88867ead-523a-4d55-9311-bdddd200c270 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 26 12:57:18.393525 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi [None req-1887a040-1f7d-45de-9375-d711a58ca7ee tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] Calling method '>' {{(pid=129321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:57:18.394175 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.compute.api [None req-1887a040-1f7d-45de-9375-d711a58ca7ee tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] [instance: 88867ead-523a-4d55-9311-bdddd200c270] Fetching instance by UUID {{(pid=129321) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:57:18.401361 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-1887a040-1f7d-45de-9375-d711a58ca7ee tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:57:18.401812 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-1887a040-1f7d-45de-9375-d711a58ca7ee tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:57:18.402584 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-1887a040-1f7d-45de-9375-d711a58ca7ee tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:57:18.403021 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG oslo_concurrency.lockutils [None req-1887a040-1f7d-45de-9375-d711a58ca7ee tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] Lock "20e2b1f2-33d6-4e23-a875-4a2cebf4cec0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:57:18.416966 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: INFO nova.api.openstack.wsgi [None req-1887a040-1f7d-45de-9375-d711a58ca7ee tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] HTTP exception thrown: Instance 88867ead-523a-4d55-9311-bdddd200c270 could not be found. May 26 12:57:18.418534 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi [None req-1887a040-1f7d-45de-9375-d711a58ca7ee tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] Request method failure captured: May 26 12:57:18.418534 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: request: GET /compute/v2.1/servers/88867ead-523a-4d55-9311-bdddd200c270 HTTP/1.1 May 26 12:57:18.418534 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: Accept: application/json May 26 12:57:18.418534 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: Accept-Encoding: identity May 26 12:57:18.418534 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: Connection: close May 26 12:57:18.418534 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: Content-Length: 0 May 26 12:57:18.418534 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: Content-Type: application/json May 26 12:57:18.418534 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: Host: 10.222.0.75 May 26 12:57:18.418534 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: Openstack-System-Scope: None May 26 12:57:18.418534 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: User-Agent: python-urllib3/1.26.9 May 26 12:57:18.418534 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: X-Auth-Token: gAAAAABij3dy_ejiT_65wXWPYwZfIN-6WeUbfvEBcCDgX9L01CFqFU-nwaxJgQr_xdeJZky3mnpsSEy0WtYtz-shYs9kb1EXqBcjtE4c5z7FWjh8oWZK7TxUIPSLNV7p0eRBTjtvtICj3UXIwBcd_3erDIcqb3pLxZywjxdf6YmqLjQWXxRzhB0 May 26 12:57:18.418534 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: X-Domain-Id: None May 26 12:57:18.418534 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: X-Domain-Name: None May 26 12:57:18.418534 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: X-Identity-Status: Confirmed May 26 12:57:18.418534 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: X-Is-Admin-Project: True May 26 12:57:18.418534 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: X-Project-Domain-Id: default May 26 12:57:18.418534 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: X-Project-Domain-Name: Default May 26 12:57:18.418534 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: X-Project-Id: 93d5b6bba38643bfb76f083e230b3d22 May 26 12:57:18.418534 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: X-Project-Name: tempest-AttachVolumeNegativeTest-1109191477 May 26 12:57:18.418534 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: X-Role: member,reader May 26 12:57:18.418534 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: X-Roles: member,reader May 26 12:57:18.420266 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/93d5b6bba38643bfb76f083e230b3d22"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.75:8080", "publicURL": "http://10.222.0.75:8080/v1/AUTH_93d5b6bba38643bfb76f083e230b3d22"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2/93d5b6bba38643bfb76f083e230b3d22"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/93d5b6bba38643bfb76f083e230b3d22"}]}] May 26 12:57:18.420266 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: X-Tenant: tempest-AttachVolumeNegativeTest-1109191477 May 26 12:57:18.420266 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: X-Tenant-Id: 93d5b6bba38643bfb76f083e230b3d22 May 26 12:57:18.420266 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1109191477 May 26 12:57:18.420266 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: X-User: tempest-AttachVolumeNegativeTest-1109191477-project May 26 12:57:18.420266 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: X-User-Domain-Id: default May 26 12:57:18.420266 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: X-User-Domain-Name: Default May 26 12:57:18.420266 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: X-User-Id: eddc5d9ac2a74507bca19e06f0051ae1 May 26 12:57:18.420266 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: X-User-Name: tempest-AttachVolumeNegativeTest-1109191477-project May 26 12:57:18.420266 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: method: > May 26 12:57:18.420266 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: exception: Instance 88867ead-523a-4d55-9311-bdddd200c270 could not be found. May 26 12:57:18.420266 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: action_args: {'id': '88867ead-523a-4d55-9311-bdddd200c270'} May 26 12:57:18.421203 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: {{(pid=129321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 12:57:18.421203 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 12:57:18.421203 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 26 12:57:18.421203 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 26 12:57:18.421203 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 26 12:57:18.421203 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 26 12:57:18.421203 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 26 12:57:18.421203 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 26 12:57:18.421203 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 26 12:57:18.421203 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 26 12:57:18.421203 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 88867ead-523a-4d55-9311-bdddd200c270 could not be found. May 26 12:57:18.421203 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi May 26 12:57:18.421203 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 12:57:18.421203 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi May 26 12:57:18.421203 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 12:57:18.421203 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 12:57:18.421203 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 12:57:18.421203 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 12:57:18.421203 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 12:57:18.421203 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 12:57:18.423024 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 12:57:18.423024 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 26 12:57:18.423024 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 26 12:57:18.423024 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 26 12:57:18.423024 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 26 12:57:18.423024 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 26 12:57:18.423024 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 12:57:18.423024 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 88867ead-523a-4d55-9311-bdddd200c270 could not be found. May 26 12:57:18.423024 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi May 26 12:57:18.423024 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 12:57:18.423024 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi May 26 12:57:18.423024 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 12:57:18.423024 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 12:57:18.423024 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 12:57:18.423024 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 12:57:18.423024 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 12:57:18.423024 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 88867ead-523a-4d55-9311-bdddd200c270 could not be found. May 26 12:57:18.423024 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: ERROR nova.api.openstack.wsgi May 26 12:57:18.424505 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: DEBUG nova.api.openstack.wsgi [None req-1887a040-1f7d-45de-9375-d711a58ca7ee tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] Returning 404 to user: Instance 88867ead-523a-4d55-9311-bdddd200c270 could not be found. {{(pid=129321) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 12:57:18.424505 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: INFO nova.api.openstack.requestlog [None req-1887a040-1f7d-45de-9375-d711a58ca7ee tempest-AttachVolumeNegativeTest-1109191477 tempest-AttachVolumeNegativeTest-1109191477-project] 10.222.0.75 "GET /compute/v2.1/servers/88867ead-523a-4d55-9311-bdddd200c270" status: 404 len: 111 microversion: 2.1 time: 0.030365 May 26 12:57:18.424505 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: [pid: 129321|app: 0|req: 652/1323] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 26 12:57:18 2022] GET /compute/v2.1/servers/88867ead-523a-4d55-9311-bdddd200c270 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 26 12:58:07.320811 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 26 12:58:07.321482 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: Thu May 26 12:58:07 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 26 12:58:10.801180 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 26 12:58:10.801938 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: Thu May 26 12:58:10 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 26 12:59:48.372990 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 26 12:59:48.373694 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: Thu May 26 12:59:48 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 26 12:59:56.442105 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 26 12:59:56.442829 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: Thu May 26 12:59:56 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 26 13:00:12.629055 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 26 13:00:12.629729 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: Thu May 26 13:00:12 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 26 13:00:15.370101 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 26 13:00:15.370707 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: Thu May 26 13:00:15 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 26 13:01:27.330819 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 26 13:01:27.331657 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: Thu May 26 13:01:27 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 26 13:01:30.810428 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 26 13:01:30.811510 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: Thu May 26 13:01:30 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 26 13:03:08.382100 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 26 13:03:08.382784 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: Thu May 26 13:03:08 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 26 13:03:16.451937 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 26 13:03:16.452728 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: Thu May 26 13:03:16 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 26 13:03:32.638743 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 26 13:03:32.639649 dv-cinder-819667-4-iscsi devstack@n-api.service[129322]: Thu May 26 13:03:32 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 26 13:03:35.379518 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 26 13:03:35.380209 dv-cinder-819667-4-iscsi devstack@n-api.service[129321]: Thu May 26 13:03:35 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!